My research topic has changed significantly over the past few years, and since I rarely update my LinkedIn, I thought I might post here to share with my LinkedIn connections the research areas I am excited about.

Here is a recent invited lecture I gave at NYU on Instruction finetuning and Reinforcement Learning with Human Feedback (RLHF). These are the deep learning technique that power Large Language Models such as ChatGPT.

Video: https://lnkd.in/g2ry3VKh
Slides: https://lnkd.in/gmMXkGDZ
Twitter summary: https://lnkd.in/gtbXtrfU

Elon Musk: "People get confused. They sometimes think an economy is money. Money is a database for exchange of goods & services. Money is a database. Money doesn't have power in & of itself. The actual economy is goods & services.

You're trapped on a remote island, shipwrecked on an island. And you have a trillion dollars in a Swiss bank account - It's worthless. You'd rather have some kind of soup. All the Bitcoin in the world, and you're still gonna starve.”

The Metagame: Think One Step Ahead
"The metagame is about understanding the bigger picture and outsmarting the competition by doing something they can’t or won’t do. When you understand why your competitors do the things they do, you can choose to play a game they can’t play."
— Source
Insight

“Hope begins in the dark, the stubborn hope that if you just show up and try to do the right thing, the dawn will come.”
— Anne Lamott
Tiny Thought

Everyone is a perfectionist when they care enough.
If you're not obsessed with it, you'll never master it.
The reason you won't master it is because you won't care enough to be a perfectionist.
(Click here to share on Twitter)
Etc.

Elizabeth Gilbert reflects on the death of her partner:
"I have learned that Grief is a force of energy that cannot be controlled or predicted. It comes and goes on its own schedule. Grief does not obey your plans, or your wishes. Grief will do whatever it wants to you, whenever it wants to. In that regard, Grief has a lot in common with Love. The only way that I can “handle” Grief, then, is the same way that I “handle” Love — by not “handling” it. By bowing down before its power, in complete humility.”
— Source

https://twitter.com/clickup/status/1660284384430243841

트위터에서 자주 하는 마케팅 방식

xx 컨텐츠를 공유받고 싶으면 팔로우, Reply해라.

가끔 미친 생각을 현실화하는 것을 보면 낭만있다고 생각했는데 그런 사례들이 계속 나올 수 있는 건 게임의 룰이 그런 사람들에게 최적화되어 있을 수도.

https://twitter.com/adcock_brett/status/1660340140273967104

Obvious fact, India will be next China

https://twitter.com/nitin_gadkari/status/1659484858769604608

It is unfortunate that only a few Koreans show interest in India, despite the projection that India's influence will significantly increase in the coming decades. Over the past few decades, substantial investments from American and Japanese entities have been made in this country.

People search chatgpt a lot.

History of SEO

Would you tell me the history of SEO related services?

When did it start? Who were the first movers? What changed the competition with what? What also changed the first version of competitions?

The history of SEO related services can be traced back to the early days of the internet, when search engines were first being developed. In the beginning, search engines were relatively simple and ranking websites was based on a few basic factors, such as the number of times a keyword appeared on a website. However, as search engines became more sophisticated, they began to use a wider range of factors to rank websites, including the quality of the content, the number of backlinks to a website, and the user experience.

As the importance of SEO became more apparent, businesses began to hire SEO professionals to help them improve their website ranking. The first SEO professionals were typically web developers and programmers who had a good understanding of how search engines worked. However, as the SEO industry grew, more specialized SEO professionals began to emerge, such as keyword researchers, content writers, and link builders.

The SEO industry has changed significantly over the years. In the early days, SEO was relatively easy to manipulate. However, as search engines have become more sophisticated, they have become better at detecting and penalizing websites that engage in black hat SEO techniques. As a result, SEO has become more complex and requires a deep understanding of search engine algorithms.

The competition in the SEO industry is fierce. There are many SEO companies and individuals who offer SEO services, and it can be difficult to choose the right one. It is important to do your research and choose an SEO company that has a proven track record of success.

Here are some of the factors that have changed the SEO industry over the years:

The rise of social media: Social media has become an important factor in SEO. Websites that are active on social media tend to rank higher in search engines.
The importance of mobile-friendly websites: More and more people are using mobile devices to search the web. As a result, it is important to have a website that is mobile-friendly.
The increasing importance of content: Quality content is essential for SEO. Websites that have high-quality content tend to rank higher in search engines.
The changing algorithms of search engines: Search engines are constantly updating their algorithms. This means that SEO professionals need to be constantly adapting their strategies.
The SEO industry is constantly evolving. It is important to stay up-to-date on the latest trends and strategies in order to be successful.

요즘 airbnb에 대해서 많이 생각을 하는데,
만약에... airbnb가 공유 모델 없이 호텔과 부동산을 매입해 가면서 그냥 서비스를 했으면, 지금의 airbnb 가 되었을까?
airbnb의 성공에 유저 경험이 가장 큰 이유라고 하면, 메리어트나 하얏트가 못 따라갈 IT적 인터페이스를 선점하는 것만으로도 지금의 시장 규모에 도달하지 않았을까?
비슷한 사례로 카카오 T를 보면, 굳이 소카가 아니더라도 택시에 앱만 붙여서 잘 불러지고 잘 잡히게만 만들어도 성공한다.
근데 여기서 재밌는 점은 그렇게 시장 점유까지는 될지 몰라도, 절대 지금의 환상적인?? 숙소들이 등장하지는 않았을 것이라는 것. Uber와 Airbnb에 차이점은 공유모델 자체가 새로운 경험을 창출하는가 단지 택시의 경험을 대체하는가에 있다. Uber를 보면 그냥 잘 교육된 택시 + 약간 더 큰 자동차도 부를 수 있는 장점 정도 이지만, Airbnb는 스포츠카를 부를 수 있다고나 할까.. 호텔과 전혀 다른 경험의 숙소와 관련 경험을 할 수 있게 해준다.
공유 경제가 성공하려면, 단순히 비용 문제 해결만 해서는 안되고, 경험 차별성을 만들어야 된다. (성공시키기기가 어렵단 이야기...^^ + 한번 성공시키면 망하기가 어렵단 이야기 ... ^^)

과거에는 춤, 노래 등 끼가 있는 인재들이 돈을 벌기 위해서는 TV에 출현해서 광고 + 공연비를 벌 수 있는 수준의 스타가 되지 않으면 기회가 없었는데 유투브, Instagram, Tiktok이라는 플랫폼 덕분에 수많은 사람이 컨텐츠 제공자가 되고 다양하고 좋은 퀄리티의 컨텐츠들이 쏟아져 나온 것도 비슷한 것 같아요 ㅎㅎ.
Airbnb, Uber는 모바일이라는 기술의 변화를 잘 활용해서 기존에 서비스 제공자가 아닌 사람들이 새로운 서비스를 영위할 수 있게 도와준 것이고, 위에 유투브, Instagram, Tiktok도 마찬가지로 새로운 유형의 컨텐츠 제공자들에게 기회를 제공했다고 생각합니다.
마찬가지로 인터넷이 생기면서 과거에는 스타 작가만이 돈을 벌 수 있었다면 블로그에 광고 수익이라는 게 생기면서 스타 작가 수준이 아니더라도 어느정도 수익을 창출할 수 있게되었고 이게 웹툰, 웹소설까지 이어진 것 같습니다 🙂
크립토/블록체인에 크리에이터들이 많은 관심을 가지는 이유도 새로운 형식의 수익모델 혹은 Incentive시스템이기 때문에 그렇지 않을까요?~ ㅎㅎ

오늘 제가 자주 이용하는 AI 서비스 몇 가지를 소개하려고 합니다! 🤖


1️⃣ ChatGPT:https://chat.openai.com/
GPT-4를 $20에 사용하시는 것을 추천드립니다. GPT-4 한도 초과 시 Natdev에서 사용해 보세요. Natdev에서는 GPT-4 & Claude 모델이 많이 사용됩니다.

AutoGPT를 테스트하려면 GPT API를 받아 사용해보세요. https://babyagi-ui.vercel.app/ko 아직 부족한 점은 많지만 여러 링크를 요약하거나 읽을 때 유용합니다.

2️⃣ Natdev: https://nat.dev/

여러 모델을 비교하여 사용 가능하며, 주로 GPT-4, Claude를 활용합니다.

3️⃣ 최신 정보 검색:

1. Perplexity https://www.perplexity.ai/threads
2. Bard: https://bard.google.com/
3. Bing https://www.bing.com/

4️⃣ 모바일
- ChatGPT Mobile/Poe많이 씁니다.

5️⃣ 번역
https://www.deepl.com/translator

6️⃣Youtube 요약
1. Assembly AI: https://www.assemblyai.com/playground/v2
2. Video Summarize: https://vidsummize.com/

7️⃣Prompt 최적화
1. Nat Dev에서 목표 달성을 위해서 Prompt를 최적화해달라고 함.
2. AIRPM(Prompt Market Place): https://chrome.google.com/webstore/detail/aiprm-for-chatgpt/ojnbohmppadfgpejeebfnmnknjdlckgj
3. Prompt 잘 쓰기: https://www.promptingguide.ai/

8️⃣ Google Drive Docs/Excel 명령어
https://workspace.google.com/u/0/marketplace/app/gpt_for_sheets_and_docs/677318054654
- 구글 닥스/엑셀에서 바로 GPT를 사용할 수 있습니다. (API키가 필요해요 ㅎㅎ)

Maybe dev community could be great strategy to bootstrap at the beginning.

LLM Pre-training vs. Instruction-Tuning

-LLaMa 65B pre-trained
-Only simple fine-tuning,
w/ only 1k (carefully chosen) data points,
no RLHF

-Can plan trips & speculate about alternate histories
-Generalizes to unseen tasks
-Humans prefer it over GPT-3

arxiv.org/abs/2305.11206