Continuous Learning_Startup & Investment
2.43K subscribers
513 photos
5 videos
16 files
2.74K links
We journey together through the captivating realms of entrepreneurship, investment, life, and technology. This is my chronicle of exploration, where I capture and share the lessons that shape our world. Join us and let's never stop learning!
Download Telegram
Based on the available data, the usage of ChatGPT in the selected countries is as follows:

1. United States: The United States accounts for 15.32% of the total audience using ChatGPT
2. India: India accounts for 6.32% of the total audience using ChatGPT.
3. Japan: Japan accounts for 3.97% of the total audience using ChatGPT.
4. Canada: Canada accounts for 2.74% of the total audience using ChatGPT.
5. Other countries: The rest of the world accounts for 68.36% of visits to ChatGPT's website.
Coming AI event in sf
๐Ÿ’โ€โ™‚๏ธ How to Play Long Term Games:

Systems > Goals
Discipline > Motivation
Trust > Distrust
Principles > Tactics
Writing > Reading
Vulnerability > Confidence
North Stars > Low Hanging Fruit
Trends > News
Habits > Sprints
Questions > Answers
Problems > Solutions
People > Projects
AI๊ฐ€ ๊ฒŒ์ž„์˜ ์ œ์ž‘๋ถ€ํ„ฐ ๊ฒŒ์ž„์˜ UI/UX๊นŒ์ง€ ๋งŽ์€ ๋ถ€๋ถ„์„ ๋ณ€ํ™”์‹œ์ผœ๋†“์„ ๊ฑฐ๋ผ๊ณ  ์ƒ๊ฐํ•ฉ๋‹ˆ๋‹ค.

์ง€๋‚œ ๋ช‡๋…„๊ฐ„ AI ๋ชจ๋ธ์€ ์—„์ฒญ๋‚œ ์†๋„๋กœ ๋ณ€ํ™”ํ•ด์™”๋Š”๋ฐ์š”. ๊ฐ€์žฅ ์ตœ์‹ ์˜ AI ๋ชจ๋ธ์˜ ๋ฐœ์ „ ์—ญ์‚ฌ์™€ ์•ž์œผ๋กœ ์˜ˆ์ƒ๋˜๋Š” AI ์—ฐ๊ตฌ์ฃผ์ œ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋ฏธ๋ž˜์˜ ๊ฒŒ์ž„์„ ์ƒ์ƒํ•ด๋ด…๋‹ˆ๋‹ค.

Stable Diffusion ๋ชจ๋ธ์ด ๋น ๋ฅด๊ฒŒ ํ˜์‹ ํ•˜๋ฉด์„œ, ๊ฒŒ์ž„ ์•„ํŠธ์™€ ๊ด€๋ จํ•ด์„œ ๋‹ค์–‘ํ•œ ์‹คํ—˜์ด ์ด๋ฃจ์–ด์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๊ฒŒ์ž„ ์•„ํŠธ๋ฅผ ๊ธฐํšํ•˜๊ณ  ๊ฐœ๋ฐœํ•˜๋Š” ๊ณผ์ •์—์„œ AI๋ฅผ ์ž˜ ์‚ฌ์šฉํ•œ ํ”„๋กœ์„ธ์Šค๋Š” ๋ญ˜๊นŒ์š”?

์ด ๋‘๊ฐ€์ง€ ์งˆ๋ฌธ์— ๋Œ€ํ•ด์„œ ๊ถ๊ธˆ์ฆ์ด ์ƒ๊ธฐ์…จ๋‹ค๋ฉด ์•„๋ž˜ ๊ตฌ๊ธ€ํผ์„ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š” ๐Ÿ™‚

https://forms.gle/RFJjwqELL9juekP66
What era do we live in?

A wide range of AI tasks that used to take 5 years and a research team to accomplish in 2013, now just require API docs and a spare afternoon in 2023.

Not a single PhD in sight. When it comes to shipping AI products, you want engineers, not researchers.

Microsoft, Google, Meta, and the large Foundation Model labs have cornered scarce research talent to essentially deliver โ€œAI Research as a Serviceโ€ APIs. You canโ€™t hire them, but you can rent them โ€” if you have software engineers on the other end who know how to work with them. There are ~5000 LLM researchers in the world, but ~50m software engineers. Supply constraints dictate that an โ€œin-betweenโ€ class of AI Engineers will rise to meet demand.

Fire, ready, aim. Instead of requiring data scientists/ML engineers do a laborious data collection exercise before training a single domain specific model that is then put into production, a product manager/software engineer can prompt an LLM, and build/validate a product idea, before getting specific data to finetune.

Letโ€™s say there are 100-1000x more of the latter than the former, and the โ€œfire, ready, aimโ€ workflow of prompted LLM prototypes lets you move 10-100x faster than traditional ML. So AI Engineers will be able to validate AI products say 1,000-10,000x cheaper. Itโ€™s Waterfall vs Agile, all over again. AI is Agile.
๐Ÿ†• post: You Are Not Too Old
(To Pivot Into AI)

https://twitter.com/swyx/status/1641849911326150661
์ƒˆ๋กœ์šด ๊ฒƒ์ด ๋“ฑ์žฅํ•˜๋ฉด ๊ทธ ๋ˆ„๊ตฌ๋„ ์ „๋ฌธ๊ฐ€๊ฐ€ ๋  ์ˆ˜ ์—†๋Š” ์‹œ๊ธฐ๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค. ๊ทธ์ € ๊ด€์‹ฌ ์žˆ๋Š” ์‚ฌ๋žŒ๋“ค๋งŒ ๊ด€์‹ฌ์„ ๊ฐ–๊ณ  ๊ฐ€์ง€๊ณ  ๋†€๋ฉฐ ์„œ๋กœ ์ด์•ผ๊ธฐํ•  ๋ฟ์ž…๋‹ˆ๋‹ค. ํ•˜์ง€๋งŒ ๊ฒฐ๊ตญ์—๋Š” ๊ทธ ์ผ์ด ์„ฑ์ˆ™ํ•ด์ง€๊ณ  ๊ทธ ์ฐฝ์ด ๋‹ซํž™๋‹ˆ๋‹ค. ์ง„์ž… ์žฅ๋ฒฝ์ด ํ›จ์”ฌ ๋†’์•„์ง„ ํ›„์—๋Š”์š”.

๋‹น์‹ ์€ AI๋กœ ์ „ํ™˜ํ•˜๊ธฐ ์œ„ํ•ด ๋„ˆ๋ฌด ๋Š™์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.

https://www.latent.space/p/not-old
AI x Design: https://www.figma.com/blog/ai-the-next-chapter-in-design/

ํ˜น์‹œ Design ์ชฝ ์ปค๋ฆฌ์–ด๋ฅผ ๊ฐ€์ ธ๊ฐ€๊ณ  ์žˆ๋Š” ๋ถ„๋“ค์ค‘ ์‹ค๋ ฅ๊ณผ ๊ด€์‹ฌ ๋‘๊ฐ€์ง€๊ฐ€ ๋‹ค ์žˆ๋Š” ์ง€์ธ ๋ถ„๋“ค์ด ์žˆ์œผ์‹ค๊นŒ์š”?~ ใ…Žใ…Ž
5๋ช…์ •๋„๋งŒ ๋ชจ์—ฌ๋„ ์žฌ๋ฐŒ๋Š” ์ด์•ผ๊ธฐ ๋งŽ์ด ํ•  ์ˆ˜ ์žˆ์„ ๊ฒƒ ๊ฐ™์€๋ฐ์š”!
Continuous Learning_Startup & Investment
I found GitHub to be the best organizer of AI-related newsletters and podcasts. Eureka!!! https://github.com/swyxio/ai-notes/blob/main/Resources/Good%20AI%20Podcasts%20and%20Newsletters.md
์˜ค๋Š˜ ๋ฐœ๊ฒฌํ•œ ์žฌ๋ฐŒ๋Š” ๊นƒํ—™. ์žฌ๋ฐŒ๋Š” ๊ฒŒ ๋„ˆ๋ฌด ๋งŽ๋„ค ๐Ÿคฃ

AI ๋ธ”๋กœ๊ทธ ์šด์˜์ž์ด์ž ํŒŸ์บ์ŠคํŠธ ํ˜ธ์ŠคํŠธ https://latent.space/

AI note: https://github.com/swyxio/ai-notes/tree/main
- ํ™œ์šฉ์‚ฌ๋ก€
- ์ดˆ์‹ฌ์ž/์ค‘๊ธ‰์ž/๊ณ ์ˆ˜๊ฐ€ ์ฝ์„ ๊ฑฐ๋ฆฌ
- ์ปค๋ฎค๋‹ˆํ‹ฐ
- People
- Reality & Demotivations
- Legal, Ethics, and Privacy
- Alignment, Safety

Good AI Podcasts and Newsletters: https://github.com/swyxio/ai-notes/blob/main/Resources/Good%20AI%20Podcasts%20and%20Newsletters.md
์ง€๋‚œ ๋ฉฐ์น ๋™์•ˆ ํ”„๋ž‘์Šค ๋ถ€๋ฅด๊ณ ๋‰ด ์ง€๋ฐฉ์„œ ์œ ๋ช…ํ•œ ์™€์ด๋„ˆ๋ฆฌ ์˜ค๋„ˆ๋“ค๊ณผ ์‹œ์Œํ•˜๊ณ , ์‹์‚ฌํ•˜๊ณ  ๋˜ ์Œ์•…์„ ์ฆ๊ธฐ๋Š” ์‹œ๊ฐ„์„ ๊ฐ€์กŒ๋‹ค. ํŠน๋ณ„ํ•œ ์ธ์—ฐ๋•Œ๋ฌธ ์•„๋‹ˆ๋ผ ๊ทธ๋ƒฅ ์•„๋Š” ์‚ฌ๋žŒ์ด ์†Œ์ˆ˜์ธ์› (8๋ช…) ๊ฐ€๋Š” ์ผ์ •์„ ๋งŒ๋“ค์—ˆ๋Š”๋ฐ ๊ฑฐ๊ธฐ ๋ผ์—ฌ์„œ ๊ฐ”๋‹ค.

ํƒœ๊ตญ๊ธฐ์—…์ด์ง€๋งŒ ์„ธ๊ณ„์ ์œผ๋กœ ์‚ฌ์—…ํ•˜๋Š” ์‚ฌ๋žŒ, ํ˜ธ์ฃผ ๋Œ€๊ธฐ์—… ๋Œ€ํ‘œ, ๋˜ ์ƒ์žฅ๊ธฐ์—… ํˆฌ์ž๊ฐ€ ๊ทธ๋ฆฌ๊ณ  ๋‚˜... ๋‹ค๋“ค ๋ถ€๋ถ€ ๋™๋ฐ˜์œผ๋กœ ์ฐธ๊ฐ€ํ–ˆ๋Š”๋ฐ ๊ธฐ๋Œ€๋ณด๋‹ค ํ›จ์”ฌ ๊ฐ’์ง„ ์‹œ๊ฐ„ ์ด์˜€๋‹ค.

์™€์ด๋„ˆ๋ฆฌ ์˜ค๋„ˆ๋“คํ•˜๊ณ  ๊ฐ™์ด ์ฆ๊ธฐ๋ฉด์„œ ๋Œ€ํ™” ํ•˜๋Š”๊ฒŒ ์šฐ๋ฆฌ๊ฐ€ ํˆฌ์žํ•œ ํšŒ์‚ฌ๋“ค๊ณผ ๋ณด๋‚ด๋Š” ์‹œ๊ฐ„๋“คํ•˜๊ณ  ๋น„์Šทํ–ˆ๋‹ค. ๋‚ ์”จ์— ๋Œ€ํ•œ ๊ณ ๋ฏผ๋ถ€ํ„ฐ AI ๋„ ๊ณ ๋ฏผํ•˜๊ณ  ์žˆ๋‹ค. ์ฐธ๊ณ ๋กœ ๊ทธ๋“ค์€ ๋ณดํ†ต ์ƒˆ๋ฒฝ 6์‹œ๋ถ€ํ„ฐ ๋ฐค 10์‹œ๊นŒ์ง€ ์ผํ•œ๋‹ค. ๊ทธ๋ฆฌ๊ณ  peak season ์—๋Š” ์ž ๋„ ๊ฑฐ์˜ ๋ชป์ž๋ฉด์„œ ์ผํ•œ๋‹ค. ๊ทธ๋“ค์—๊ฒŒ๋„ ์—ญ์‹œ ๋งŽ์€ ๊ฒƒ์„ ๋ฐฐ์šฐ๊ณ  ๊ฐํƒ„ํ•˜๊ฒŒ ๋˜์—ˆ๋‹ค.

๊ทธ์ค‘ ์ธ์ƒ ๊นŠ์—ˆ๋˜ ๋ง๋“ค:

"์Œ์‹ ๋จน๊ธฐ์ „ (๋ฐฐ๊ฐ€ ๊ณ ํ”Œ๋•Œ) ์™€์ธ์€ ๋” ๋А๋ผ๊ณ  ๋ง›์žˆ๋‹ค. ์‚ฌ๋žŒ์˜ ๋ณธ๋Šฅ์ด๋‹ค."

"์ด์ œ 30๋…„์งธ ํ•˜๋Š”๋ฐ ์–ด๋–ป๊ฒŒ ํ•ด์•ผ๋˜๋Š”์ง€ ์กฐ๊ธˆ ์•Œ์•„๊ฐ€๋Š”๊ฒƒ ๊ฐ™๋‹ค. ๋ณ€์ˆ˜๊ฐ€ ๋งŽ์•„์„œ ๊ณ„์† ์‹คํ—˜์„ ํ•ด์•ผ๋œ๋‹ค."

"์šฐ๋ฆฐ ์—ด์‹ฌํžˆ ํ•œ๋‹ค. ์–ด๋А ๋ˆ„๊ตฌ๋ณด๋‹ค๋„. ๊ทธ๋ ‡์ง€๋งŒ ๊ฒฐ๊ตญ ํ•˜๋Š˜์ด ๋งŽ์€๊ฒƒ์„ ์ขŒ์šฐํ•˜๊ธฐ๋•Œ๋ฌธ ๊ธฐ๋„๋„ ๋งŽ์ด ํ•œ๋‹ค."

"๋‹ค๋“ค ํŠน์œ ์˜ ๋ฐฉ๋ฒ•์ด ์žˆ๋‹ค. ๋ฌผ๋ก  ๋‚จ๋“ค์ด ๋ญ˜ ์–ด๋–ป๊ฒŒ ํ•˜๋Š”์ง€ ๊ด€์‹ฌ์žˆ๊ฒŒ ๋ณด์ง€๋งŒ...๊ทธ๋ฆฌ๊ณ  ์‹คํ—™๋„ ํ•˜์ง€๋งŒ ์šฐ๋ฆฌ๋งŒ์˜ ๋ฐฉ์‹๋Œ€๋กœ ํ•œ๋‹ค."

"๋ชจ๋“  ์™€์ธ์€ ๋งˆ์‹ค๋•Œ๋งˆ๋‹ค ๋‹ค๋ฅด๋‹ค. ๊ฐ ์‚ฌ๋žŒ๋งˆ๋‹ค ์ข‹์•„ํ•˜๋Š” ํ–ฅ์ด ์žˆ๊ณ  ๋ง›์ด ์žˆ๋Š”๊ฑฐ๊ธฐ ๋•Œ๋ฌธ ์–ด๋–ค ์™€์ธ์ด ์ ˆ๋Œ€์ ์ด๋ผ๊ณ  ํ• ์ˆ˜ ์—†๋‹ค. ๊ทธ๋ฆฌ๊ณ  ๋˜‘๊ฐ™์€ ์™€์ธ๋„ ๋ณ‘๋งˆ๋‹ค ์กฐ๊ธˆ์”ฉ ๋‹ค๋ฅด๊ณ  ๋˜ ๊ทธ๋•Œ ๊ธฐ๋ถ„/๋ถ„์œ„๊ธฐ ๋”ฐ๋ผ์„œ ๋‹ค๋ฅธ๋ง›์„ ๋А๋‚€๋‹ค." -- (๋กœ๋งˆ๋„ค๊ฝํ‹ฐ ์˜ค๋„ˆ).

๋งˆ์ง€๋ง‰ ๊ท€์ ˆ์„ ๊ทธ๋ถ„์—๊ฒŒ ๋“ฃ๊ณ ... ์ด์ œ๋Š” ํŽธํžˆ ์ซ„์ง€์•Š๊ณ  ์™€์ธ ์ฆ๊ธธ์ˆ˜ ์žˆ๊ฒŒ๋˜์„œ ์ข‹์•˜๋‹ค.
Continuous Learning_Startup & Investment
What era do we live in? A wide range of AI tasks that used to take 5 years and a research team to accomplish in 2013, now just require API docs and a spare afternoon in 2023. Not a single PhD in sight. When it comes to shipping AI products, you want engineersโ€ฆ
I think this is mostly right.
- LLMs created a whole new layer of abstraction and profession.
- I've so far called this role "Prompt Engineer" but agree it is misleading. It's not just prompting alone, there's a lot of glue code/infra around it. Maybe "AI Engineer" is ~usable, though it takes something a bit too specific and makes it a bit too broad.
- ML people train algorithms/networks, usually from scratch, usually at lower capability.
- LLM training is becoming sufficently different from ML because of its systems-heavy workloads, and is also splitting off into a new kind of role, focused on very large scale training of transformers on supercomputers.
- In numbers, there's probably going to be significantly more AI Engineers than there are ML engineers / LLM engineers.
- One can be quite successful in this role without ever training anything.
- I don't fully follow the Software 1.0/2.0 framing. Software 3.0 (imo ~prompting LLMs) is amusing because prompts are human-designed "code", but in English, and interpreted by an LLM (itself now a Software 2.0 artifact). AI Engineers simultaneously program in all 3 paradigms. It's a bit ๐Ÿ˜ตโ€๐Ÿ’ซ

https://twitter.com/karpathy/status/1674873002314563584