Ilya Sutskever finally confirmed
> scaling LLMs at the pre-training stage plateaued
> the compute is scaling but data isn’t and new or synthetic data isn’t moving the needle
What’s next
> same as human brain, stopped growing in size but humanity kept advancing, the agents and tools on top of LLMs will fuel the progress
> sequence to sequence learning
> agentic behavior
> teach self awareness
Think of it as the “iPhone”, which kept getting bigger and more useful from hardware point, but plateaued and the while focused shifted to applications.
2025 will be the year of Agents!
> scaling LLMs at the pre-training stage plateaued
> the compute is scaling but data isn’t and new or synthetic data isn’t moving the needle
What’s next
> same as human brain, stopped growing in size but humanity kept advancing, the agents and tools on top of LLMs will fuel the progress
> sequence to sequence learning
> agentic behavior
> teach self awareness
Think of it as the “iPhone”, which kept getting bigger and more useful from hardware point, but plateaued and the while focused shifted to applications.
2025 will be the year of Agents!
🔥2
https://frame.work/
These guys inspire me. Make me want to play with pc hardware stuff like its 1999 all over again
These guys inspire me. Make me want to play with pc hardware stuff like its 1999 all over again
🔥1
BTW anything .computer is becoming a new hostest domain name....
Cora.computer and many such as examples
Cora.computer and many such as examples
👍1
"javascript is the perfect language for writing bugs.
its fast development speed allows for bugs to be created at an unprecedented rate"
its fast development speed allows for bugs to be created at an unprecedented rate"
😁5
How will Ethiopia benefit from this trend? The most reliably predictable trend of the next 100 years: every year, humanity will use significantly more computing power than the previous year.
Someone at EIH should start an ETF based on that thesis (it's not just $NVDA and $AMD, it's cloud services, the data center industry, nuclear power...)
Someone at EIH should start an ETF based on that thesis (it's not just $NVDA and $AMD, it's cloud services, the data center industry, nuclear power...)
❤1
We are reviewing this book today at 10:00AM, at Adore Addis in Bole. Feel free to join.
In some section, The Old Drift explores technology's impact on society through various futuristic elements, such as embedded chips called "Beads" that connect individuals to information networks, blurring the lines between human and machine. The narrative features innovations like drones and viral vaccines, reflecting Zambia's technological evolution while addressing contemporary issues like colonialism and health crises.
In The Old Drift, drones and microdrones serve as symbols of technological advancement and surveillance, reflecting societal changes.
The Zambian space program, initiated by Edward Makuka Nkoloso in the 1960s, aimed to launch a rocket carrying 17-year-old Matha Mwambwa and two cats to the Moon. Nkoloso sought to position Zambia as a contender in the Space Race against the U.S. and Soviet Union. Training involved unconventional methods like rolling trainees in oil drums to simulate weightlessness.
In some section, The Old Drift explores technology's impact on society through various futuristic elements, such as embedded chips called "Beads" that connect individuals to information networks, blurring the lines between human and machine. The narrative features innovations like drones and viral vaccines, reflecting Zambia's technological evolution while addressing contemporary issues like colonialism and health crises.
In The Old Drift, drones and microdrones serve as symbols of technological advancement and surveillance, reflecting societal changes.
The Zambian space program, initiated by Edward Makuka Nkoloso in the 1960s, aimed to launch a rocket carrying 17-year-old Matha Mwambwa and two cats to the Moon. Nkoloso sought to position Zambia as a contender in the Space Race against the U.S. and Soviet Union. Training involved unconventional methods like rolling trainees in oil drums to simulate weightlessness.
⚡1
Read science fiction to imagine what might change.
Read ancient literature to understand what doesn't.
HAVE A WONDERFUL 2025
Read ancient literature to understand what doesn't.
HAVE A WONDERFUL 2025
⚡6
et/acc
What real Acceleration looks like.🤯 It is quite fitting that DeepSeek, China’s leading LLM lab, releases its latest model V3 on Christmas. - on-par with GPT-4o & Claude 3.5 Sonnet - trained w/10x less compute
If China can train frontier model with $6Mn - when will ethiopia/Africa build an frontier model with trained on local synthetic data? Will there ever be an Pan-african research Lab tasked on this?
📖 The first book of 2025 is What is Next is Now.
You can respond to unexpected challenges—big and small—by turning them into opportunities with six principles for developing a “future-ready mindstate”:
1. Optimism
2. Openness
3. Curiosity
4. Experimentation
5. Empathy
6. Dimension X—the unique lens through which each of us sees the world.
Both inspirational and actionable, What's Next Is Now engages your personal sense of discovery, providing dozens of thoughtful exercises and illustrations, real-world practices, and provocative insights from people who have adopted a future-ready mindstate. Here is an optimistic guide that helps innovators, entrepreneurs, and other agents of change invent the future.
You can respond to unexpected challenges—big and small—by turning them into opportunities with six principles for developing a “future-ready mindstate”:
1. Optimism
2. Openness
3. Curiosity
4. Experimentation
5. Empathy
6. Dimension X—the unique lens through which each of us sees the world.
Both inspirational and actionable, What's Next Is Now engages your personal sense of discovery, providing dozens of thoughtful exercises and illustrations, real-world practices, and provocative insights from people who have adopted a future-ready mindstate. Here is an optimistic guide that helps innovators, entrepreneurs, and other agents of change invent the future.
🔥3