Alex Finn / AlexFinn:
This is potentially the biggest news of the year
Google just released #TurboQuant. An algorithm that makes #LLM’s smaller and faster, without losing quality
Meaning that 16gb Mac Mini now can run INCREDIBLE AI models. Completely locally, free, and secure
This also means:
• Much larger context windows possible with way less slowdown and degradation
• You’ll be able to run high quality AI on your phone
• Speed and quality up. Prices down.
The people who made fun of you for buying a Mac Mini...
Alex Finn / @AlexFinn:
R to @AlexFinn: I predicted by end of year you’d be able to run frontier models on Mac Minis
I’m going to be right
This is potentially the biggest news of the year
Google just released #TurboQuant. An algorithm that makes #LLM’s smaller and faster, without losing quality
Meaning that 16gb Mac Mini now can run INCREDIBLE AI models. Completely locally, free, and secure
This also means:
• Much larger context windows possible with way less slowdown and degradation
• You’ll be able to run high quality AI on your phone
• Speed and quality up. Prices down.
The people who made fun of you for buying a Mac Mini...
Alex Finn / @AlexFinn:
R to @AlexFinn: I predicted by end of year you’d be able to run frontier models on Mac Minis
I’m going to be right
#Skills up with this #LLM and #Agentic AI-focused bundle of e#Book's! 🤖🆙
https://itsfoss.com/news/llm-and-agentic-ai-bundle/
https://itsfoss.com/news/llm-and-agentic-ai-bundle/
It's FOSS
Want to Learn LLMs and Build AI Agents?Get 23 eBooks for Under $20
And part of your purchase goes to support World Central Kitchen, a nonprofit that provides emergency food relief to communities hit by disasters and humanitarian crises around the world.