Alex Finn / AlexFinn:
This is potentially the biggest news of the year
Google just released #TurboQuant. An algorithm that makes #LLM’s smaller and faster, without losing quality
Meaning that 16gb Mac Mini now can run INCREDIBLE AI models. Completely locally, free, and secure
This also means:
• Much larger context windows possible with way less slowdown and degradation
• You’ll be able to run high quality AI on your phone
• Speed and quality up. Prices down.
The people who made fun of you for buying a Mac Mini...
Alex Finn / @AlexFinn:
R to @AlexFinn: I predicted by end of year you’d be able to run frontier models on Mac Minis
I’m going to be right
This is potentially the biggest news of the year
Google just released #TurboQuant. An algorithm that makes #LLM’s smaller and faster, without losing quality
Meaning that 16gb Mac Mini now can run INCREDIBLE AI models. Completely locally, free, and secure
This also means:
• Much larger context windows possible with way less slowdown and degradation
• You’ll be able to run high quality AI on your phone
• Speed and quality up. Prices down.
The people who made fun of you for buying a Mac Mini...
Alex Finn / @AlexFinn:
R to @AlexFinn: I predicted by end of year you’d be able to run frontier models on Mac Minis
I’m going to be right