Last weekend we won a big Lllama 3 Hackaton!
We built a smart glasses from scratch using off-the-shelf parts in $20 and it runs entirely on Open Source networks.
This kind of blown up everywhere - now everyone knows what we have done and we have 1500+ of preorders in the first day. Gizmodo took small interview, virtually anyone i am talking two knows about our glasses. I have built firmware and base app (everything up to LLM) and guys benchmarked different llms and picked the best approach.
What we found is that Moondream v2 + Llama 3 is capable to run similar to what OpenAI demonstrated. It can sense what's happening around, answering questions. You can get faster than realtime responses via Groq API for Llama 70B, TTS is also quite fast. STT is also 100x of realtime. Ofc openai is much better at this, but hacked in the weekend solution also works.
My goal getting street creds in bay area is slowly working!
We built a smart glasses from scratch using off-the-shelf parts in $20 and it runs entirely on Open Source networks.
This kind of blown up everywhere - now everyone knows what we have done and we have 1500+ of preorders in the first day. Gizmodo took small interview, virtually anyone i am talking two knows about our glasses. I have built firmware and base app (everything up to LLM) and guys benchmarked different llms and picked the best approach.
What we found is that Moondream v2 + Llama 3 is capable to run similar to what OpenAI demonstrated. It can sense what's happening around, answering questions. You can get faster than realtime responses via Groq API for Llama 70B, TTS is also quite fast. STT is also 100x of realtime. Ofc openai is much better at this, but hacked in the weekend solution also works.
My goal getting street creds in bay area is slowly working!
Gizmodo
Cerebral Valley Hackers Build $20 Open Source Smart Glasses
A five-person team at a San Francisco hackathon created an open source approach to Meta's AI-powered Ray-Bans.
๐ฅ15๐ฆ5โค4
My first audio pre-training finished!
Thankfully my small cluster of 4090 finished pre-training of my audio foundational model! It took about 30 days to finish. This model is akin to original GPT (not chat one) in essence that it is not really that useful without finetuning, but you can finetnue it to do denoising, speech enhancement, speaker separation, text-to-speech tasks. All this tasks are very very important for AI Wearables and every single company i have talked too are struggling with it.
Thankfully my small cluster of 4090 finished pre-training of my audio foundational model! It took about 30 days to finish. This model is akin to original GPT (not chat one) in essence that it is not really that useful without finetuning, but you can finetnue it to do denoising, speech enhancement, speaker separation, text-to-speech tasks. All this tasks are very very important for AI Wearables and every single company i have talked too are struggling with it.
๐6๐ค3๐
2๐จโ๐ป1
This media is not supported in your browser
VIEW IN TELEGRAM
SuperVoice Enhance
My new model for speech enhance and denoising. This model processes noisy or damaged audio extracts high quality voice. Should work with most languages out of the box.
Model and sources: https://github.com/ex3ndr/supervoice-enhance
My new model for speech enhance and denoising. This model processes noisy or damaged audio extracts high quality voice. Should work with most languages out of the box.
Model and sources: https://github.com/ex3ndr/supervoice-enhance
๐ฅ14โค2
Please open Telegram to view this post
VIEW IN TELEGRAM
๐ฆ8๐4โค1๐คฎ1๐ฅด1๐1๐พ1
Can you imagine president going to podcast during during election season!
https://www.youtube.com/watch?v=blqIZGXWUpU
https://www.youtube.com/watch?v=blqIZGXWUpU
YouTube
In conversation with President Trump
(0:00) Bestie intros: Big house talk!
(1:37) Economy: Regulation, taxes, tariffs, taming inflation, de-dollarization
(12:02) Federal debt: growth, spend control, where to cut, role of energy, nuclear
(20:22) Foreign policy: Ukraine/Russia
(25:05) Foreignโฆ
(1:37) Economy: Regulation, taxes, tariffs, taming inflation, de-dollarization
(12:02) Federal debt: growth, spend control, where to cut, role of energy, nuclear
(20:22) Foreign policy: Ukraine/Russia
(25:05) Foreignโฆ
๐1
Please open Telegram to view this post
VIEW IN TELEGRAM
๐13๐ฅ3