Programming is changing so fast... I'm trying VS Code Cursor + Sonnet 3.5 instead of GitHub Copilot again and I think it's now a net win. Just empirically, over the last few days most of my "programming" is now writing English (prompting and then reviewing and editing the generated diffs), and doing a bit of "half-coding" where you write the first chunk of the code you'd like, maybe comment it a bit so the LLM knows what the plan is, and then tab tab tab through completions. Sometimes you get a 100-line diff to your code that nails it, which could have taken 10+ minutes before.

I still don't think I got sufficiently used to all the features. It's a bit like learning to code all over again but I basically can't imagine going back to "unassisted" coding at this point, which was the only possibility just ~3 years ago.



Source Karpathy

This is why @baydis and @beka_cru and many of you couldn't make it to YC lol

Alright alright, what's good people😁

Guess what, he loves Ethiopian food too. Will get a lunch with him some day

Counting is one of the active problems of most llms if not all.

🍓Why AI can’t spell ‘strawberry’.


This is a blog from Techcrunch released just yesterday, most of the researchers have their view on why this happen.

From the blog "As these memes about spelling “strawberry” spill across the internet, OpenAI is working on a new AI product code-named Strawberry, which is supposed to be even more adept at reasoning..."

https://techcrunch.com/2024/08/27/why-ai-cant-spell-strawberry/

Can Neural Networks Learn to Reason? by Samy Bengio

The successes of deep learning critically rely on the ability of neural networks to output meaningful predictions on unseen data – generalization. Yet despite its criticality, there remain fundamental open questions on how neural networks generalize. How much do neural networks rely on memorization – seeing highly similar training examples – and how much are they capable of human-intelligence styled reasoning – identifying abstract rules underlying the data?
https://youtu.be/lCSdC8b0MrY

🤯100M Token Context Windows

I don't like to hype about AI but this is some next level stuff and all of you devs are done.

While the commercial applications of these ultra-long context models are plenty, at Magic we are focused on the domain of software development.

It’s easy to imagine how much better code synthesis would be if models had all of your code, documentation, and libraries in context, including those not on the public internet.

https://magic.dev/blog/100m-token-context-windows

I didn't expect Jane Street would invest in such things, I guess there is a lack of Ocaml devs.

Just to be clear, I want us (human civilization) to have AGI no mater the cost BUT my issue is over hyping

I hope we will have strong AI one day but until that days comes, I'm gonna be skeptic about this trend.

Techኢት Podcast S02E11 🎙

Guest:Henok B. Ademtew
Host: Ruth
Date: Tuesday , September 3, 2024
Time:8:00 PM (2:00 LT)

We’re thrilled to have Henok B. Ademtew on the Techኢት Podcast! 🎉 Henok is an AI researcher at the Ethiopian Artificial Intelligence Institute, with a focus on Deep Learning, NLP, and AI.

Henok is not only working in AI research but is also a hackathon powerhouse with participation in over 40 hackathons globally, where he has won numerous awards. 🚀 He also recently presented his work Amharic, Ge’ez, and English (AGE) parallel dataset at ACL2024.

Tune in to hear Henok discuss his journey, the challenges of AI research in Ethiopia, his hackathon experiences, and his vision for the future of AI in Africa. 🌟💡

Don’t miss out! Follow his telegram channel Neural Nets for more content and join us for an insightful and inspiring episode. 🤩

@Techinethio 
📅 Stay tuned! 🎧📢✨ 
#TechኢትPodcast

Seems like I'm gonna talk some gibberish which most web devs won't & don't want to understand lol

✈️Let's attend the biggest AI/ML conference and community in Africa, Deep Learning Indaba in Senegal 🇸🇳. I'll be spamming here about this in the next few days.

Forget passports, I just need my face! Almost everywhere I go, people skip the small talk and go straight to 'Are you from Ethiopia?' I guess Ethiopians have that global VIP look! 😂

Sneak peak of the first day of DLI2024

https://x.com/DeepIndaba/status/1830546542417096913