In this video, I dive into the controversy surrounding the Leaderboard Illusion paper and what it reveals about systematic flaws in LLM benchmarks—especially Chatbot Arena. As someone who’s followed the evolution of these leaderboards closely, I was shocked…

Why do AI systems ace benchmarks yet stumble in the real world? Melanie Mitchell says it’s time to rethink how we probe intelligence in machines.