GPT 6 Astra (high) scores 92.9% on WeirdML and matches Fable 5.1 (max) for the top score.

It sets a new individual high score on 6 of the 17 tasks, and is overall very solid.

Interestingly it writes significantly less code than Sol and other recent GPT models, although still more than Claude.

I will do a more careful analysis when the max and pro max runs are done.

Posted by Håvard Ihle, 3 hours ago

From GPT-4 to GPT-6.

Sparks was a remarkably prescient paper that got a lot of pushback at the time, but absolutely sensed where the vibes were heading with LLMs based on a lot of qualitative experiments. It deserves credit in retrospect.

Posted by Ethan Mollick, 29 minutes ago

https://www.microsoft.com/en-us/research/publication/sparks-of-artificial-general-intelligence-early-experiments-with-gpt-4/

Gemini 3 achieves state of the art performance in SpatialBench. A Spatial reasoning benchmark for VLM to test their tracing, 3d visualization ability, and reasoning across each.

Posted by spicylemonade, 9 months ago

It seems like they trained it to know precise coordinates in reasoning (without any external tool calls, at least not on the client-side)