In cellular automata, simple rules create elaborate structures. Now researchers can start with the structures and reverse-engineer the rules.

Naomi Saphra thinks that most research into language models focuses too much on the finished product. She’s mining the history of their training for insights into why these systems work the way they do.

The V-JEPA system uses ordinary videos to understand the physics of the real world.