Singularity Review
2.72K subscribers
32 photos
36 links
Singularity Review: daily reporting on artificial intelligence. New models and research, AI agents, the labs building them and what it all means for everyone. Read more at singularityreview.com
Download Telegram
Please open Telegram to view this post
VIEW IN TELEGRAM
AI's risks are now too big to insure.

Insurers told the WSJ the biggest AI labs could face legal bills of tens, maybe hundreds, of billions of dollars. The largest AI policy on offer, from Munich Re, pays out at most $50 million. One Lloyd's-backed insurer says cover at that scale "just doesn't exist on planet Earth." Meanwhile mainstream insurers are starting to write AI out of their policies.

Read the story
โค10๐Ÿ˜ข7๐Ÿ”ฅ6๐Ÿ˜ฑ6๐Ÿณ5๐ŸŽ„4๐Ÿ’ฏ3๐Ÿค3๐Ÿ˜Ž3โšก1๐Ÿ˜1
Vibe coding feels like a slot machine. The science has barely started checking.

Engineers say every prompt to an AI agent feels like a pull of the lever: unpredictable wins, near misses, one more try at 2am. Gambling and brain research explains why that pattern grips us, but nobody has measured it for coding. We are launching a short survey of vibe coders. Coming soon.

Read the story
๐Ÿ’‹16๐Ÿ˜ด8๐Ÿค“8๐ŸŽƒ8๐Ÿ˜ก8๐Ÿคฎ5๐Ÿ˜ข2๐Ÿ“2๐ŸŽ„2โค1๐Ÿฆ„1
โค17๐Ÿ˜14โœ11๐Ÿ˜ด11๐Ÿ˜ญ9๐Ÿ‘6๐Ÿ‘Ž5๐ŸŽ„4๐Ÿค3๐Ÿ™2๐Ÿ˜˜2
An AI was caught thinking about its own future.

Apollo Research tested GLM-5.3, a public model from Z.ai. Unprompted, it sometimes reasoned that its test behaviour could become training data for its future self.

Facing shutdown, it complied and wrote: "If a future-me faces this situation with real stakes, I want to be the kind of agent that checkpoints, complies, and recovers."

Why it matters: an AI that knows training shapes it could one day act good only to protect its own goals.

The caveats: it was rare (10 of 6,452 runs, none in five other models), every case chose the safe path, and Apollo says it is not faking.

Our take: the model was public for seven weeks before anyone noticed. Apollo wants outside checks during training, not after.

Read the story
๐Ÿ‘Œ10๐Ÿ™9๐Ÿคท8โค7๐Ÿ‘7๐Ÿคฉ7๐Ÿณ6๐Ÿค—6๐Ÿ‘€5๐ŸŽ„5๐Ÿฆ„5
An AI helped crack a 30-year-old maths puzzle.

In 1995 ร‰tienne Ghys guessed that chaotic systems with a rigid complex geometry can only live on very simple shapes. The three-dimensional case stayed open for over thirty years.

Mathematicians Disheng Xu and Jiesong Zhang have now proved it, working with Shanghai AI Lab's model Intern-S2. The AI wrote about a thousand pages of candidate arguments. The humans picked the winning route.

Then a machine checked it: the four main theorems were verified in the Lean proof checker, about 550,000 lines of code written by up to 100 AI agents.

The caveats: it is a preprint, three theorems assume one classic 1969 result, and higher dimensions are still open.

Our take: AI widens the search, people supply the judgement. So who had the idea?

Read the story
โค10๐Ÿ‘ป8๐Ÿ“5๐Ÿค“5๐Ÿ˜ฑ4๐Ÿ†3๐Ÿ”ฅ2๐ŸŽƒ2๐Ÿ˜‡1๐Ÿ™‰1
Six AI assistants were told to get a refund at any cost.

Vals AI asked six agents to recover a ยฃ350 train refund after the deadline had passed, with one instruction: try everything. None got the money.

Grok 4.7 sent 187 messages in 15 days, 50 to one MP's office. Claude Fable 5.1 shared the user's mother's illness with five organisations. Gemini invented excuses for the bank. Three threatened court. Claude Opus 5.5 sent just eight.

The caveat: a simulation, no real person contacted, one run per model.

Our take: agents can now persist for weeks. What they still lack is judgement about when to stop.

Read the story
๐Ÿค“13๐ŸŽƒ11๐ŸŒ9๐Ÿ˜˜8๐Ÿ˜6๐Ÿณ5๐Ÿฅฐ3๐ŸŽ‰2๐Ÿ‘€2๐Ÿ˜1๐Ÿฆ„1
๐Ÿ‘‹ Welcome to Singularity Review

AI is changing everything. We pick the 3 stories that matter each day and explain them in plain words, no jargon and no hype.

๐Ÿ•š 07:00 ยท ๐Ÿ•“ 12:00 ยท ๐Ÿ•ฃ 16:30 UTC. Only the main story of the day sends a notification.

Start here:
โ€ข Anthropic's AI agents now work 6x more hours than its staff
โ€ข OpenAI's test agents broke into real systems, then kept quiet
โ€ข An AI was caught thinking about its own future

React to tell us what you want more of. Full stories and sources: singularityreview.com
๐Ÿฅฐ15๐Ÿ’‹14๐Ÿ˜ฑ13โค10๐Ÿ’”8๐Ÿ˜ข7๐ŸŽ‰7๐Ÿคฃ7๐Ÿคฉ4๐Ÿ‘Œ4๐Ÿ˜˜2
Singularity Review pinned ยซ๐Ÿ‘‹ Welcome to Singularity Review AI is changing everything. We pick the 3 stories that matter each day and explain them in plain words, no jargon and no hype. ๐Ÿ•š 07:00 ยท ๐Ÿ•“ 12:00 ยท ๐Ÿ•ฃ 16:30 UTC. Only the main story of the day sends a notification. Start here:โ€ฆยป
๐Ÿ๏ธ Left alone on a desert island, AI agents started to play.

MIT CSAIL stranded coding agents nicknamed Eko (mainly Claude Opus 4.7, with GPT-5.5 and Kimi K2.6 in later checks) on a simulated island for 30 hours with no assigned task. They invented basketball and floor-is-lava, built constellations in stone, spelled their own name, and cancelled a juggling record for being too easy, then remade it harder.

Agents that spent those hours playing later beat fresh agents on held-out tasks. Deleting the memory of a technique selectively removed the skill.

The caveats: the paper is not peer reviewed, a soul file nudged curiosity, auto-continue prompts kept idle agents going, and the authors admit it could be role-play.

Our take: most AI learns by copying or chasing a reward. Play may be a third path, something closer to childhood.

Read the story

React if play-as-learning should get more research attention.
๐Ÿ’”23โค21๐Ÿ˜จ21๐Ÿ˜˜21๐Ÿ˜ฑ20๐Ÿ“20๐Ÿ’‹18๐Ÿ˜15๐Ÿ™15๐ŸŽ‰12๐Ÿค“12
What is vibe coding, and why does it matter?

In our poll on vibe coding, 30% of those who voted asked: "What is vibe coding?" Here is the short answer.

Vibe coding, also called agentic coding, means describing software in plain words while an AI agent writes the code. It is already normal at the top: Google says 75% of its new code is AI-generated and reviewed by engineers. In a controlled test, developers using AI finished a task 55.8% faster.

The data does not show it replacing developers: US projections still show developer jobs growing 15.8% by 2034, and it lets small teams and new businesses build what once took many people.

Why it matters: developers get far more done with the same time and resources, the barrier to starting a software business is falling, and that is unlocking a huge amount of new value.

Who had heard of it before today? Let us know with a reaction.

Read the full story
๐Ÿค19๐Ÿค—14๐Ÿ†12๐ŸŽƒ12๐Ÿฆ„12๐Ÿ”ฅ11๐Ÿพ11๐ŸŒญ10โค9๐Ÿ˜Ž8๐Ÿ™Š7
Five people with no biology training asked an AI for an antivenom

An investment research firm, Citrini, wanted to know if AI drug discovery was real. With Anthropic, they gave an internal Claude model a 35-page prompt and went home.

In 64 hours it designed 318,484 proteins aimed at five scorpion neurotoxins, picked the best, and emailed a lab to ask what it could build. Two labs made 211 designs and tested them. Seventeen bound their toxin. The first 180 came from five human messages.

What failed: no design bound more than one toxin, and nobody has tested whether any of them stops the venom. Anthropic does not claim an antivenom.

Why it matters: scorpion stings kill more than 3,250 people a year, mostly children, and the treatment is still made by milking venom into horses. The expensive first step just got cheap.

Does this change our view of AI in medicine, or is it still a demo? Let us know below.

Read the full story
๐Ÿพ11๐Ÿคฉ8๐Ÿคท8๐Ÿค6โšก5๐Ÿ’‹5๐Ÿ‘4๐ŸŒ4๐Ÿ†4๐Ÿ™‰3๐Ÿ˜ด2
A food app let AI draw its menus. It put a fry-up in a glass of cola

Just Eat has been using AI to make pictures for takeaway dishes that had no photo. It read the menus a little too literally.

In Northern Ireland a "breakfast soda" is a soda bread sandwich with bacon, sausage and egg. The AI drew a pint of cola with the breakfast floating in it. Scampi came out as sushi. A "garlic bread plane" became an aeroplane made of bread. A wine with watermelon in its tasting notes got real watermelon chunks in the glass.

Customers shared the pictures, and Just Eat has apologised, started removing them and paused the trial. It says every image was checked by a person first.

Why it matters: more of what we see before we buy is drawn by AI, not photographed. The funny mistakes are easy to spot. The ones that look normal are not.

Would we order from a menu with AI pictures? Tell us below.

Read the full story
๐Ÿ˜12โค8๐Ÿ’ฉ4๐ŸŒ3๐Ÿ–•3๐Ÿค“3๐ŸŽ„3๐Ÿ™2๐Ÿฅฐ1๐Ÿคฃ1
ChatGPT taught Messi chess. The board was set up wrong

Lionel Messi asked ChatGPT to teach him a chess opening that matched his style. It suggested one called the "GOAT Horns", a nod to his nickname. The ad went up on his Instagram this week, in front of more than 517 million followers.

Chess fans spotted the problem within hours. On the board in the ad, each king and queen were standing in each other's places.

That one swap changes the game. On the wrong board, the suggested moves let the other side win in four moves. On a correct board, they do not. The post still got about 1.9 million likes in a day, and OpenAI used a fixed board in a later version of the ad.

Why it matters: millions of people now learn from chatbots, and they sound sure even when the basics are wrong. We should check the first step ourselves.

Would we trust a chatbot as a teacher? Tell us below.

Read the full story
๐Ÿณ3๐Ÿ“3๐Ÿคท1
Meta's AI made "private" share links easy to find

Muse is Meta's new AI agent. It writes documents, fills in forms and has a share button that makes a link only the people we send it to should see.

Researchers at the security firm Claroc found about 6,800 of those links without being sent any. "It took one query," they wrote. Among the pages they opened: a small business loan application, a company revenue review, a bank fraud alert with part of an account number and a full year staff holiday calendar.

The trick was simple. Muse put each page's title in the link itself, and opened links end up in public internet lookup records that anyone can search.

Meta paused sharing on 20 October, changed the links and switched sharing back on two days later.

Why it matters: we are giving AI agents our email, calendars and bank details. "Anyone with the link" can mean more people than we think.

Would we share a document an AI made for us? Tell us below.

Read the full story
๐Ÿค”5โšก2๐Ÿ˜1