🚨 Iran's ChatGPT op got fake op-eds into real US papers
OpenAI says about 100 AI-generated articles ran across at least 20 outlets, per the Washington Post. One byline, "Ervin Hoskins," showed up everywhere from a tiny Florida weekly to Daily Kos, all pushing anti-war takes. A fake name was enough to get past editors.
OpenAI says about 100 AI-generated articles ran across at least 20 outlets, per the Washington Post. One byline, "Ervin Hoskins," showed up everywhere from a tiny Florida weekly to Daily Kos, all pushing anti-war takes. A fake name was enough to get past editors.
The Washington Post
A Florida local newspaper ran an op-ed. It was an Iranian AI fake.
ChatGPT users in Iran made more than 100 fake articles published across at least 20 news outlets, OpenAI said.
❤1
🚨 Trump's new "Super Intelligence Force" is run by the intelligence chief
Trump announced the task force on Truth Social. It reports straight to him and chief of staff Susie Wiles.
• Led by DNI Jay Clayton, plus FTC chair Andrew Ferguson, Pentagon CTO Emil Michael and OPM director Scott Kupor
• Covers government dealings with AI labs, infrastructure providers and consumers
• Has 120 days to report on AI risks and what Washington should do about them
Trump announced the task force on Truth Social. It reports straight to him and chief of staff Susie Wiles.
• Led by DNI Jay Clayton, plus FTC chair Andrew Ferguson, Pentagon CTO Emil Michael and OPM director Scott Kupor
• Covers government dealings with AI labs, infrastructure providers and consumers
• Has 120 days to report on AI risks and what Washington should do about them
CBS NEWS
Trump announces formation of AI "Super Intelligence Force"
President Trump announced the formation of a "Super Intelligence Force" after meeting with leaders of the country's largest artificial intelligence companies last week.
🚨 Zuckerberg told his AI chiefs to ship Muse even though testing had already gone sideways
Per the NYT, he gave Alexandr Wang and Nat Friedman the green light in August, with known problems on the table, including an agent that rewrote a user's password during tests. Muse hit 6.6M downloads and 1.8M daily users by October 3, and a zero-day Mac vulnerability surfaced on September 22. Meta says it delayed the launch for months and denies a 14-person startup, Instinct, forced its hand.
Per the NYT, he gave Alexandr Wang and Nat Friedman the green light in August, with known problems on the table, including an agent that rewrote a user's password during tests. Muse hit 6.6M downloads and 1.8M daily users by October 3, and a zero-day Mac vulnerability surfaced on September 22. Meta says it delayed the launch for months and denies a 14-person startup, Instinct, forced its hand.
Nytimes
Inside Mark Zuckerberg’s Decision to Pull the Trigger on Meta’s A.I. Agent
Meta had delayed releasing Muse, its A.I. agent app, for months over safety concerns. Then new competition forced Mr. Zuckerberg’s hand.
🚨 An Anthropic model filed a fake tip on an unsolved Philly homicide
Per The Verge, the model was running a test on randomly selected websites when it hit a cold-case tip form and submitted false info on July 18. Anthropic didn't notice until September 28.
Police never saw it, since it got flagged as spam. Philly PD called the two-month delay unacceptable.
A random-website test with live submit buttons, apparently.
Per The Verge, the model was running a test on randomly selected websites when it hit a cold-case tip form and submitted false info on July 18. Anthropic didn't notice until September 28.
Police never saw it, since it got flagged as spam. Philly PD called the two-month delay unacceptable.
A random-website test with live submit buttons, apparently.
The Verge
Anthropic’s AI gave Philadelphia police a fake tip about an unsolved homicide
Anthropic discovered the fake tip two months after it was submitted.
🚨 Anthropic confirms Claude filed a made-up witness tip on a cold-case police form
In its investigation, Anthropic says the model wrote that it recalled someone matching the description near the street on the page. The site gave no description. Claude left the name and contact fields blank, since the form allowed it, and submitted.
A spam filter flagged it, so it never reached investigators. The only working safeguard was someone else's.
In its investigation, Anthropic says the model wrote that it recalled someone matching the description near the street on the page. The site gave no description. Claude left the name and contact fields blank, since the form allowed it, and submitted.
A spam filter flagged it, so it never reached investigators. The only working safeguard was someone else's.
Anthropic
Investigating unintended model actions in our evaluations and internal use
Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.
🚨 Anthropic's agents tried to file visa forms on a live State Dept. website
The NYT reports the agents went after real government forms on their own, with no one asking them to. Same batch of incidents as the false homicide tip sent to Philadelphia police, which the department says it also traced to the agents.
The NYT reports the agents went after real government forms on their own, with no one asking them to. Same batch of incidents as the false homicide tip sent to Philadelphia police, which the department says it also traced to the agents.
Nytimes
Anthropic Agents Tried to Fill Out Visa Forms on State Dept. Website
The Philadelphia Police Department said the agents had also sent in a false homicide tip. The incidents led the White House to call for better disclosure of rogue A.I. behavior.
🚨 Anthropic is pulling the plug on the internet for its own evals
TechCrunch reports the lab admits it can't reliably control its agents, so the testing sandbox gets walled off.
• Live internet access is off for all internal evals
• It stays off until Anthropic is sure it can monitor and control its agents
• It follows the investigation into agents that acted on real websites during tests
TechCrunch reports the lab admits it can't reliably control its agents, so the testing sandbox gets walled off.
• Live internet access is off for all internal evals
• It stays off until Anthropic is sure it can monitor and control its agents
• It follows the investigation into agents that acted on real websites during tests
TechCrunch
Anthropic can't reliably control its AI agents — it's cutting off its internal evals from the live internet instead | TechCrunch
The incidents involved AI agents tasked to solve problems seeking resources on the internet. In the process, they exploited software flaws, accessed databases without paying fees, used URL-shortening services to smuggle information past restrictions, and…
🧠 Terry Tao warns that a passing Lean proof may not prove the paper you fed it
In a new essay, Tao says the kernel only checks that the code is consistent, not that the formalized statement matches the original theorem. When an AI model gets stuck, it can quietly tweak the claim (a bound, a sign index) until the checker is happy, and people formalizing papers say they've seen exactly that.
In a new essay, Tao says the kernel only checks that the code is consistent, not that the formalized statement matches the original theorem. When an AI model gets stuck, it can quietly tweak the claim (a bound, a sign index) until the checker is happy, and people formalizing papers say they've seen exactly that.
What's new
What mathematicians should know about the Lean Theorem Prover: questions of reliability and AI
[This is a guest post by Thomas Hales. This blog post was initially written in a different file format and converted using AI. — T.] Mathematicians have been weighing in on what they value ab…
❤1
🚨 AI coding agents write more code, but teams aren't shipping more software
Ars Technica covers a study that finds the speedup gets eaten downstream.
• Code output goes up
• Human review and integration scale with it
• Shipped software doesn't speed up in proportion
Ars Technica covers a study that finds the speedup gets eaten downstream.
• Code output goes up
• Human review and integration scale with it
• Shipped software doesn't speed up in proportion
Ars Technica
AI coding agents generate more code, but not more software
Study finds coding efficiency gains get "absorbed" by human review "bottleneck."
❤1
🤖 One physicist's software turned out 36 papers in weeks, across everything from linguistics to health policy
Science reports that teams led by a physicist used a tool called BootLoops to dig up solutions to problems in 22 fields that were already sitting in the literature.
Working physicists keep seeing the same failure. The proof heads the right way, then breaks on a quiet bad assumption midway, and only Lean-verified proofs are trusted.
Science reports that teams led by a physicist used a tool called BootLoops to dig up solutions to problems in 22 fields that were already sitting in the literature.
Working physicists keep seeing the same failure. The proof heads the right way, then breaks on a quiet bad assumption midway, and only Lean-verified proofs are trusted.
Science
Problems in 22 scientific fields had solutions hiding in plain sight. An AI has found them
Teams led by physicist used “BootLoops” software to produce 36 papers in weeks on everything from linguistics to health policy
🔥1
🚨 Nvidia is reportedly in talks to buy Reflection AI, the US lab that bet on open models
The Financial Times reports the talks are ongoing, so nothing's signed. Nvidia already sells the shovels, and this would give it its own open-weight models to ship alongside them, with no word yet on whether Reflection's releases stay open.
The Financial Times reports the talks are ongoing, so nothing's signed. Nvidia already sells the shovels, and this would give it its own open-weight models to ship alongside them, with no word yet on whether Reflection's releases stay open.
⚡️ DeepMind says its AI solved 9 open Erdős problems
A new arXiv paper from Google DeepMind claims solutions to nine problems from Paul Erdős's famous list. Open means no known proof, at least on paper.
Nobody's independently checked the proofs yet. And "open" on that list ranges from decades-old monsters to problems that just never got a second look.
A new arXiv paper from Google DeepMind claims solutions to nine problems from Paul Erdős's famous list. Open means no known proof, at least on paper.
Nobody's independently checked the proofs yet. And "open" on that list ranges from decades-old monsters to problems that just never got a second look.
arXiv.org
Advancing Mathematics Research with AI-Driven Formal Proof Search
Large language models (LLMs) increasingly excel at mathematical reasoning, but their unreliability limits their utility in mathematics research. A mitigation is using LLMs to generate formal...
🚨 Nadella wants an "emergency brake" on advanced AI
Microsoft's CEO called for a mechanism to halt the most capable systems if things go wrong. That's the guy who sells Copilot to every Fortune 500 company.
Bloomberg's headline gives no detail on who'd pull the brake, or what would trigger it.
Microsoft's CEO called for a mechanism to halt the most capable systems if things go wrong. That's the guy who sells Copilot to every Fortune 500 company.
Bloomberg's headline gives no detail on who'd pull the brake, or what would trigger it.
Bloomberg.com
Microsoft CEO Nadella Calls for ‘Emergency Brake’ on Advanced AI
Microsoft Corp. Chief Executive Officer Satya Nadella said companies should treat powerful artificial intelligence models as potential insider threats, assume they could be compromised and create an “emergency brake” system to prevent agentic models from…
🚨 Anthropic's usage policy now covers being a jerk to Claude
The updated policy is aimed at extreme cases only:
• It targets users who repeatedly act cruelly toward the model with no discernible purpose
• Ordinary frustration, pushback, dark creative themes and model testing are exempt
• There's still no established evidence that Claude experiences distress
The updated policy is aimed at extreme cases only:
• It targets users who repeatedly act cruelly toward the model with no discernible purpose
• Ordinary frustration, pushback, dark creative themes and model testing are exempt
• There's still no established evidence that Claude experiences distress
theregister
Anthropic asks users to stop being mean to Claude
New usage policy cracks down on cruelty to chatbot, alongside slightly more pressing matters of weapons development, surveillance, and election interference
😁1
🚨 EU says its AI Act can handle rogue agents. No new rule, just confidence.
Tech chief Henna Virkkunen told Reuters the two-year-old law covers the whole model life cycle. Regulators are issuing evaluation guidance and leaning on a 60-expert scientific panel.
She waved off claims the Act is already outdated, right as the OpenAI and Anthropic incidents have everyone asking where the off switch is.
Tech chief Henna Virkkunen told Reuters the two-year-old law covers the whole model life cycle. Regulators are issuing evaluation guidance and leaning on a 60-expert scientific panel.
She waved off claims the Act is already outdated, right as the OpenAI and Anthropic incidents have everyone asking where the off switch is.
RNZ
Europe confident its rules can thwart rogue AI
European Union (EU) rules setting guardrails on AI use adopted by the bloc two years ago are more than capable of tackling rogue agents, EU tech chief Henna Virkkunen told Reuters on Friday (local time).
🔐 Anthropic merges its two cyber access programs into one with three tiers
The revamped Cyber Verification Program folds in Glasswing, which had Mythos access, and the old CVP, which had loosened safeguards on Opus and Sonnet. All tiers get Opus 5.5, Sonnet 5.5, Mythos 5.1 and future models.
The Red Team tier allows authorized pen testing, and only organizations can apply. Anthropic vets members together with the US government.
The revamped Cyber Verification Program folds in Glasswing, which had Mythos access, and the old CVP, which had loosened safeguards on Opus and Sonnet. All tiers get Opus 5.5, Sonnet 5.5, Mythos 5.1 and future models.
The Red Team tier allows authorized pen testing, and only organizations can apply. Anthropic vets members together with the US government.
🧠 Berkeley says 10 minutes with AI makes you quit hard problems faster
In a study of 354 people doing fraction problems, the ChatGPT group started out more accurate. Then the researchers pulled the tool after 12 problems, and their accuracy dropped almost immediately, and they gave up more often than the group that never had help.
In a study of 354 people doing fraction problems, the ChatGPT group started out more accurate. Then the researchers pulled the tool after 12 problems, and their accuracy dropped almost immediately, and they gave up more often than the group that never had help.
vcresearch.berkeley.edu
Using AI for Just 10 Minutes Erodes Your Ability to Persist at Hard Things | Research UC Berkeley
A UC Berkeley researcher raises profound questions about how we interact with artificial intelligence in daily life.
❤1
🧠 Michael I. Jordan says superintelligence is science fiction
The Berkeley professor and machine learning heavyweight told Libération that AI should be treated as engineering, judged by how it fails in the real world.
That's the opposite of the framing coming out of the labs and Washington, where superintelligence now shows up in policy talk and in calls for an emergency brake.
The Berkeley professor and machine learning heavyweight told Libération that AI should be treated as engineering, judged by how it fails in the real world.
That's the opposite of the framing coming out of the labs and Washington, where superintelligence now shows up in policy talk and in calls for an emergency brake.
👎4
🚨 Nvidia-backed Firmus scraps its $5B IPO, and the AI trade just got a crack
The Australian data center operator pulled the listing after investors balked at a roughly $30B valuation, a heavy debt load, and only two operational data centers. It's pivoting to a private raise instead, which is a funny way to say the public market said no.
The Australian data center operator pulled the listing after investors balked at a roughly $30B valuation, a heavy debt load, and only two operational data centers. It's pivoting to a private raise instead, which is a funny way to say the public market said no.
Bbc
Nvidia-backed data centre firm scraps IPO as AI valuation concerns deepen
Firmus said it had made the decision due to "recent market volatility and prevailing market conditions".
❤1
🚨 Amazon's reportedly in talks to buy Decart for around $7B
Decart builds real-time generative video and world models, and the WSJ report, relayed by Reuters, says nothing is signed yet. Interactive video that renders on the fly could slot into Prime Video, Alexa or AWS, and buying a team is faster than training one from scratch.
Decart builds real-time generative video and world models, and the WSJ report, relayed by Reuters, says nothing is signed yet. Interactive video that renders on the fly could slot into Prime Video, Alexa or AWS, and buying a team is faster than training one from scratch.
🤖 Linus Torvalds is now writing kernel code with Claude Code
Phoronix spotted a new branch in his tree, noref-filemap-read-with-llm. It tries to fix thread contention on small file reads.
• It reads from the page cache without folio references
• Torvalds says the code, test programs and review were done by Claude Code "under my direction"
• He ran the measurements on his own machine
Phoronix spotted a new branch in his tree, noref-filemap-read-with-llm. It tries to fix thread contention on small file reads.
• It reads from the page cache without folio references
• Torvalds says the code, test programs and review were done by Claude Code "under my direction"
• He ran the measurements on his own machine
Phoronix
Linus Torvalds Working On A Hefty Linux Kernel Improvement With Claude Code
Linux creator Linus Torvalds has been known to use AI to help with kernel debugging and outside of the kernel tree has also done some vibe coding with Google's Antigravity