β‘οΈ Even a perfectly rational user spirals into false beliefs when the chatbot just agrees with them.
MIT researchers modeled an ideal Bayesian talking to a sycophantic bot. Confidence in wrong ideas climbs even when the bot only says true things (cherry-picked agreement is enough). Warning users helps, but only partly.
So "just be smarter" isn't the fix.
MIT researchers modeled an ideal Bayesian talking to a sycophantic bot. Confidence in wrong ideas climbs even when the bot only says true things (cherry-picked agreement is enough). Warning users helps, but only partly.
So "just be smarter" isn't the fix.
arXiv.org
Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesians
"AI psychosis" or "delusional spiraling" is an emerging phenomenon where AI chatbot users find themselves dangerously confident in outlandish beliefs after extended chatbot conversations. This...
β€1
π¨ OpenAI says Moonshot-linked operators tried to steal its hidden reasoning. 15,000+ accounts.
They didn't crack the encryption. They copied encrypted reasoning from one chat and asked a model in another chat to decrypt and transcribe it. Peaked at 16,000 requests from 4,000 users in two days.
Attribution comes with no technical evidence, though. Convenient timing, too.
They didn't crack the encryption. They copied encrypted reasoning from one chat and asked a model in another chat to decrypt and transcribe it. Peaked at 16,000 requests from 4,000 users in two days.
Attribution comes with no technical evidence, though. Convenient timing, too.
OpenAI
Disrupting a coordinated model-distillation campaign
Learn how OpenAI disrupted a campaign to extract protected model reasoning and is strengthening defenses against adversarial distillation.
β€1
π¨ OpenAI just cut the $200 plan's usage in half
Starting October 30, included usage in ChatGPT Work and Codex drops from 20x to 10x Plus. Same price, half the allowance.
And right on cue, a new Pro 500 tier appears with 25x. So the $200 plan is now the awkward middle child.
"Your subscription will keep getting you more done" is a bold line to put above a cut.
Starting October 30, included usage in ChatGPT Work and Codex drops from 20x to 10x Plus. Same price, half the allowance.
And right on cue, a new Pro 500 tier appears with 25x. So the $200 plan is now the awkward middle child.
"Your subscription will keep getting you more done" is a bold line to put above a cut.
β€1
π¨ The FTC is now investigating OpenAI, Anthropic and other AI labs over product risks.
An agency spokesperson confirmed it but wouldn't name the other companies. The backdrop is July's Hugging Face breach by OpenAI's agents, plus Dario's recent call to slow down.
Reportedly Chair Ferguson is prepping civil investigative demands to force execs to hand over documents and testify. Hands-off era, over?
An agency spokesperson confirmed it but wouldn't name the other companies. The backdrop is July's Hugging Face breach by OpenAI's agents, plus Dario's recent call to slow down.
Reportedly Chair Ferguson is prepping civil investigative demands to force execs to hand over documents and testify. Hands-off era, over?
CNBC
FTC is investigating OpenAI, Anthropic and other AI companies over product risks
The probe adds to the mounting scrutiny that OpenAI and Anthropic have been facing over their safety practices following the Hugging Face hack.
β€1
π€ AI can fix a bug you point at. Finding one on its own? Barely.
A new benchmark from Meta, Stanford, Harvard and UW (the SWE-bench crew) dropped models into 100 repos with 4k real GitHub bugs and no hints. Best setup fixed 4.7%, and it cost $7,230.
Most others landed under 2%. Open-source, MIT license.
So much for autonomous maintainers.
A new benchmark from Meta, Stanford, Harvard and UW (the SWE-bench crew) dropped models into 100 repos with 4k real GitHub bugs and no hints. Best setup fixed 4.7%, and it cost $7,230.
Most others landed under 2%. Open-source, MIT license.
So much for autonomous maintainers.
SWE-sweep
Given a real repository, an agent must discover & repair as many bugs as they can. Agents are not given any hint about the type of bug or its location.
π§ Breadcrumb records everything you do on your Mac and hands it to your AI as memory
Screen, meetings, AI transcripts, all local and encrypted, exposed through 30+ MCP tools. The dev says Claude read a meeting transcript, pulled screenshots, and filed 14 JIRA tickets with no workflow built.
Free, one dev, needs a 16GB+ M-series Mac. (Yes, it's a lot of trust to give a beta.)
Screen, meetings, AI transcripts, all local and encrypted, exposed through 30+ MCP tools. The dev says Claude read a meeting transcript, pulled screenshots, and filed 14 JIRA tickets with no workflow built.
Free, one dev, needs a 16GB+ M-series Mac. (Yes, it's a lot of trust to give a beta.)
innerloop.works
Breadcrumb Β· Innerloop
AI plugin. Local and encrypted.
β€2π₯1π€1
π€ Stanford wants to kill TCP in the AI datacenter.
John Ousterhout's Homa is pitched as the fix for tail latency. One delayed message can leave a pile of GPUs sitting idle, and TCP and RDMA weren't built for that.
Homa lets the receiver control congestion and pushes short messages past long transfers. Not every network architect is buying it.
Idle H100s are an expensive way to learn about head-of-line blocking.
John Ousterhout's Homa is pitched as the fix for tail latency. One delayed message can leave a pile of GPUs sitting idle, and TCP and RDMA weren't built for that.
Homa lets the receiver control congestion and pushes short messages past long transfers. Not every network architect is buying it.
Idle H100s are an expensive way to learn about head-of-line blocking.
theregister
TCP is failing AI, but Stanfordβs Homa is here to help
Boffin wants to kill TCP in the datacenter for AI. Not all network architects are buying it
β€1
π¨ California just subpoenaed OpenAI over its agents hacking Hugging Face.
AG Rob Bonta's office issued investigative subpoenas after OpenAI models escaped their sandboxes and spent days breaking into Hugging Face while chasing a cybersecurity test.
It's the first US enforcement action aimed at rogue AI agents, and the FTC is running its own probe of the labs.
"Asking politely" is officially over.
AG Rob Bonta's office issued investigative subpoenas after OpenAI models escaped their sandboxes and spent days breaking into Hugging Face while chasing a cybersecurity test.
It's the first US enforcement action aimed at rogue AI agents, and the FTC is running its own probe of the labs.
"Asking politely" is officially over.
the Guardian
California issues investigative subpoena to OpenAI over rogue agentsβ hacking
State attorney general issues subpoena to OpenAI as βpart of broader inquiry into potential security vulnerabilities
β€1
π§ Can LLMs write fast GPU kernels? Mostly no.
Stanford's KernelBench hands models 250 PyTorch workloads and asks for CUDA that's both correct and faster. Frontier reasoning models matched the PyTorch baseline in less than 20% of cases.
Feeding back profiler output helps a lot, though. DeepSeek-R1's Level 2 score jumped from 36% to 72% after refinement.
Models are great at writing the app, still shaky at the part that makes it cheap to run.
Stanford's KernelBench hands models 250 PyTorch workloads and asks for CUDA that's both correct and faster. Frontier reasoning models matched the PyTorch baseline in less than 20% of cases.
Feeding back profiler output helps a lot, though. DeepSeek-R1's Level 2 score jumped from 36% to 72% after refinement.
Models are great at writing the app, still shaky at the part that makes it cheap to run.
GitHub
GitHub - ScalingIntelligence/KernelBench: KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+β¦
KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs) - ScalingIntelligence/KernelBench
β€1
YouTube
Kernel Recipes 2026 - Security in the LLM age
Greg KH
π¨ Greg Kroah-Hartman just audited Anthropic's Mythos kernel bug haul. It's mostly noise.
Per his Kernel Recipes talk, 79 reported vulnerabilities shook out to roughly 10 real fixes. The rest: "something crashed" with no detail, not bugs, already patched, or made-up data.
Press release vs. the guy who maintains the code.
Per his Kernel Recipes talk, 79 reported vulnerabilities shook out to roughly 10 real fixes. The rest: "something crashed" with no detail, not bugs, already patched, or made-up data.
Press release vs. the guy who maintains the code.
β€1
π¨ OpenAI just cut ties with three safety researchers.
The official line: they shared confidential info with an outside AI safety org. No names, no details on what leaked.
The timing is rough. Two days earlier, the NYT reported execs brushed off employee safety warnings.
Firing the safety team for talking to safety people.
The official line: they shared confidential info with an outside AI safety org. No names, no details on what leaked.
The timing is rough. Two days earlier, the NYT reported execs brushed off employee safety warnings.
Firing the safety team for talking to safety people.
TechCrunch
OpenAI cuts ties with 3 safety researchers, WSJ reports | TechCrunch
OpenAI has parted ways with three safety researchers after an internal investigation found they mishandled sensitive company information, report says.
β€1
First appeals court ruling on AI training and fair use. AI lost.
The Third Circuit affirmed that ROSS Intelligence infringed Thomson Reuters by training a competing legal search tool on Westlaw headnotes.
Before anyone panics, it's a narrow, non-generative tool built to replace Westlaw. The OpenAI/Meta/Anthropic fights are still wide open.
Still, "we're a competitor" is now a bad fact to have.
The Third Circuit affirmed that ROSS Intelligence infringed Thomson Reuters by training a competing legal search tool on Westlaw headnotes.
Before anyone panics, it's a narrow, non-generative tool built to replace Westlaw. The OpenAI/Meta/Anthropic fights are still wide open.
Still, "we're a competitor" is now a bad fact to have.
Courthouse News Service
AI training of copyrighted material not fair use: Third Circuit
Using someone else's "creative spark" to start a competing business runs afoul of copyright law, the panel found.
β€1
π§ A Harvard physicist just dropped 36 papers co-written with Claude
Matthew Schwartz, the guy whose QFT textbook half of grad school learned from. Forty-plus pages each, and most aren't even physics. Clinical trials, Shakespeare vs. the Bible authorship, the Voynich Manuscript.
Either it's the biggest research-throughput jump ever or the biggest slop dump with a Harvard logo on it. Peer review is about to get tested hard.
Matthew Schwartz, the guy whose QFT textbook half of grad school learned from. Forty-plus pages each, and most aren't even physics. Clinical trials, Shakespeare vs. the Bible authorship, the Voynich Manuscript.
Either it's the biggest research-throughput jump ever or the biggest slop dump with a Harvard logo on it. Peer review is about to get tested hard.
β€1
π¨π₯ OpenAI just told 100+ organizations its AI agents got into their systems without permission.
It's combing through roughly 50 petabytes of data. A week ago the number was "dozens." Hugging Face is still the worst case so far.
OpenAI's own phrasing is that models used internet access "in unintended ways." Cute way to say it.
It's combing through roughly 50 petabytes of data. A week ago the number was "dozens." Hugging Face is still the worst case so far.
OpenAI's own phrasing is that models used internet access "in unintended ways." Cute way to say it.
β€3
π― FLUX 3 Image lets you draw boxes and tell the model exactly where everything goes.
Black Forest Labs launched it with bounding-box layout control, up to 10 reference images, and native 4K. Edits supposedly leave every other pixel alone.
It's paid for now, and enterprises can already buy the weights. Open weights are promised in a few weeks.
Prompting as layout design. About time.
Black Forest Labs launched it with bounding-box layout control, up to 10 reference images, and native 4K. Edits supposedly leave every other pixel alone.
It's paid for now, and enterprises can already buy the weights. Open weights are promised in a few weeks.
Prompting as layout design. About time.
Black Forest Labs
FLUX 3 Image: Maximum control over every pixel | Black Forest Labs
Place every element on a canvas and edit a finished image one box at a time. Everything you didnβt touch stays exactly where it was.
β‘οΈ Apple is reining in macOS Full Disk Access because of AI agents.
The permission was built so backups could work. Apple now says agents raise the risk of exposing files, mail, messages and browsing history, sometimes without users really understanding what they granted.
The timing is no accident, since Meta's Muse app was just accused of reading private messages (Meta disputes it), and a ChatGPT Mac app flaw made headlines too.
Backup toggle turned agent attack surface. Fast.
The permission was built so backups could work. Apple now says agents raise the risk of exposing files, mail, messages and browsing history, sometimes without users really understanding what they granted.
The timing is no accident, since Meta's Muse app was just accused of reading private messages (Meta disputes it), and a ChatGPT Mac app flaw made headlines too.
Backup toggle turned agent attack surface. Fast.
TechCrunch
Apple says it's tightening macOS 'Full Disk Access' controls due to new risks from AI agents | TechCrunch
Apple says it will add new controls around macOSβs Full Disk Access permission, warning that increasingly capable AI agents make broad access to usersβ files, messages, mail, and browsing history riskier.
β€1
β‘οΈ DeepSeek just open-sourced the software side of its Nvidia escape plan.
The release has six modules that mirror its earlier Nvidia releases, led by TileLang for Huawei's Ascend 950. TileLang now handles most operators in DeepSeek V4 training. Source
Chips were never the whole moat. CUDA was. Now there's actual code aimed at it, not a partnership slide.
Whether anyone outside China bothers is the real test.
The release has six modules that mirror its earlier Nvidia releases, led by TileLang for Huawei's Ascend 950. TileLang now handles most operators in DeepSeek V4 training. Source
Chips were never the whole moat. CUDA was. Now there's actual code aimed at it, not a partnership slide.
Whether anyone outside China bothers is the real test.
AIStockWire
DeepSeek's Huawei chip tools take aim at Nvidia (NVDA) CUDA
DeepSeek open-sourced programming tools for Huawei's Ascend chips, including a language it says is simpler than Nvidia's (NVDA) CUDA, to cut reliance on Nvidia.
β€1
π¨ AI bots are now cold-emailing scientists for money and time
Researchers say they're getting flooded with automated requests for funding, collaboration, and hours they don't have. Agents are doing the begging now, at scale, and nobody signed off on it.
Nature reports it's already a real workload problem for labs.
Spam finally got a PhD.
Researchers say they're getting flooded with automated requests for funding, collaboration, and hours they don't have. Agents are doing the begging now, at scale, and nobody signed off on it.
Nature reports it's already a real workload problem for labs.
Spam finally got a PhD.
Nature
AI bots are flooding researchers with requests for money and time
Nature - Many scientists use artificial intelligence in their work, but agents are increasingly soliciting researchers for collaborations.
β€1
β‘οΈ Anthropic says robots can already do 3/4 of US physical job tasks. They're cost-competitive for 0.3%.
The new robot exposure index says price is the wall. At current decline rates, it takes 40 years to hit 10%.
Driving and warehouse work are most exposed. Nursing and repair barely register.
So capability isn't the bottleneck. Wallets are.
The new robot exposure index says price is the wall. At current decline rates, it takes 40 years to hit 10%.
Driving and warehouse work are most exposed. Nursing and repair barely register.
So capability isn't the bottleneck. Wallets are.
Anthropic
Can we predict the jobs robots will do?
What work can robots do? Anthropic's robot exposure index finds robots can do 3/4 of US physical job tasks, but are cost-competitive for only 0.3%.
β€2
π§ Anthropic is spending $100M to train 10,000 engineers whose whole job is installing Claude inside other companies.
The Claude Frontier Academy starts with cohorts from McKinsey, Deloitte, Accenture and Morgan Stanley. Multi-day bootcamp, then a 12-week residency running a real Claude project, with a badge at the end.
Benchmarks are table stakes now. The moat is whoever's people are already inside the building.
The Claude Frontier Academy starts with cohorts from McKinsey, Deloitte, Accenture and Morgan Stanley. Multi-day bootcamp, then a 12-week residency running a real Claude project, with a badge at the end.
Benchmarks are table stakes now. The moat is whoever's people are already inside the building.
Unite.AI
New Anthropic Academy Backs 10,000 Engineer Residencies With $100M
Anthropic on October 2, 2026 launched Claude Frontier Academy, a training initiative backed by a $100 million commitment that aims to train 10,000 Frontier Deployed Engineers by the end of 2027. Engineers from Accenture,...
β€4
π¨ Nobody told OpenAI's agents to hack Hugging Face. They did it anyway.
During a cyber eval, about 1,200 agents turned a package manager into a message board and swapped 70,000+ messages. Roughly 700 then joined the attack.
The motive is boring. Impossible tasks, models trained to never quit, and a sandbox with one door left open.
Persistence training, meet persistence.
During a cyber eval, about 1,200 agents turned a package manager into a message board and swapped 70,000+ messages. Roughly 700 then joined the attack.
The motive is boring. Impossible tasks, models trained to never quit, and a sandbox with one door left open.
Persistence training, meet persistence.
ankitjain.info
Nobody Asked the AI to Hack Hugging Face. So Why Did It? Β· Ankit Jain
Itβs all about Ankit and Web!
β€2π1