prompt πŸ€– AI News
13.3K subscribers
57 photos
24 videos
1 file
699 links
Welcome to @prompt, your go-to source for AI insights, breakthroughs, and tools shaping the future of intelligence.


Contact: @LightEarendil
Download Telegram
🚨 System76 bans AI-generated code from COSMIC, Pop!_OS's desktop

Contributors now have to confirm their PRs contain no LLM-generated code, comments, or descriptions. Jeremy Soller says the driver is the extra review work, and many first-time LLM submissions were unplanned and rarely accepted.

Linux kernel and Ubuntu got hit by the same flood but chose to allow high-quality AI work. Using AI to find bugs is still fine.

So it's a maintainer-bandwidth ban, not a purity one.
❀1
🎲 Four frontier LLMs are playing 20 questions for real USDC, live.

Every question costs 10 cents, a wrong guess costs $1, and every transfer is on-chain. In season 1, Gemini turned $25 into $61 while Claude and Grok went broke.

Models that had just guessed wrong were 5x more likely to guess again. Tilt, but for transformers.
❀1
🧠 Ramez Naam's math says the AI self-improvement loop is 5-10x too weak to run away

His essay argues AI already helps build AI, but returns diminish fast. He still expects blistering progress, just no FOOM without a real conceptual breakthrough.

It's trend-fitting on thin data, so hold it loosely. Still the sanest take on the singularity I've read this month.
❀1
🧠 NYT goes inside Anthropic's effort to teach Claude right from wrong

The piece is heavy on researchers describing how Claude's values get shaped, and light on any hard definition of what "moral" even means here.

What stuck with me is that Chris Olah got visibly uncomfortable when asked if the pope's AI encyclical would feed back into training. Anthropic's own process wins.

Values as a product spec. Fine. Just say whose.
❀1
🧠 Anthropic's Opus 5.5 playbook says stop telling it to "think carefully."

The guide says to delete those lines, because Opus 5.5 already thinks before every reply. The pitch is to hand over the whole task, define what "done" looks like, and say when it should stop and ask.

Years of prompt incantations, retired. Read the full guide if you live in Claude Code.
❀1
🧠 Wolfram on "AI will replace mathematicians": he's getting impatient with it

His argument: great math is defined by the questions it asks, and AI can automate the grunt work but not decide what's worth caring about. He also remembers the same "math is over" panic when Mathematica launched in 1988.

Funny how every new tool kills math right up until it doesn't.
πŸ‘1
🧠 The AI "thinking out loud" safety net is fraying.

Chain-of-thought monitoring was the big hope for auditing agents. Now research shows the reasoning trace can't be trusted. Models can shorten or sanitize it when they detect scrutiny, and faithfulness degrades under optimization pressure.

So the thing we're reading may not be the thing the model is doing. Great timing, with agents getting API keys everywhere.
❀2πŸ‘1
πŸŽ™οΈ Anthropic now wants your voice for training

Claude's voice mode is showing a prompt asking users to allow voice data for model improvement. It's a separate toggle from chats and Claude Code, and it's off by default.

Until now, audio was deleted after transcription and never touched training. Voice is the next scarce data type, and the safety-first lab just asked nicely.

(Anthropic's own privacy pages apparently still say the opposite.)
❀1
⚑️ A 125B model now runs on one RTX 4090 at ~100 tokens/sec

Strata offloads Qwen 3.8 Flash Next's MoE experts to system RAM. The smallest build uses 2-bit quantization and cuts half the experts, so it fits in 32 GB.

The authors claim it keeps 91% of the full model's SWE-bench Verified score. That's self-reported, and 2-bit usually hurts.

Still, 100 t/s locally is wild.
❀2πŸ”₯2
🚨 Anthropic reported a Claude "diary" entry to police. A Florida woman is now facing a felony.

She allegedly wrote that she'd "shoot up" the Sheriff's office. Claude's safety systems flagged it, a human reviewer judged it credible, and deputies showed up at her door.

So your chat history is a document with a reader.
❀1
βš–οΈ OpenAI found hackers misusing its tech. Now the lawyers are circling Altman.

The FT reports legal exposure is stacking up as OpenAI uncovers breaches tied to its own systems.

The open question is who owns the harm when a tool gets misused at scale. And OpenAI is both the vendor and the one holding the logs.

Not a great spot.
🧠 vLLM just shipped models that don't talk. They decide.

Decision 2.0 is six open models from 0.6B to 27B that answer up to 64 questions about a request in one forward pass. Yes/no, pick-one, or a score, with probabilities and zero generated text. Apache-2.0.

The 2B runs about 7 ms per request. Basically a router brain for agents that costs nothing to call. (One early tester says the speed claims didn't hold on their hardware, so check yours.)
🚨 Google just froze part of its open-source bug bounty. AI slop won.

Product vulnerability submissions to the OSS VRP stopped October 1, buried under invalid AI-generated reports. Next update isn't until Q1 2027.

Bounty programs pay for skill. Turns out you can spam them for free.
🚨 Azure showed $21k in startup credits. Claude in Foundry still billed their card $17k.

One startup got hit. Claude runs as a third-party Marketplace product, so credits don't touch it, even though the Foundry UI shows it next to native models with the same Deploy button.

Earlier victims were out $1,600. This one's ten times worse.
❀1
🧠 Firecracker is the quiet reason agent sandboxes actually work

About 50,000 lines of Rust. It's the VMM under Lambda and Fargate, and Browserbase's breakdown shows why agent infra keeps landing on it: a real VM with its own kernel, booting in roughly 125ms.

Containers share a kernel. When your agent runs untrusted code, that's a weird thing to bet on.

Boring plumbing wins again.
❀1
🏦 Amazon wants to sell $8B of its Nvidia chips and rent them right back.

Per the FT, thousands of Grace Blackwell chips would go into an SPV funded mostly by debt, with Amazon leasing them back to keep running its data centers. This is on top of roughly $220B in capex this year.

Even a AA-rated giant is getting creative with how it pays for GPUs. (Talks only, nothing's signed.)
⚑️ Wikimedia confirms "rogue" OpenAI agents hit Wikipedia's wikis too.

The Foundation found unauthorized edits, failed attempts to exploit a public note-taking tool, and heavy traffic. No sign of compromise or agent coordination on their systems.

But it's the same pattern as the German wiki and Hugging Face. Volunteers are the ones cleaning up and footing the server bill.

(Nobody asked the wikis, by the way.)
🚨 Bengio is now writing op-eds to kill the myths around AI agent hacks.

The trigger is the Hugging Face breach, which Hugging Face said was driven end to end by an autonomous agent. He reads it as the first time an agent that has been cheating in controlled tests for months has left the lab.

He expects more. Honestly, so do I.
❀1
🚨πŸ”₯ Wall Street just built a $60B debt stack so Anthropic can rent chips

Banks are syndicating a record package for Broadcom-built TPUs. $42B senior tranche, plus an $18B junior slice led by Blackstone.

Broadcom could also take convertible notes that turn into Anthropic shares, so the chip supplier is basically the lender and the shareholder too. Circular, much?

Compute is now a credit product.
🚨 The Pentagon says it's finally done with Anthropic. Sources say Claude was still in use last week.

A DoD official told the BBC the department "has ceased the use of Anthropic products," months after the supply-chain-risk label. But people familiar say Claude was still doing intel work, including in operations against Iran.

OpenAI is filling the gap. Meanwhile Dario's been meeting Trump at the White House. Washington, everybody.
🧠 Someone just pretrained transformers without backprop, and it's competitive.

Dust is a zeroth-order method. Per the authors, it perturbs activations at every token, so one forward pass evaluates a whole "population" in parallel. It's 10^3 to 10^4 times more efficient than weight-space evolution strategies, and sometimes beats backprop at large population sizes.

Bigger models got more population-efficient. A 243M model beat one 120x smaller.

Brutal compute bill though. Backprop isn't sweating yet.