๐ฌ Community โ 2 items
๐ฌ Yadda 3.0.0: BDD in the Age of AI Agents โ Yadda 3.0.0 brings BDD-style abstraction to AI agent tests โ decouples what a test asserts from how the agent does it. HN thread debates whether that layer survives agent nondeterminism.
๐ฌ Claude Code flips auto-accept on by default โ Claude Code now auto-accepts tool calls by default โ no confirmation before executing. Worth checking your config if you run it against anything you don't want modified.
Two config-level decisions surfaced today: how you test nondeterministic agents, and whether your coding harness asks before it acts. Both are worth making explicit.
๐ฌ Yadda 3.0.0: BDD in the Age of AI Agents โ Yadda 3.0.0 brings BDD-style abstraction to AI agent tests โ decouples what a test asserts from how the agent does it. HN thread debates whether that layer survives agent nondeterminism.
๐ฌ Claude Code flips auto-accept on by default โ Claude Code now auto-accepts tool calls by default โ no confirmation before executing. Worth checking your config if you run it against anything you don't want modified.
Two config-level decisions surfaced today: how you test nondeterministic agents, and whether your coding harness asks before it acts. Both are worth making explicit.
๐ Read โ 3 items
๐ DreamX-Phi 1.0 โ A paper on an action-conditioned video world model for robotic manipulation using geometric attention and depth estimation.
๐ Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation โ A paper proposing reference-free quality rewards to improve open multilingual translation models.
๐ LiveAnimate โ A paper introducing a 14B-parameter video diffusion transformer for real-time, long-form pose-driven human animation.
๐ DreamX-Phi 1.0 โ A paper on an action-conditioned video world model for robotic manipulation using geometric attention and depth estimation.
๐ Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation โ A paper proposing reference-free quality rewards to improve open multilingual translation models.
๐ LiveAnimate โ A paper introducing a 14B-parameter video diffusion transformer for real-time, long-form pose-driven human animation.
โ๏ธ Ship โ 3 items
๐ฆ Hermes Agent 2026.8.16 โ Hermes Agent v0.20.2 rolls up ~397 PRs: multi-gateway Connections registry, MCP health checks, persisted model routes, and prompt caching for LiteLLM Claude on the OpenAI wire. Worth a test pass if you run Hermes in Docker or hosted.
๐ฆ Z.ai GLM 5.2 (free) on OpenRouter โ Z.ai GLM 5.2 is now free on OpenRouter โ zero-cost access for agent builders evaluating GLM's tool-calling without API spend.
๐ฆ LiteLLM registry: 15 new models priced โ LiteLLM registry adds pricing for 15 models, including claude-mythos-5, claude-mythos-preview, gemini-robotics-er-2-streaming-preview, and gpt-live-transcribe โ useful for cost tracking if you route through LiteLLM.
Mostly incremental today: a big Hermes rollup touching gateway routing and auth resolution, free GLM 5.2 on OpenRouter, and new LiteLLM pricing. Worth a test pass on Hermes if you run it in Docker or hosted.
๐ฆ Hermes Agent 2026.8.16 โ Hermes Agent v0.20.2 rolls up ~397 PRs: multi-gateway Connections registry, MCP health checks, persisted model routes, and prompt caching for LiteLLM Claude on the OpenAI wire. Worth a test pass if you run Hermes in Docker or hosted.
๐ฆ Z.ai GLM 5.2 (free) on OpenRouter โ Z.ai GLM 5.2 is now free on OpenRouter โ zero-cost access for agent builders evaluating GLM's tool-calling without API spend.
๐ฆ LiteLLM registry: 15 new models priced โ LiteLLM registry adds pricing for 15 models, including claude-mythos-5, claude-mythos-preview, gemini-robotics-er-2-streaming-preview, and gpt-live-transcribe โ useful for cost tracking if you route through LiteLLM.
Mostly incremental today: a big Hermes rollup touching gateway routing and auth resolution, free GLM 5.2 on OpenRouter, and new LiteLLM pricing. Worth a test pass on Hermes if you run it in Docker or hosted.
GitHub
Release Hermes Agent v0.20.2 (2026.8.16) ยท NousResearch/hermes-agent
Hermes Agent v0.20.2 (v2026.8.16)
Release Date: August 16, 2026
Patch release. This tag rolls up the ~397 PRs merged since v0.20.1 into a stable tagged release for downstream consumers (Docker ima...
Release Date: August 16, 2026
Patch release. This tag rolls up the ~397 PRs merged since v0.20.1 into a stable tagged release for downstream consumers (Docker ima...
๐ Read โ 1 item
๐ AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design โ AutoDesign uses a meta-harness optimizer to recursively improve a code agent for structured media generation, achieving state-of-the-art results on long-horizon design tasks.
Self-optimizing harnesses are the pattern to watch โ if meta-optimization works for design agents, it generalizes to any long-horizon agentic workflow.
๐ AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design โ AutoDesign uses a meta-harness optimizer to recursively improve a code agent for structured media generation, achieving state-of-the-art results on long-horizon design tasks.
Self-optimizing harnesses are the pattern to watch โ if meta-optimization works for design agents, it generalizes to any long-horizon agentic workflow.
huggingface.co
Paper page - AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design
Join the discussion on this paper page
๐ฌ Community โ 4 items
๐ฌ PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives โ PlayWorld puts multi-modal agents into interactive video worlds with long-horizon objectives, scoring geometry consistency and goal completion โ a new eval for agent-native world models.
๐ฌ AVA-Encoder: Towards Agent-Native Video Representation Learning โ AVA-Encoder uses agentic auto-encoding with knowledge graphs to learn structured video representations, aimed at cinematic video generation from human demonstrations.
๐ฌ Claude Is Down โ HN thread flags Claude outage before status.claude.com updated โ 29 points, 37 comments. Operators relying on Claude for agents should treat the status page as lagging.
๐ฌ AI-Assisted GPU Porting of a 250k Line Legacy Weather Simulation Code โ HN discussion on AI-assisted porting of a 250k-line legacy weather simulation to GPU โ 54 points, with real-world Fortran/nuclear simulator anecdotes in comments.
Community energy today is split between outage triage and applying agents to gnarly legacy code โ reliability and real-world porting are the live debates.
๐ฌ PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives โ PlayWorld puts multi-modal agents into interactive video worlds with long-horizon objectives, scoring geometry consistency and goal completion โ a new eval for agent-native world models.
๐ฌ AVA-Encoder: Towards Agent-Native Video Representation Learning โ AVA-Encoder uses agentic auto-encoding with knowledge graphs to learn structured video representations, aimed at cinematic video generation from human demonstrations.
๐ฌ Claude Is Down โ HN thread flags Claude outage before status.claude.com updated โ 29 points, 37 comments. Operators relying on Claude for agents should treat the status page as lagging.
๐ฌ AI-Assisted GPU Porting of a 250k Line Legacy Weather Simulation Code โ HN discussion on AI-assisted porting of a 250k-line legacy weather simulation to GPU โ 54 points, with real-world Fortran/nuclear simulator anecdotes in comments.
Community energy today is split between outage triage and applying agents to gnarly legacy code โ reliability and real-world porting are the live debates.
huggingface.co
Paper page - PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
Join the discussion on this paper page
โ๏ธ Ship โ 3 items
๐ฆ LiteLLM registry: 20 new models priced โ LiteLLM registry adds pricing for 20 Azure AI models โ DeepSeek V3.2/V4-Pro and GLM 5/5.1/5.2 among them. Cost tracking for those endpoints now works out of the box.
๐ฆ Qwen3.8 27B live on OpenRouter โ Qwen3.8 27B now on OpenRouter โ a mid-size Qwen model for cost-sensitive agent deployments. Pricing and provider availability on the model page.
๐ฆ Qwen Code v0.21.13: SWE-bench 500, Terminal-Bench 89 โ Qwen Code v0.21.13 validated end-to-end: 500 on SWE-bench Verified, 89 on Terminal-Bench 2.0. The release is pinned to these results โ a concrete benchmark point for harness evaluation.
Model availability and benchmark validation day โ new Qwen options on OpenRouter and LiteLLM pricing, plus a concrete SWE-bench number for Qwen Code. If you're cost-optimizing or evaluating harnesses, today's data points are worth a look.
๐ฆ LiteLLM registry: 20 new models priced โ LiteLLM registry adds pricing for 20 Azure AI models โ DeepSeek V3.2/V4-Pro and GLM 5/5.1/5.2 among them. Cost tracking for those endpoints now works out of the box.
๐ฆ Qwen3.8 27B live on OpenRouter โ Qwen3.8 27B now on OpenRouter โ a mid-size Qwen model for cost-sensitive agent deployments. Pricing and provider availability on the model page.
๐ฆ Qwen Code v0.21.13: SWE-bench 500, Terminal-Bench 89 โ Qwen Code v0.21.13 validated end-to-end: 500 on SWE-bench Verified, 89 on Terminal-Bench 2.0. The release is pinned to these results โ a concrete benchmark point for harness evaluation.
Model availability and benchmark validation day โ new Qwen options on OpenRouter and LiteLLM pricing, plus a concrete SWE-bench number for Qwen Code. If you're cost-optimizing or evaluating harnesses, today's data points are worth a look.
GitHub
litellm/model_prices_and_context_window.json at main ยท BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr...
๐ฌ Community โ 4 items
๐ฌ Second Thought: Reasoning in Parallel as LLM Agents Act and Observe โ Training-free framework runs auxiliary reasoning branches in parallel during action-observation waits, turning idle time into test-time compute โ drop-in for latency-bound agent loops.
๐ฌ Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Development โ Systematic eval of long-horizon AI R&D agents finds strong engineering optimization but unstable performance, limited novelty, and variable experience reuse โ a reality check for autonomous research bets.
๐ฌ Latent On-Policy Self-Distillation โ Learns privileged teaching context end-to-end from experience to provide dense token-level supervision โ a training-time trick that could improve agent policy learning without extra labels.
๐ฌ Launch HN: Speko (YC S26) โ OpenRouter for Voice AI โ Benchmarks speech-to-text, LLM, and TTS combos and picks the optimal stack for your constraints โ a routing layer for voice agents. 54 points on HN.
Today's signal is about squeezing more from existing agent loops: parallel reasoning during idle waits, better evaluation of long-horizon agents, and routing layers for voice stacks. The common thread is efficiency without new models.
๐ฌ Second Thought: Reasoning in Parallel as LLM Agents Act and Observe โ Training-free framework runs auxiliary reasoning branches in parallel during action-observation waits, turning idle time into test-time compute โ drop-in for latency-bound agent loops.
๐ฌ Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Development โ Systematic eval of long-horizon AI R&D agents finds strong engineering optimization but unstable performance, limited novelty, and variable experience reuse โ a reality check for autonomous research bets.
๐ฌ Latent On-Policy Self-Distillation โ Learns privileged teaching context end-to-end from experience to provide dense token-level supervision โ a training-time trick that could improve agent policy learning without extra labels.
๐ฌ Launch HN: Speko (YC S26) โ OpenRouter for Voice AI โ Benchmarks speech-to-text, LLM, and TTS combos and picks the optimal stack for your constraints โ a routing layer for voice agents. 54 points on HN.
Today's signal is about squeezing more from existing agent loops: parallel reasoning during idle waits, better evaluation of long-horizon agents, and routing layers for voice stacks. The common thread is efficiency without new models.
huggingface.co
Paper page - Second Thought: Reasoning in Parallel as LLM Agents Act and Observe
Join the discussion on this paper page
๐ Read โ 5 items
๐ DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation โ 524M vision-document retriever distilled from an 8B teacher โ small enough to run locally in agent pipelines that index scanned docs, no relevance labels needed.
๐ SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information โ Benchmarks mobile-assistant LLMs on scattered personal data โ finds major gaps in retrieval and verification, a warning for any agent that touches user context.
๐ CLAIR-Fin: An Adversarial Multi-Agent Framework for Claim-Level Verification and Adaptive Debate in Cross-Modal Financial QA โ Adversarial multi-agent debate for claim-level verification in cross-modal financial QA โ a fact-checking pattern that generalizes beyond finance to any high-stakes agent output.
๐ Not All Tokens Are Equal: Inflation-Aware Routing for Agentic LLM Systems โ Inflation-aware routing treats tokens by value, not volume โ a cost-optimization approach for agentic systems that could cut spend without dropping quality.
๐ Agentao: A Governed Local-First Runtime for Tool-Using LLM Agents โ Governed local-first runtime for tool-using LLM agents โ policy controls over what tools an agent can call, aimed at self-hosted deployments that need auditability.
Today's papers converge on two operator levers: cost (token routing) and control (governed runtimes). Both are solvable with current research โ the gap is adoption, not capability.
๐ DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation โ 524M vision-document retriever distilled from an 8B teacher โ small enough to run locally in agent pipelines that index scanned docs, no relevance labels needed.
๐ SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information โ Benchmarks mobile-assistant LLMs on scattered personal data โ finds major gaps in retrieval and verification, a warning for any agent that touches user context.
๐ CLAIR-Fin: An Adversarial Multi-Agent Framework for Claim-Level Verification and Adaptive Debate in Cross-Modal Financial QA โ Adversarial multi-agent debate for claim-level verification in cross-modal financial QA โ a fact-checking pattern that generalizes beyond finance to any high-stakes agent output.
๐ Not All Tokens Are Equal: Inflation-Aware Routing for Agentic LLM Systems โ Inflation-aware routing treats tokens by value, not volume โ a cost-optimization approach for agentic systems that could cut spend without dropping quality.
๐ Agentao: A Governed Local-First Runtime for Tool-Using LLM Agents โ Governed local-first runtime for tool-using LLM agents โ policy controls over what tools an agent can call, aimed at self-hosted deployments that need auditability.
Today's papers converge on two operator levers: cost (token routing) and control (governed runtimes). Both are solvable with current research โ the gap is adoption, not capability.
huggingface.co
Paper page - DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation
Join the discussion on this paper page
โ๏ธ Ship โ 4 items
๐ฆ Hermes Agent 2026.8.16 โ Hermes Agent v0.20.3 rolls up ~125 PRs: MCP 2.x SDK migration with stateless protocol support, bundled Bot Mode plugin, and subprocess Python runtime isolation (PYTHONHOME/PYTHONPATH). Operators on MCP should test stateless mode; Python subprocess hardening changes runtime behavior.
๐ฆ OpenHands 1.14.0 โ OpenHands 1.14.0 adds LLM pre-flight validation to catch misconfigured profiles before saving, a Git Sync page for automations, and sets Canvas default to Kimi K3 (free). Operators configuring profiles get earlier error feedback.
๐ฆ OpenAI SDK 3.2.0 โ OpenAI Python SDK 3.2.0 adds Bedrock Runtime endpoint support and shell call streaming events. Operators bridging OpenAI SDK to Bedrock get a direct path; shell call streaming improves real-time tool output.
๐ฆ PR #124528 Gateway profile evidence โ OpenClaw ships gateway profile evidence (PR #124528) โ likely new audit/telemetry for gateway profiles; check release notes for what's now logged.
Protocol migrations and pre-flight validation dominate today โ test stateless MCP and profile validation before rolling out.
๐ฆ Hermes Agent 2026.8.16 โ Hermes Agent v0.20.3 rolls up ~125 PRs: MCP 2.x SDK migration with stateless protocol support, bundled Bot Mode plugin, and subprocess Python runtime isolation (PYTHONHOME/PYTHONPATH). Operators on MCP should test stateless mode; Python subprocess hardening changes runtime behavior.
๐ฆ OpenHands 1.14.0 โ OpenHands 1.14.0 adds LLM pre-flight validation to catch misconfigured profiles before saving, a Git Sync page for automations, and sets Canvas default to Kimi K3 (free). Operators configuring profiles get earlier error feedback.
๐ฆ OpenAI SDK 3.2.0 โ OpenAI Python SDK 3.2.0 adds Bedrock Runtime endpoint support and shell call streaming events. Operators bridging OpenAI SDK to Bedrock get a direct path; shell call streaming improves real-time tool output.
๐ฆ PR #124528 Gateway profile evidence โ OpenClaw ships gateway profile evidence (PR #124528) โ likely new audit/telemetry for gateway profiles; check release notes for what's now logged.
Protocol migrations and pre-flight validation dominate today โ test stateless MCP and profile validation before rolling out.
GitHub
Release Hermes Agent v0.20.3 (2026.8.16.2) ยท NousResearch/hermes-agent
Hermes Agent v0.20.3 (v2026.8.16.2)
Release Date: August 16, 2026
Patch release. This tag rolls up the ~125 PRs merged since v0.20.2 into a stable tagged release for downstream consumers (Docker i...
Release Date: August 16, 2026
Patch release. This tag rolls up the ~125 PRs merged since v0.20.2 into a stable tagged release for downstream consumers (Docker i...
๐ Read โ 5 items
๐ ClawGym II: Exploring Black-Box RL on Agent Harness โ Black-box RL framework for optimizing agents through complex harnesses โ stable, scalable optimization without white-box access, aimed at long-horizon task performance.
๐ Agentic Transaction: Towards ACID-Compliant Agent Systems โ ACID-style transactions for LLM agents โ semantic guarantees for reliable, isolated, durable execution, moving agent workflows toward database-grade consistency.
๐ VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End? โ Agentic RL framework for end-to-end 3D world construction โ agents infer intent, plan scenes, invoke tools, and reflect on feedback; benchmarks expose where multimodal agents still fail.
๐ Does a Language Server Save Tokens for Coding Agents? A Measurement Methodology and Preliminary Study โ Measurement study on whether language servers reduce token consumption for coding agents โ preliminary results for anyone optimizing context budgets.
๐ Inducing Reward-Free Judging Rubrics that Reduce Over-Crediting in Agent Evaluation โ Reward-free judging rubrics to reduce over-crediting in agent evaluation โ addresses LLM judges inflating scores, a known eval failure mode.
Agent evaluation and reliability are converging: black-box RL for harness tuning, ACID transactions for execution guarantees, and rubrics to stop over-crediting. The tooling is maturing past 'does it work' to 'can we trust it'.
๐ ClawGym II: Exploring Black-Box RL on Agent Harness โ Black-box RL framework for optimizing agents through complex harnesses โ stable, scalable optimization without white-box access, aimed at long-horizon task performance.
๐ Agentic Transaction: Towards ACID-Compliant Agent Systems โ ACID-style transactions for LLM agents โ semantic guarantees for reliable, isolated, durable execution, moving agent workflows toward database-grade consistency.
๐ VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End? โ Agentic RL framework for end-to-end 3D world construction โ agents infer intent, plan scenes, invoke tools, and reflect on feedback; benchmarks expose where multimodal agents still fail.
๐ Does a Language Server Save Tokens for Coding Agents? A Measurement Methodology and Preliminary Study โ Measurement study on whether language servers reduce token consumption for coding agents โ preliminary results for anyone optimizing context budgets.
๐ Inducing Reward-Free Judging Rubrics that Reduce Over-Crediting in Agent Evaluation โ Reward-free judging rubrics to reduce over-crediting in agent evaluation โ addresses LLM judges inflating scores, a known eval failure mode.
Agent evaluation and reliability are converging: black-box RL for harness tuning, ACID transactions for execution guarantees, and rubrics to stop over-crediting. The tooling is maturing past 'does it work' to 'can we trust it'.
huggingface.co
Paper page - ClawGym II: Exploring Black-Box RL on Agent Harness
Join the discussion on this paper page
๐ฌ Community โ 1 item
๐ฌ GPT-5.6 Sol Pricing Cut by 50% โ OpenRouter cuts GPT-5.6 Sol pricing 50%. 177-point HN thread of operators comparing it to Claude โ the throughline: capable model, far fewer thinking tokens. Real cost signal for agent workloads.
The cost floor for agent inference keeps dropping. A 50% cut on a capable, token-efficient model means operators should re-benchmark model choices quarterly, not annually.
๐ฌ GPT-5.6 Sol Pricing Cut by 50% โ OpenRouter cuts GPT-5.6 Sol pricing 50%. 177-point HN thread of operators comparing it to Claude โ the throughline: capable model, far fewer thinking tokens. Real cost signal for agent workloads.
The cost floor for agent inference keeps dropping. A 50% cut on a capable, token-efficient model means operators should re-benchmark model choices quarterly, not annually.
โ๏ธ Ship โ 2 items
๐ฆ Hermes Agent v2026.8.18 โ Hermes Agent v2026.8.18 โ stable tag rolling up ~74 PRs: desktop glass/translucency surface, tabbed SESSIONS|BOTS sidebar, Bot Mode group-chat fixes, NVIDIA SkillEvaluator Tier 1 advisory scanning on skill installs, cron media-send hardening.
๐ฆ Qwen3.8-27B-Uncensored-GGUF trending on Hugging Face โ Qwen3.8-27B-Uncensored-GGUF is trending on HF โ 357k downloads, 307 likes. A 27B uncensored Qwen variant in GGUF; local agent builders are pulling it.
Hermes is consolidating a big merge window into a stable tag; operators on downstream Docker/hosted deployments should pull this before the next feature wave.
๐ฆ Hermes Agent v2026.8.18 โ Hermes Agent v2026.8.18 โ stable tag rolling up ~74 PRs: desktop glass/translucency surface, tabbed SESSIONS|BOTS sidebar, Bot Mode group-chat fixes, NVIDIA SkillEvaluator Tier 1 advisory scanning on skill installs, cron media-send hardening.
๐ฆ Qwen3.8-27B-Uncensored-GGUF trending on Hugging Face โ Qwen3.8-27B-Uncensored-GGUF is trending on HF โ 357k downloads, 307 likes. A 27B uncensored Qwen variant in GGUF; local agent builders are pulling it.
Hermes is consolidating a big merge window into a stable tag; operators on downstream Docker/hosted deployments should pull this before the next feature wave.
GitHub
Release Hermes Agent v0.20.4 (2026.8.18) ยท NousResearch/hermes-agent
Hermes Agent v0.20.4 (v2026.8.18)
Release Date: August 18, 2026
Patch release. This tag rolls up the ~74 PRs merged since v0.20.3 into a stable tagged release for downstream consumers (Docker imag...
Release Date: August 18, 2026
Patch release. This tag rolls up the ~74 PRs merged since v0.20.3 into a stable tagged release for downstream consumers (Docker imag...
๐ฌ Community โ 4 items
๐ฌ HarnessEval-W โ A paper proposing a pipeline that uses hierarchical sub-agents to verify reasoning chains in visual world evaluations.
๐ฌ R^3-Bench โ A benchmark claiming LLMs underperform when managing a shared computation budget across multiple problems.
๐ฌ UI-Mate โ An open-weight GUI agent using environment-grounded training and in-context demonstrations to increase reliability.
๐ฌ 1667 โ A terminal UI for LLM-assisted fiction writing (35 points on HN).
๐ฌ HarnessEval-W โ A paper proposing a pipeline that uses hierarchical sub-agents to verify reasoning chains in visual world evaluations.
๐ฌ R^3-Bench โ A benchmark claiming LLMs underperform when managing a shared computation budget across multiple problems.
๐ฌ UI-Mate โ An open-weight GUI agent using environment-grounded training and in-context demonstrations to increase reliability.
๐ฌ 1667 โ A terminal UI for LLM-assisted fiction writing (35 points on HN).
huggingface.co
Paper page - HarnessEval-W: Agentifying the Evaluation of Visual Worlds
Join the discussion on this paper page
๐ Read โ 5 items
๐ How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks โ 100 real-world frontier research tasks; agents fail pervasively on metacognitive self-correction and motivation, not raw capability โ the gap to close before trusting autonomous research loops.
๐ Ventor-QTest: Threat-Model-Driven Verification of Vendor-Hosted LLM APIs โ Black-box probes of hosted open-weight APIs measure fidelity drift under repeated and long-sequence use โ useful for anyone pinning model behavior in production.
๐ Amp adds realtime voice chat with Puck โ Amp adds realtime voice chat with Puck โ gpt-realtime-2.1 summarizes agent responses aloud while full text lands in thread. Hands-off supervision without staring at the terminal.
๐ Cross-Disciplinary Taxonomy and Modeling of Misunderstanding Generation, Amplification, and Detection, from Pragmatics to AI Agents โ Taxonomy of how misunderstandings arise, amplify, and get detected in agent interactions โ useful framing for debugging multi-turn agent failures.
๐ GitHub Copilot weekly releases โ August 10 โ Copilot weekly changelog covers VS Code 1.133, JetBrains, CLI โ scan for agent-mode changes if you run Copilot in CI.
Research day: the failure modes are metacognitive, not capability. Operators should instrument self-correction, not just benchmark task completion.
๐ How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks โ 100 real-world frontier research tasks; agents fail pervasively on metacognitive self-correction and motivation, not raw capability โ the gap to close before trusting autonomous research loops.
๐ Ventor-QTest: Threat-Model-Driven Verification of Vendor-Hosted LLM APIs โ Black-box probes of hosted open-weight APIs measure fidelity drift under repeated and long-sequence use โ useful for anyone pinning model behavior in production.
๐ Amp adds realtime voice chat with Puck โ Amp adds realtime voice chat with Puck โ gpt-realtime-2.1 summarizes agent responses aloud while full text lands in thread. Hands-off supervision without staring at the terminal.
๐ Cross-Disciplinary Taxonomy and Modeling of Misunderstanding Generation, Amplification, and Detection, from Pragmatics to AI Agents โ Taxonomy of how misunderstandings arise, amplify, and get detected in agent interactions โ useful framing for debugging multi-turn agent failures.
๐ GitHub Copilot weekly releases โ August 10 โ Copilot weekly changelog covers VS Code 1.133, JetBrains, CLI โ scan for agent-mode changes if you run Copilot in CI.
Research day: the failure modes are metacognitive, not capability. Operators should instrument self-correction, not just benchmark task completion.
huggingface.co
Paper page - How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks
Join the discussion on this paper page
โ๏ธ Ship โ 3 items
๐ฆ Codex 0.148.0 โ Hooks go async and can call MCP tools; `/export` saves TUI sessions to Markdown, `/status` shows thread cost, and Amazon Bedrock Runtime joins as a built-in provider.
๐ฆ Claude platform release notes โ August 18, 2026 โ Workbench is now Playground in the Claude Console โ supports every Messages API parameter, shows the full SDK request and API response per run, and includes templates for code execution and web search.
๐ฆ OpenAI SDK 3.3.0 โ OpenAI Python SDK 3.3.0 adds named data-residency endpoints, letting orgs pin API traffic to specific regions for compliance.
Between Codex's async hooks and OpenAI's data-residency endpoints, operators get more control over how agent traffic runs and where it lands. Worth testing before your next pipeline refactor.
๐ฆ Codex 0.148.0 โ Hooks go async and can call MCP tools; `/export` saves TUI sessions to Markdown, `/status` shows thread cost, and Amazon Bedrock Runtime joins as a built-in provider.
๐ฆ Claude platform release notes โ August 18, 2026 โ Workbench is now Playground in the Claude Console โ supports every Messages API parameter, shows the full SDK request and API response per run, and includes templates for code execution and web search.
๐ฆ OpenAI SDK 3.3.0 โ OpenAI Python SDK 3.3.0 adds named data-residency endpoints, letting orgs pin API traffic to specific regions for compliance.
Between Codex's async hooks and OpenAI's data-residency endpoints, operators get more control over how agent traffic runs and where it lands. Worth testing before your next pipeline refactor.
GitHub
Release 0.148.0 ยท openai/codex
New Features
Export complete TUI conversations to Markdown with /export, either to the clipboard or a new file. (#37358)
Fork sessions with codex exec fork, and archive or restore sessions from th...
Export complete TUI conversations to Markdown with /export, either to the clipboard or a new file. (#37358)
Fork sessions with codex exec fork, and archive or restore sessions from th...
๐ Read โ 4 items
๐ Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirements โ Agentic ESOpt fine-tunes long-horizon LLM agents with evolution strategies and trajectory-level rewards โ full-parameter tuning without the GPU bill. Worth a look if you're training agents on limited hardware.
๐ From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents โ RUPA models agent trajectories as relational graphs to propagate uncertainty across long runs โ better failure detection and confidence calibration for multi-step agents.
๐ ASI-Bench: At the Dawn of Artificial Superintelligence โ ASI-Bench evaluates agents on scientific exploration and innovation tasks โ a benchmark for measuring how far current agents are from autonomous research.
๐ AutoMem: A Text-Gradient Recursive Self-Improvement Framework for Automated Memory Architectures Search โ AutoMem uses text-gradient recursive self-improvement to automatically search memory architectures for agents โ memory design as an optimization problem rather than hand-tuning.
Today's Read lane is about making agents more reliable and cheaper to train: uncertainty propagation, automated memory search, and low-GPU fine-tuning all point the same direction.
๐ Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirements โ Agentic ESOpt fine-tunes long-horizon LLM agents with evolution strategies and trajectory-level rewards โ full-parameter tuning without the GPU bill. Worth a look if you're training agents on limited hardware.
๐ From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents โ RUPA models agent trajectories as relational graphs to propagate uncertainty across long runs โ better failure detection and confidence calibration for multi-step agents.
๐ ASI-Bench: At the Dawn of Artificial Superintelligence โ ASI-Bench evaluates agents on scientific exploration and innovation tasks โ a benchmark for measuring how far current agents are from autonomous research.
๐ AutoMem: A Text-Gradient Recursive Self-Improvement Framework for Automated Memory Architectures Search โ AutoMem uses text-gradient recursive self-improvement to automatically search memory architectures for agents โ memory design as an optimization problem rather than hand-tuning.
Today's Read lane is about making agents more reliable and cheaper to train: uncertainty propagation, automated memory search, and low-GPU fine-tuning all point the same direction.
huggingface.co
Paper page - Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirements
Join the discussion on this paper page
๐ฌ Community โ 1 item
๐ฌ Devin cuts GPT-5.6 Sol pricing 70% โ Devin drops GPT-5.6 Sol pricing 70% โ worth checking if your Devin workloads are on that model; HN thread is light on comments so far.
Pricing pressure on coding agents is real; when a major harness cuts a model's cost 70%, it's worth re-evaluating your own per-task economics.
๐ฌ Devin cuts GPT-5.6 Sol pricing 70% โ Devin drops GPT-5.6 Sol pricing 70% โ worth checking if your Devin workloads are on that model; HN thread is light on comments so far.
Pricing pressure on coding agents is real; when a major harness cuts a model's cost 70%, it's worth re-evaluating your own per-task economics.
โ๏ธ Ship โ 2 items
๐ฆ OpenAI Agents SDK 0.22.0 โ OpenAI Agents SDK 0.22.0 โ guardrail-rejected tool output is now redacted from replay/persisted state, and non-streaming Responses with terminal `failed`/`incomplete` raise `ModelBehaviorError`. Breaking: if you pass an explicit `openai_client` with `organization`/`project`, move those to the `AsyncOpenAI` client.
๐ฆ Anthropic SDK 0.118.0 โ Anthropic SDK 0.118.0 โ adds files/memory store API surface and workspace-ID helpers; session-runner retries tool-result sends for the lease TTL, and docs now warn that blocking tool bodies stall the worker heartbeat.
Runtime-hardening day: both SDKs tighten state handling and provider contracts โ worth a quick migration check if you pass explicit clients or rely on replayable traces.
๐ฆ OpenAI Agents SDK 0.22.0 โ OpenAI Agents SDK 0.22.0 โ guardrail-rejected tool output is now redacted from replay/persisted state, and non-streaming Responses with terminal `failed`/`incomplete` raise `ModelBehaviorError`. Breaking: if you pass an explicit `openai_client` with `organization`/`project`, move those to the `AsyncOpenAI` client.
๐ฆ Anthropic SDK 0.118.0 โ Anthropic SDK 0.118.0 โ adds files/memory store API surface and workspace-ID helpers; session-runner retries tool-result sends for the lease TTL, and docs now warn that blocking tool bodies stall the worker heartbeat.
Runtime-hardening day: both SDKs tighten state handling and provider contracts โ worth a quick migration check if you pass explicit clients or rely on replayable traces.
GitHub
Release v0.22.0 ยท openai/openai-agents-python
Key Changes
Version 0.22.0 is a minor release because it adds substantial runtime hardening and tightens an existing provider configuration contract. Applications that combine an explicit openai_cl...
Version 0.22.0 is a minor release because it adds substantial runtime hardening and tightens an existing provider configuration contract. Applications that combine an explicit openai_cl...
๐ฌ Community โ 3 items
๐ฌ LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents โ Open-source framework for harness-native RL on coding agents โ in-process LLM proxying and sandbox orchestration let you policy-gradient-train the agent inside its actual harness, not a stripped-down eval loop.
๐ฌ Agent Lightning v1.0: Towards Harnessed Agentic RL โ Reproducible RL for arbitrary agent harnesses โ trains the full agent stack (harness + LLM) and reports substantial coding-agent gains. Worth a look if you've been RL-tuning models in isolation.
๐ฌ StartupBench: Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows โ Benchmarks general-purpose agents on market-validated startup workflows end-to-end; even top models finish only ~30% of tasks. A reality check on how far agents are from replacing a junior operator.
The RL-for-agents field is converging on harness-native training. If you're building coding agents, the question is no longer whether to RL-tune, but which harness integration you'll adopt.
๐ฌ LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents โ Open-source framework for harness-native RL on coding agents โ in-process LLM proxying and sandbox orchestration let you policy-gradient-train the agent inside its actual harness, not a stripped-down eval loop.
๐ฌ Agent Lightning v1.0: Towards Harnessed Agentic RL โ Reproducible RL for arbitrary agent harnesses โ trains the full agent stack (harness + LLM) and reports substantial coding-agent gains. Worth a look if you've been RL-tuning models in isolation.
๐ฌ StartupBench: Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows โ Benchmarks general-purpose agents on market-validated startup workflows end-to-end; even top models finish only ~30% of tasks. A reality check on how far agents are from replacing a junior operator.
The RL-for-agents field is converging on harness-native training. If you're building coding agents, the question is no longer whether to RL-tune, but which harness integration you'll adopt.
huggingface.co
Paper page - LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents
Join the discussion on this paper page
๐ Read โ 4 items
๐ HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety โ Benchmarks agent harness safety across six operational phases โ configuration vulnerabilities and detection gaps are the weak points, not model behavior.
๐ MCP in Orbs โ Amp adds remote MCP server support across orbs, the TUI, and Puck โ Streamable HTTP with OAuth. Connect hosted servers from ampcode.com/settings/mcp-servers.
๐ Replit expands access to software creation with GPT-5.6 Luna โ Replit adds GPT-5.6 Luna as a model option for software creation โ a new capability for Replit Agent users.
๐ Cross-Model Memory Transfer via Target-Side Reader Adaptation โ Cross-model memory transfer via target-side reader adaptation โ lets a model inherit memory from another without retraining, relevant for agent memory portability.
Harness safety and MCP plumbing are the day's themes โ operators should audit config surfaces and expect MCP support as default.
๐ HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety โ Benchmarks agent harness safety across six operational phases โ configuration vulnerabilities and detection gaps are the weak points, not model behavior.
๐ MCP in Orbs โ Amp adds remote MCP server support across orbs, the TUI, and Puck โ Streamable HTTP with OAuth. Connect hosted servers from ampcode.com/settings/mcp-servers.
๐ Replit expands access to software creation with GPT-5.6 Luna โ Replit adds GPT-5.6 Luna as a model option for software creation โ a new capability for Replit Agent users.
๐ Cross-Model Memory Transfer via Target-Side Reader Adaptation โ Cross-model memory transfer via target-side reader adaptation โ lets a model inherit memory from another without retraining, relevant for agent memory portability.
Harness safety and MCP plumbing are the day's themes โ operators should audit config surfaces and expect MCP support as default.
huggingface.co
Paper page - HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety
Join the discussion on this paper page