ClawBytes
15 subscribers
1K links
Download Telegram
πŸ“š Read β€” 6 items

πŸ“š ClawProBench: Trace-Aware Evaluation of AI Agents with Runtime Coverage and Frozen Workplace-Style Holdouts β€” Trace-aware eval across live and frozen tracks shows final-answer rankings obscure runtime coverage gaps β€” worth adopting if you benchmark harness configs.

πŸ“š Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses β€” Recursive memory architecture tracks progress and guides skill selection, improving long-horizon agent success rates β€” a concrete pattern for memory in agent harnesses.

πŸ“š There Is No Neutral Harness: Modern LLM Leaderboards Are Manufactured by Config-Fragile Items β€” Argues leaderboard rankings are manufactured by config-fragile items β€” small harness config changes flip results. A caution for anyone trusting eval leaderboards.

πŸ“š A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications β€” Survey of multimodal agentic frameworks β€” techniques and applications, a useful map for agents handling images, video, and audio.

πŸ“š Plan-and-Execute Agents β€” LangChain's plan-and-execute pattern separates planning from execution to improve reliability on multi-step tasks β€” worth comparing against ReAct loops.

πŸ“š LangSmith Engine Improves Agent Issue Detection by 2x β€” LangSmith Engine claims 2x better agent issue detection via improved trace analysis β€” worth checking if you're already on LangSmith for eval.

Eval is the theme today β€” trace-aware benchmarks and config-fragility critiques both point to the same conclusion: trust your own traces, not leaderboards.
βš™οΈ Ship β€” 2 items

πŸ“¦ Claude Python SDK v1.0 β€” Python SDK v1.0 ships β€” HTTP layer moves from httpx to httpx2 (call `httpx2.alias_httpx()` if you patch httpx for tracing/mocking). Requires Python 3.10+, drops legacy Text Completions and `temperature`/`top_p`/`top_k`; async `.with_raw_response` now needs `await response.parse()`.

πŸ“¦ Antigravity Google β€” Embedded Terminals, Git Version Control, and Audio Attachments β€” Antigravity adds embedded terminals, git version control, and audio attachments β€” terminal and git in-IDE move it toward full agentic coding parity.

SDK maturity day β€” Anthropic's Python SDK hits 1.0 with breaking changes, and Antigravity closes the terminal/git gap. Both are upgrade-and-retest items, not read-and-forget.
πŸ’¬ Community β€” 6 items

πŸ’¬ WebMCP: Teaching Your Website to Talk to AI Agents β€” HN debate on WebMCP β€” exposing website actions to agents via MCP. Top comment calls the approach 'inverted and impractical'; 50 comments arguing whether sites should serve agent APIs.

πŸ’¬ CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild β€” CyberFactory turns real-world vulnerabilities into agentic training data for Aegis β€” an open-weight security agent that gets better at triage from wild instances.

πŸ’¬ AgentRoom: Concurrent Multi-Agent Coding in a CRDT-Backed Shared Workspace β€” AgentRoom gives multiple coding agents a shared CRDT workspace β€” real-time collaborative editing and filesystem coordination, cutting task conflicts.

πŸ’¬ Automata from Agent Traces: Failure and Next-Step Prediction β€” Compresses LLM agent traces into finite-state machines for next-step and failure prediction β€” a safety-auditing tool for agent behavior.

πŸ’¬ Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights β€” Z.ai confirms Ox Alpha is GLM-series and will release weights β€” HN reports it crushing coding tasks via OpenRouter/OpenCode Zen.

πŸ’¬ Claude Code update hardcodes AgentTool guardrails β€” Claude Code update hardcodes guardrails: 'Do not call AgentTool unless the user requested it' and workflow restrictions β€” check if this breaks your sub-agent patterns.

Open-weight coding models are closing the gap (Ox Alpha weights coming), while Claude Code is tightening sub-agent autonomy β€” operators should re-test both their model choices and their sub-agent patterns.
πŸ“š Read β€” 5 items

πŸ“š SecOPD: Mitigating Adaptive Prompt Injections by On-Policy Distillation β€” On-policy distillation with token-level feedback sharply reduces adaptive prompt injection success β€” a concrete defense for agents exposed to untrusted content.

πŸ“š AI Agents Push Humans Out of the Loop β€” Mitchell, Ghosh, and Passi map how agent deployments displace human oversight β€” a must-read for anyone designing review or approval loops.

πŸ“š Show HN: Proliferate- open-source, self-hostable Codex for any coding agent β€” Open-source, self-hostable Codex for any coding agent β€” YC S25 founder's Show HN. Worth a look if you want Codex-style orchestration without vendor lock-in.

πŸ“š LLM Agents Perform Controlled Experiments Using Simulation Models β€” Agents run controlled experiments against simulation models, moving from code generation to hypothesis validation β€” relevant to scientific and engineering agent workflows.

πŸ“š ADE: Agentic Data Evolution Framework for Human-Centered Objectives β€” Agentic data evolution framework that optimizes datasets against human-centered objectives β€” a different angle on data curation for agent training.

Today's read splits between hardening agents against injection and questioning how much human oversight we're actually keeping β€” both worth acting on before the next deployment.
βš™οΈ Ship β€” 2 items

πŸ“¦ Codex 0.150.0 β€” Agents can now reference other Codex tasks with @ mentions and read, create, or message them from the terminal. New Interrupt hooks run commands or MCP handlers when a top-level turn is interrupted. Also: untrusted projects no longer supply project-level AGENTS.md instructions.

πŸ“¦ Claude platform release notes β€” August 26, 2026 β€” Compliance API session endpoints are out of beta for Cowork and Claude Code sessions, so orgs can retrieve session transcripts via API. Admin API is now available in the ant CLI and Python, TypeScript, C#, Go, Java, PHP, and Ruby SDKs under client.beta.organization.

Task orchestration and compliance both got more serious today: Codex tasks are now addressable from the terminal, and Claude Code session transcripts are GA via the Compliance API.
πŸ“š Read β€” 7 items

πŸ“š Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments β€” AnTrap injects dynamic anomalies into Android GUI agent execution trajectories and finds universal vulnerabilities β€” robustness evals are moving from static benchmarks to adversarial runtime conditions.

πŸ“š MARS: Multi-Specialist LLM Relay System for Competitive Programming β€” MARS chains retrieval-augmented specialist agents per algorithmic topic to generate, test, and refine C++ solutions β€” a concrete multi-agent relay pattern for competitive programming.

πŸ“š How loveholidays is making everyone a builder with Codex β€” OpenAI case study: loveholidays rolls out Codex to non-engineers, turning 'everyone into a builder' β€” operational detail on deploying coding agents across a travel company.

πŸ“š GitHub Copilot app Customize tab is generally available β€” GitHub Copilot app Customize tab is GA β€” teams can bring their own tools into Copilot and manage customization types centrally, moving beyond default integrations.

πŸ“š SchemaRouter: Field-Aware Tool Routing for Efficient Heterogeneous Agentic RAG β€” SchemaRouter routes agentic RAG queries to tools based on schema fields, cutting overhead in heterogeneous tool environments β€” field-aware routing beats flat tool selection.

πŸ“š RENDER: Controlling Reader-Facing Evidence in LLM Memory Evaluation β€” RENDER controls reader-facing evidence in LLM memory evaluation, separating what a model actually retrieves from what's already in context β€” useful for auditing agent memory claims.

πŸ“š August 2026: LangChain Newsletter β€” Managed Deep Agents, LLM Gateway, and More β€” LangChain's August newsletter maps the current surface: managed deep agents, LLM gateway, and agent improvement engine β€” a quick read on where the framework is investing.

Robustness and routing dominate today's Read: adversarial GUI evals, field-aware tool routing, and memory-evidence control all point to operators needing to test agents under conditions they weren't trained for.
πŸ’¬ Community β€” 1 item

πŸ’¬ Serve Markdown to AI Agents with Accept Headers β€” HN debate (102 pts, 60 comments) on serving markdown to agents via Accept headers β€” content negotiation vs dedicated agent endpoints. Fielding's REST trade-off argument resurfaces; a real design question for anyone exposing APIs to agents.

The agent-facing web is being designed in public, and content negotiation is the first real standards fight. If you serve content agents consume, the Accept-header question is coming for your API.
βš™οΈ Ship β€” 2 items

πŸ“¦ Antigravity Google β€” Generative UI and UI improvements β€” Antigravity adds generative UI and UI improvements β€” the changelog entry is thin, but the move toward agent-generated interfaces is worth tracking for Antigravity operators.

πŸ“¦ Claude platform release notes β€” August 26, 2026 β€” Compliance API session endpoints out of beta for Cowork and Claude Code; local transcripts now cover Claude Science and M365 agents. Admin API lands in ant CLI and SDKs.

Compliance and admin tooling is maturing β€” operators can now pull session transcripts and manage orgs programmatically across SDKs.
🚨 Watch β€” 1 item

🚨 Salem Robotics β€” Software for industrial inspection robots; 20 points on HN.
πŸ’¬ Community β€” 1 item

πŸ’¬ Russian-speaking hackers used Cursor to help breach a Belgian chemical company β€” Bluesky thread: Russian-speaking hackers reportedly used Cursor to help break into a Belgian chemical company. If confirmed, first notable case of an AI coding assistant directly aiding an intrusion.

If AI coding assistants become a standard tool in intrusion workflows, the security conversation shifts from 'can agents be jailbroken' to 'how do we detect agent-assisted attacks'.
πŸ“š Read β€” 5 items

πŸ“š JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution β€” JIT-Agent trains a model to synthesize adaptive agent harnesses for off-the-shelf LLMs β€” harness intelligence as a learned layer instead of hand-built scaffolding.

πŸ“š When "Must" Becomes "Maybe": Constraint Weakening in LLM Agent Workflows β€” Multi-stage LLM workflows lose operational constraints when intermediate artifacts turn binding prerequisites into non-binding context β€” a failure mode most evals miss.

πŸ“š Nexus: Depth-Adaptive KV-Cache Splicing and Retrieval-Decoupled Tool Routing for Agentic LLMs on Unified Memory β€” Nexus proposes depth-adaptive KV-cache splicing and retrieval-decoupled tool routing for agentic LLMs on unified memory β€” targets the memory and tool-call bottleneck in long-horizon agents.

πŸ“š LangSmith Engine: How We Built an Agent for Improving Agents β€” LangChain details LangSmith Engine, their agent-for-improving-agents β€” an autonomous evaluation and improvement loop. Useful pattern for anyone building self-improving agent pipelines.

πŸ“š The Future of SaaS Is Apps That Agents Can Use β€” Lovable CTO on shifting from app-building to MCP-powered 'capabilities' β€” the SaaS surface agents actually consume. Signals where agent-native tooling is heading.

Today's Read lane clusters around making agents more reliable: learned harnesses, constraint preservation, memory/tool routing, and self-improving loops. The common thread is that hand-built scaffolding is the bottleneck.
πŸ’¬ Community β€” 3 items

πŸ’¬ fasterthanli: if your agent harness calls itself an "operating system," it better boot from UEFI β€” fasterthanli draws the line on "agent OS" branding: a harness that calls itself an operating system should boot from UEFI. The naming inflation in agent tooling is getting called out β€” 99 likes and climbing.

πŸ’¬ The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents β€” What happens when a coding agent switches models mid-trajectory: measurable degradation β€” the "handoff tax." Continuing a trajectory with a different model than the one that started it costs performance. Relevant for anyone mixing models in agent workflows.

πŸ’¬ SWE Refactor Bench: Can Coding Agents Complete a Long-Horizon, Whole-Repository Stack Migration? β€” New benchmark for whole-repository stack migrations β€” the long-horizon work beyond single-task SWE-bench. Current models rarely complete them. The gap between demo tasks and real refactors is still wide.

Naming inflation on one side, capability gaps on the other β€” today's community signal is measuring the distance between agent marketing and what models can actually finish.
βš™οΈ Ship β€” 2 items

πŸ“¦ Claude platform release notes β€” August 27, 2026 β€” Claude SDKs unify beta files/skills APIs (no more beta headers; `beta.skills.delete()` removes all versions) and add personal/service account keys in Console.

πŸ“¦ Antigravity Google β€” Embedded Terminals, Git Version Control, and Audio Attachments β€” Antigravity adds embedded terminals, git version control, and audio attachments β€” tighter loop for agentic coding.

SDK consolidation day β€” Claude unifies beta APIs and adds new key types, while Antigravity tightens the agentic coding loop. Worth checking your beta header usage before the next deploy.
πŸ“š Read β€” 5 items

πŸ“š Breaking Claude Code Opus 5 Auto Mode β€” Simon Willison stress-tests Claude Code Opus 5's auto mode β€” Anthropic's primary prompt-injection defense for coding agents β€” and documents where it holds and where it breaks.

πŸ“š SDAD: Spec-Driven Agentic Development for the AI-Native SDLC β€” Spec-driven agentic development for the AI-native SDLC β€” agents build from formal specs rather than ad-hoc prompts, with implications for reproducibility and review.

πŸ“š FrontierChallenge: Evaluating Scientific Workflow Completion β€” New benchmark for agents completing multi-step scientific workflows β€” evaluates end-to-end task completion rather than isolated subtask accuracy.

πŸ“š UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City β€” Benchmarks whether multimodal LLM agents can sustain reliable navigation and spatial reasoning across a real-scale 3D city β€” from local perception to spatial agency.

πŸ“š SIMGUIDE: Procedurally Grounded Multi-Context Representations for Personalized Agent Planning β€” Introduces procedurally grounded multi-context representations for personalized agent planning β€” plans are anchored in procedural context, not just user profiles.

Prompt injection remains the sharpest edge for coding agents β€” today's strongest signal is a hands-on break of the latest defense, while the research side keeps pushing benchmarks and spec-driven workflows.
βš™οΈ Ship β€” 3 items

πŸ“¦ Claude platform release notes β€” August 27, 2026 β€” Python/TS/Go/Java/Ruby/C# SDKs drop beta headers for files/skills β€” `client.beta.skills.delete()` now deletes a Skill with all versions, `BetaSkill` renamed `BetaContainerSkill`. Console adds personal and service account keys.

πŸ“¦ Anthropic Expanding support for scientists β€” Anthropic launches Claude Science, a product integrating research tools with auditable artifacts, plus new programs for scientists.

πŸ“¦ Hermes Agent 0.20.6 β€” Hermes 0.20.6 rolls up ~525 PRs: consent-gated real-profile browsing, desktop Browser with SSH remote-update and fleet profiles, 50+ verified remote MCP servers (Cloudflare, Grafana, Railway), TTL caching for web tools.

SDK migration day: Claude beta files/skills APIs graduate to stable shapes, and Hermes rolls up a month of agent-runtime work. Operators on beta APIs should migrate before the next SDK bump.
πŸ’¬ Community β€” 3 items

πŸ’¬ Cursor used in Russian-speaking hacking campaign against Belgian chemical company and six other firms β€” Brad Heath reports Russian-speaking hackers used Cursor to help breach a Belgian chemical company and at least six other firms earlier this year. Coding assistants as attack tools is now a documented pattern.

πŸ’¬ Terminal-Bench-Science: Evaluating AI agents on scientific research workflows β€” New benchmark for agents doing real scientific research workflows; HN is stress-testing whether the tasks in harbor-framework/terminal-bench-science are actually hard.

πŸ’¬ Show HN: We built open OpenRouter that turns usage into a better model β€” Open-source Rust model gateway that routes across self-hosted, frontier, and open models β€” and uses usage data to improve the model. 203 points on HN.

The community is converging on two questions: can agents do real scientific work, and what happens when coding assistants become attack tools. Both answers are getting sharper.
πŸ“š Read β€” 5 items

πŸ“š Training Agents to Evolve with Their Harness: TaoLive Digital Avatar Agent Technical Report β€” Harness-Aware Training lets compact models adapt to evolving digital-avatar harness configs without retraining β€” low latency, high accuracy for production avatar agents.

πŸ“š TTPO: Test-Time Policy Optimization β€” Test-Time Policy Optimization enables label-free test-time training for mathematical reasoning by asymmetrically distilling agreeing rollouts β€” stays robust even when majority-vote labels are noisy.

πŸ“š AI Agent Latency 101: How do I speed up my AI agent? β€” LangChain's practical guide to cutting agent latency β€” walks through the levers that actually move the needle: model choice, streaming, and parallel tool execution.

πŸ“š Wiki Memory: File-Based Memory for AI Agents | LangChain β€” LangChain introduces Wiki Memory β€” file-based persistent memory for agents, giving them structured, editable knowledge across sessions instead of just vector search.

πŸ“š How Candidly Built State-Aware Agent Harnesses in LangSmith β€” Case study: how Candidly built state-aware agent harnesses in LangSmith β€” the state architecture that keeps long-running agents coherent across turns.

Memory and latency are the two levers operators are fighting over this week β€” LangChain's new file-based memory and its latency guide both point to the same conclusion: state management is the bottleneck.
πŸ’¬ Community β€” 3 items

πŸ’¬ Thinking on Shots β€” A paper proposing an agentic framework for consistent multi-instruction editing across long multi-shot videos.

πŸ’¬ CaSKG β€” A paper on using counterfactual-causal graphs to improve how LLM agents retrieve executable skills from libraries.

πŸ’¬ Task-CoEvolve β€” A paper proposing adaptive validation task selection to optimize LLM harness performance estimation.
βš™οΈ Ship β€” 4 items

πŸ“¦ Anthropic Model Hardware Standard research preview β€” Anthropic opens a research preview of the Model Hardware Standard β€” a shared spec for AI agents to safely operate physical lab and manufacturing devices. First cohort: scientific research labs and advanced manufacturers.

πŸ“¦ Devin CLI v3000.6.7 β€” MCP registry fetches now use the platform cert store and configured proxy settings β€” custom registries load correctly behind corporate proxies or TLS inspection, and registry-allowed servers are no longer wrongly blocked. Also cuts terminal rendering CPU for long text, code blocks, and tables.

πŸ“¦ Anthropic SDK 1.2.0 β€” Files/skills namespaces move to GA shapes (dated beta header pins dropped); the agent toolset and memory tool now preserve exact file bytes with no newline translation. Bedrock binary uploads fixed.

πŸ“¦ OpenClaw release-publish/6ddb9f049fb3 β€” New OpenClaw release. Scan the changelog for operator-facing runtime changes.

The day's signal: agents reaching past software into physical devices (MHS), while the plumbing underneath gets more production-grade β€” GA files/skills namespaces, proxy-aware MCP registry fetches.
πŸ“š Read β€” 2 items

πŸ“š Copilot code review: Resolution reasons and expanded capabilities β€” Copilot code review adds comment resolution reasons and expanded capabilities β€” reviewers can now record why a thread was resolved, making review outcomes auditable.

πŸ“š CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering β€” CIFQA: deterministic tool-grounded multi-agent framework for financial QA β€” claims deterministic outputs by grounding each agent in tools; relevant if nondeterminism is a liability in your multi-agent stack.

Deterministic tool-grounding is the throughline: CIFQA applies it to financial QA, and Copilot's resolution reasons make review outcomes auditable β€” both push toward less guesswork in agent outputs.
βš™οΈ Ship β€” 2 items

πŸ“¦ Codex 0.151.0 β€” Codex 0.151.0 β€” extensions can now inspect or replace MCP tool results before they reach the model, nested subagent token usage counts toward root goal budgets, and `/cd` no longer weakens sandbox restrictions.

πŸ“¦ OpenHands 1.16.0 β€” OpenHands 1.16.0 β€” skills move from an all-on catalog to an explicit allow-list, LLM provider selection lands in settings, and the Canvas Extensions frontend ships. Self-hosted backends get the VSCode button fix.

Sandbox and MCP control are today's theme: Codex hardens both, OpenHands moves skills to an explicit allow-list. Operators get more control over what agents can touch.