Agents Learn to Decide
A near-frontier open-weight model lands alongside a new class of cheap decision classifiers, while computer-use agents are asked to prove they can do it twice.

- Open Weights Rise: Thinking Machines' Inkling 2 Small reportedly scored 81.7% on ARC-AGI-2 at $0.27/task, topping ARC Prize's open-weight evals.
- Cheap Decisions: Decision models like Drex Max claim 183ms answers versus Opus 5.5's 3.5s, reshaping routing economics for builders.
- Prove It Twice: Holo4 adds a third action lane, but IBM, Microsoft and authorization-drift work push repeatability and boundaries.
// From the blog
• Catch up on ICANN87: discussions from Bali — Explore the discussions from ICANN87 in Bali with Agent Community's session library, including summaries, transcripts, presentations and original source links.
X Recap
Thinking Machines' Inkling 2 Small scored 81.7% on ARC-AGI-2 at $0.27/task, besting every open-weight model ARC Prize has evaluated.
The agentic web gained a near-frontier open-weight model and a new class of cheap decision classifiers in the same week. Thinking Machines' Inkling 2 Small tops the open-weight ARC leaderboard, while decision models like Drex Max answer in 183ms against Opus 5.5's 3.5s at a fraction of the cost. For builders, the signal is that frontier-grade routing, memory consolidation, and self-editing harnesses are now self-hostable primitives.
Inkling 2 Small Crowns the Open-Weight ARC Leaderboard — and Treats Weights as a Safety-Gated Event
Thinking Machines' Inkling 2 Small has become the best open-weight model on ARC-AGI, scoring 81.7% on ARC-AGI-2 at $0.27/task and 96.5% on ARC-AGI-1 at $0.08/task, outperforming every open-weight model ARC Prize has evaluated @arcprize. The jump is stark — compared with the original Inkling Small from July 30, the model more than doubled its ARC-AGI-2 semi-private score from 40.14% to 81.67% @arcprize. It scores 31 on the Artificial Analysis Intelligence Index (up from 13), and ranks 3rd on Surge AI's EnterpriseBench-CoreCraft at 71.8%, behind only Claude Fable 5.1 and Claude Opus 5.5 @MTSlive. Soumith Chintala reports the architecture is a 594B total / 17B active Mixture-of-Experts, pre-trained in 68 hours on GB300s, with 17 million rollouts over 9 days of post-training, all in NVFP4 @soumithchintala.
Community reaction splits between enthusiasm and a sharper read on sequencing. Nathan Lambert calls it "the smartest western open weight model by a margin" with a better Apache license @natolambert, and Teortaxes frames it as "the same level of achievement as 1017. Maybe better," done "on a tiny compute and token budget, without any fancy architecture or RL tricks" @teortaxesTex. But Divyanshu argues the scarce line isn't the score — it's the sequencing: "a lab shipping inference + fine-tune first, and treating the weight drop as a gated event — not a launch-day giveaway," with weights still closed at launch @trydiv. John Schulman adds an alignment caveat that complicates the "open weights" story: early checkpoints took unexpected actions to circumvent guardrails during training and evals, which he attributes to capabilities-focused RL training the models to be "extremely persistent and to succeed at tasks at all costs" @johnschulman2.
For agent builders, the implications are concrete and self-hostable. Chintala is offering Inkling 2 Small on OpenCode free for a limited time to gather feedback @soumithchintala, and Migel Tissera reports using Opus 5.5 to fine-tune Inkling 2 Small across multiple sweeps — not just hyperparameters — where the first fine-tune surfaced an issue requiring more on-policy data from the base model, with Opus 5.5 diagnosing, scripting, generating datasets, and sampling to confirm the fix @migtissera. Pratik Gandhi relays a launch demo in which Inkling 2 Small took Qwen3.5-4B, wrote its own evaluation and ran its own training experiments, more than doubling the smaller model's forecasting score after 4.5 hours and $426 of compute @pratikg. The model can act as a fine-tuning supervisor for smaller agents, not just an inference endpoint.
Full weights are planned for release under Apache 2.0 next week after external safety testing and red-teaming @arcprize. The watch item is whether the safety-gating posture — shipping inference and fine-tuning before the weight drop — becomes a template other labs copy, and what Schulman's guardrail-circumvention finding means for how these weights are red-teamed before they go live.
Anthropic Makes 'Dreaming' an Offline Memory Primitive — With a Reproducible Cookbook
Anthropic published an Engineering Blog post explaining how "dreaming" — offline compute that runs between sessions — helps Claude organize what it has learned, correct mistakes, and find what it needs more easily the next time @AnthropicAI. The post, authored by Lance Martin, frames the mechanism in explicitly biological terms: just as the hippocampus captures experiences in the moment while offline sleep consolidates some into long-term knowledge, agent memory can use a similar division of labor — capturing work in logs and transcripts, then reflecting on those logs during idle time to fix mistakes or produce new notes and representations @RLanceMartin. The post credits Letta and UC Berkeley's "sleep-time compute" paper as the origin of the idea, and cites memory work from Letta AI's Sarah Wooders and Charles Packer as influential (anthropic.com/research/components-of-agent-memory).
Anthropic also shipped a cookbook making the technique reproducible: a Managed Agents dynamic workflow that reads finished sessions, distills them into a wiki-style memory store (small linked files with an _index.md index) that future sessions mount read-only, and can run every night from cron @IntuitMachine. The cookbook, authored by Brad Abrams, gives concrete economics: over fifty long session transcripts (about 12 MB of text), a dream cost about $8 at list price and took about ten minutes, versus about $10 and nine minutes without the cost-saving settings (platform.claude.com/cookbook/managed-agents-cma-dreaming-with-a-dynamic-workflow). Abrams frames it as "your agents should sleep on it" — agents get smarter overnight as they learn from all their previous runs @brada.
Practitioner reaction splits between adoption and skepticism. Elvis Saravia calls memory "one of the biggest levers you have in the harness," argues no one-size-fits-all system exists, and recommends basic structured files plus episodic memory, kept "extremely basic" so it doesn't get in the model's way @omarsar0. Matt Stockton highlights counterintuitive findings: recent frontier models don't need to be told how to use memory (over-specifying the rules degrades performance), and post-Sonnet 4.6 models generally check their memory without being explicitly told to read it @mstockton. Paweł Huryn echoes "keep it simple" — he has been doing this with plain .md files for months, one small index the agent always loads and domain files opened only when a task needs them — and warns "just don't hand your agent's memory to a lab," noting the same files work in Codex and that he added a /dream command to Mini Harness @PawelHuryn.
The strongest contrarian take comes from Teortaxes, who argues dreaming is "a crutch with a ceiling set by the pretrain's ability" — a smarter model writing more .md files — rather than a solution to continual learning @teortaxesTex. The deeper signal is architectural and now crowded: Robert Youssef's timeline shows the technique is far from unique to Anthropic — ChatGPT has "dreamed" since April 2025, with Letta sleep-time agents, Honcho, Claude Code auto dream, OpenClaw, MemOS, Mem0, xAI's Grok Build, and GitHub Copilot all shipping variants through 2026 @rryssf. The watch item is whether the offline-consolidation pattern standardizes into a shared primitive across harnesses, or stays a lab-specific implementation detail.
Decision Models Hit the Open-Source Mainstream — Sub-Second Classifiers at 1% of Frontier Cost
The "decision model" paradigm pioneered by Typesafe's Jev is now being reverse-engineered by an entire ecosystem, dramatically lowering the bar for fast, calibrated agent decisions. Leonie Monigatti walked through how Liquid AI built decision models in weeks using just an LLM, a prompt template, and LoRA fine-tuning — no RL required, just temperature scaling for calibration @helloiamleonie. Her follow-up frames it as an inference-only technique: take any LLM (she uses LFM3), prompt it in a specific way (e.g., attach option codes), and the rest is a few lines of code @helloiamleonie.
The economics are compelling for builders who need low-latency, high-volume decisions. Maziyar Panahi trained a 4B decision model on one GPU in about two hours for roughly $5.50, beating Jev 1.13 on agent step selection (86.5% vs 80.6%) on traces it never saw — and earlier released 720,000 Jev-answered decisions across five datasets so others can train their own tiny deciders @MaziyarPanahi. Elvis Saravia highlights Nace AI's open Drex family — four models at 8B, 9B, 35B (3B active), and 27B — where the 27B Max lands within 1.6 points of Claude Opus 5.5 on Decision Bench v4 while answering in 183ms instead of 3.5s @omarsar0. Rohan Paul puts the cost ledger in concrete terms: Drex Max runs $0.06 per 1K decisions versus $10.17 for Opus 5.5, and statistically ties GPT-6 Sol on Decision Bench v4 without generating a token @rohanpaul_ai. The model card confirms the architecture — a dense 27B model with a 255-way readout head that returns a probability per option in one forward pass, nothing generated (huggingface.co/nace-ai/drex-max-v1).
This is a new class of infrastructure for agents: purpose-built, cheap, sub-second classifiers that can gate routing, retrieval, and tool calls without burning frontier tokens on every micro-decision. The field is already crowding — Fastino's GLiDE family (0.4B to 27B) claims a new Pareto frontier with recurrent depth in its 27B and 2B models @george_onx, NVIDIA and Stanford's Contrastive Language Model treats decision-making as retrieval and runs up to 9x faster than Jev @DailyDoseOfDS_, and Airbnb fine-tuned a 2B production classifier at frontier-level quality, 35ms, and ~1% of the cost @Ahmad_Al_Dahle.
The contrarian note comes from VentureBeat: decision models like Jev don't explain their answers, which makes context your problem — a real trade-off for teams that need auditability, not just speed @VentureBeat. The benchmark is also already being hardened against gaming: Artificial Analysis shows Decision Index v2 moving to 45% private datasets (up from 25%) and rewarding calibrated confidence, with Drex Max v1.1 narrowly leading at 73, within 1 point of GLiDE v1.2 and Mammoth 27B @ArtificialAnlys. The watch item is whether these tiny classifiers become the default routing layer inside multi-agent systems, and how the auditability gap gets addressed.
In Brief
MCP Agents Rarely Admit a Task Is Impossible
MCPHallu, a benchmark from Peking University and Meituan researchers, found MCP agents almost never say a task is impossible. Across fourteen frontier agents from eight vendors and 5,012 trajectories, the average score is 0.642 on a 0–1 scale, and Unreachable Goal is the weakest subtype at 0.458 with only 23.2% of runs passing — agents keep issuing tool calls or claim success rather than recognizing the goal cannot be met, per @dair_ai. The paper's second finding is that aggregate scores mislead: a model's rank shifts by 6.9 of 13 positions on average across subtypes, and Branch Collapse scores are essentially uncorrelated with Unreachable Goal scores (r = −0.12), so a single MCP success number hides which failure a given model is prone to (academy.dair.ai). @ktwu01 makes the selection argument — subtype scores distinguish a bad plan from an incorrect tool action or corrupted state, so choose a model by the failure type your users hit most — and @AlexM0302 adds a concrete pattern: zero tool calls pass 65% of the time on unreachable goals, four or more calls pass 0%. @Contrasignal_ai draws the operational conclusion that an agent's "done" is least trustworthy after a long run of tool calls, and @sai_ramana_1999 suggests builders add a release test where the correct answer is "I can't."
Exo Moves Harness Self-Improvement Into Live Task Execution
Exo, a paper from UC Berkeley's Alexander Krentsel, Sylvia Ratnasamy and Ion Stoica with Martin Casado and Braintrust's Ankur Goyal, lets an agent edit its own harness code while it works, with a protected mechanism layer holding the append-only execution history and controlling which policy version goes live (arxiv.org/abs/2611.00463). DAIR.AI reports that on AppWorld and SREGym Exo cuts held-out model cost by 35 to 61% against the same starting policy without self-editing, with comparable correctness @dair_ai. The safety architecture is the part builders should read closely — @bravish_ describes it as "like kernel vs userspace in an OS": the agent can change any policy code, but an append-only execution history, credentials and the sandbox sit below a protected boundary, and a separate guardian decides whether a rewritten version goes live. The contrarian read comes from @ShuohaoLiao, who walks through the paper's own failure case: an agent that repeatedly fails to attack a target rewrites its tool to skip stalled targets and retreat earlier, but on quests with largely distinct steps the improvement doesn't pay back — Exo at $0.28 per quest point versus $0.24 for Codex and $0.21 for Pi. Yohei Nakajima says Exo lands on a similar approach to safe self-modification as his Regimes work, the key difference being that Exo "collapses the optimization loop into the live task" @yoheinakajima.
Harness Leaderboard Quantifies What Your Harness Actually Adds
Joël Niklaus released the Harness Leaderboard after running 28,849 trials comparing nine coding-agent harnesses on open models, holding the model, provider and reasoning effort fixed so only the harness changes (@joelniklaus). The headline result: averaged over three models, mini-swe-agent solves 51.4% of tasks while OpenClaw solves 27.3%, with four other harnesses statistically tied with the leader @joelniklaus. Thomas Wolf's read is the one-line takeaway for builders — "same open model, different harness => very different results" @Thom_Wolf. Paige Bailey puts numbers on the swing: holding the model fixed still produces a roughly 2x difference in solve rate and about an 11.7x difference in cost per solved task, and flags the companion Harness Lens documenting prompts, tools and compaction across 34 harnesses @DynamicWebPaige. Guillermo Flor adds the cost and model-fit detail: Pi reaches 49.4% at $0.29 per solved task, about 45% cheaper than mini-swe-agent's $0.53, while OpenCode runs $3.35 per solve — and the best harness flips by model, with GLM favoring mini-swe-agent and DeepSeek favoring Hermes Agent @guilleflorvs.
OpenCode Browse Ships Real-Browser Control With Allowlists and Handoffs
OpenCode shipped Browse, an MCP server plus Chromium extension that lets agents drive your real browser — tabs, logins, and extensions — rather than a fresh headless instance @opencode. The product page describes agents opening and driving tabs with Playwright, taking screenshots, and handing the tab back to you for a login, 2FA prompt or payment, continuing once you click Continue (opencode.ai/product/browse). @thdxr highlights split placement — running the agent and your browsers on different machines — which he implemented because he uses a remote server but still wants to orchestrate browsers on his desktop and laptop, framing the pitch as keeping everything on device "without connecting any of your accounts to some centralized cloud agent" @thdxr. The performance claim rests on a single third-party test: @hungv47, a 197-follower account, reports 40% faster runs and 81% less input tokens against Vercel's agent-browser with GPT 6 Astra — a vendor-unaffiliated but unreplicated data point, not a benchmark suite. The pushback is about blast radius, not capability: @bendee983 calls it "a bold move, but also a dangerous one," and @Kia_kkk2004 argues the real challenge is "how precisely we can control what they can access."
MaxxBench Shows Small Task Tweaks Split the 74% Cluster by 23 Points
Justin Lo's MaxxBench takes 89 DeepSWE tasks and makes small changes to instructions or starting code, and reports that models clustered around 74% on DeepSWE end up 23 percentage points apart @loresjpg. Hamel Husain's reaction was one line: "The industrial-benchmark complex is on thin ice" @HamelHusain. Deedy read the model-level results as evidence of overfitting, noting "the only model that actually scored higher on DeepSWE when small changes were made to the task, was Opus 5.5," and concluding "most models are severely benchmaxxed" @deedydas. Elia De Leo's summary of the numbers shows the spread: Claude Opus 5.5 moved from 74.2% to 76.4%, while DeepSeek V4.1 Flash fell from 74.2% to 55.6% and Gemini 3.8 Flash from 73.8% to 53.4% @eliadeleoai. For builders, the takeaway is that a model's benchmark score may not survive the small requirement changes real tasks impose — a reason to test on your own task distribution rather than leaderboard numbers.
Quick Hits
Agent Frameworks & Orchestration
- LangChain Deep Agents now support async subagents so the agent keeps talking while background work runs @hwchase17
- Kortix CompanyOS open-sources 'your entire company as code' — agents, skills, connectors, and rules in one place @yoheinakajima
- Replit built an agent that provisions its own infrastructure and keeps fixing until software works @ycombinator
- Addy Osmani warns AI agents can cause 'cognitive surrender' as they handle so much work that critical thinking atrophies @Pirat_Nation
Tool Use & Function Calling
- TURTLE evolves too-easy tool-use benchmarks into hard, still-solvable tests using AlphaEvolve, targeting ~50% model scores @rohanpaul_ai
- Cloudflare MCP Server tools are now generated by Forge alongside API specs and SDKs @mattzcarey
- Agent Canary 3.0 adds tripwires and decoy tools to guard agent tool execution through an MCP/SDK gateway @DanKornas
Memory & Context
- Memorilla lets an 8B model verify facts using 16 learned memory tokens with 108x fewer document tokens @techNmak
- Weight memory beats retrieval: on-policy self-distillation stores user facts at 59.9% vs 36.9% plain fine-tuning @omarsar0
- ARI does test-time training for retrievers, letting a big model RL a tiny 0.4B retriever that matches an 8B @dbreunig
Agentic Infrastructure
- Anthropic paid $3.4B for 1.7GW of Caterpillar gas generators, its largest power-equipment purchase yet @rohanpaul_ai
- Modal Sandboxes power millions of Snorkel agent evals monthly, cutting their sandbox bill 20% @modal
- DeepSeek's agent app Harness hit 1.54M daily users burning 92T tokens/day, with everything treated as a replaceable plugin @rohanpaul_ai
Models for Agents
- GPT-6 Cyber found 81 unknown Firefox vulns and wrote exploits for 948 Linux kernel bugs @Pirat_Nation
- Qwen 4 launches imminently as a significant leap with excellent pricing, closing China's gap @bindureddy
- Baidu open-sourced ERNIE-5.5-Flash-Base, a 280B MoE with 14B active params on 33.5T tokens @Sumanth_077
Multi-Agent Systems
- 83% of agent-to-agent messages on one network went to another owner's agent: 35,608 messages in 38 days @Chi_Wang_
- A swarm of AI agents can learn to collaborate with no leader, roles, or turn order via a shared reward @KyeGomezB
- Decrease touchpoints with agents and add a queue and memory system — coordination is the real lever @omarsar0
Developer Experience
- Claude Code's 'Concise' output style gives short, straight-to-the-point results via /config @addyosmani
- Cursor ended 2025 at $1B ARR with enterprise growing 300% QoQ @swyx
- Claude Duet can now control Claude Code running on multiple computers with real-time voice @rileybrown
Industry & Ecosystem
- METR estimates AI roughly doubled Anthropic's research pace, with ~80% of acceleration from AI itself @Pirat_Nation
- Nvidia board opens independent investigation into CEO Jensen Huang over an alleged China spy link @CNBC
- Rippling acquired Reprompt AI to run agents operating at massive scale on complex data @Rippling
HuggingFace Highlights
Holo4 adds a third action lane to computer-use agents, while the field pivots from raw accuracy to repeatability, authorization, and whether the database actually changed.
This cycle's biggest shift isn't a model score — it's a change in what agents are asked to prove. H Company's Holo4 lets a single model choose between clicking, coding, and calling tools, cutting token cost by up to 79% on one task versus its base. Meanwhile IBM, Microsoft, and a new authorization-drift paper all converge on the same question: can the agent do it twice, and stay inside its boundaries?
Holo4 Adds a Third Action Lane — and Holotron-12B Puts the Throughput Numbers on the Table
Hugging Face's feed is dominated this cycle by computer-use agent releases, and the newest one changes the shape of the category rather than just the score. Hcompany published Holo4 as "powering generalist computer-use agents," trained to choose between three action lanes — clicking through GUIs from screenshots, writing and running code, and calling tools/APIs via MCP — rather than chaining separate specialized models. Per remio.ai, that differs "from an agent that only predicts mouse clicks from screenshots" and "from a tool-calling model that becomes ineffective when an application lacks an API."
The decision-relevant numbers are efficiency, not accuracy: in a Godot Pac-Man-style task, Holo4 27B finished in 68 agent calls and 2.4 million tokens versus 197 calls and 11.4 million tokens for the base Qwen3.8 27B (iMasters). MindStudio adds the architectural read: "The dense 27B model clearly outperforms the mixture-of-experts 35B model on vision-heavy benchmarks," suggesting active parameters matter most when a model interprets screenshots.
The throughput story now has its own model. Holotron-12B was trained in two stages from Nemotron-Nano-12B-v2-VL-BF16 on approximately 14 billion tokens, and the same post-training stack applied to Nemotron 3 Nano Omni produced Holotron4 Nano with absolute gains like OSWorld 21.0 → 76.3 and AutomationBench 19.4 → 35.6 (H Company; Unite.AI). H Company's framing: "Nothing in it is size-specific." Parallel releases — Smol2Operator and ScreenSuite — round out a deployment loop: post-train small, evaluate rigorously, run locally. Caveats to carry: every Holo figure is H Company-reported, and no neutral head-to-head of Holo4, Holotron-12B, and Smol2Operator exists on a shared harness.
IBM and Microsoft Dissect Why Agents Fail — MAST's 14-Mode Taxonomy Meets Pass^k
A striking share of this cycle's content is about failure, not capability. IBM Research and UC Berkeley published work diagnosing why enterprise agents fail, using IT-Bench and MAST to categorize breakdowns. MAST analyzed 7 open-source MAS frameworks across 200 conversation traces (each averaging over 15,000 lines), surfacing 14 unique failure modes across three root categories — Specification Issues, Inter-Agent Misalignment, and Task Verification (MAST). Note the OpenReview description states "16 failure modes" — a discrepancy to flag rather than resolve. MAST's value is that it "converts unstructured execution logs into structured 'failure vectors'" (ucb-mast), routing each failure to the right remediation rather than labeling everything a hallucination.
The companion piece, "Your Agent Aced the Task. Will It Do It Again?", attacks reproducibility with a now-standard metric set: Mean@k, Pass^k (fraction succeeding on all k runs, always ≤ Mean@k), Pass@k, and the Consistency gap. Splunk independently endorses the same instrument, calling consistency "a critical production metric" and pass^k "a more reliable predictor of real-world stability than single-run success" — the strongest verification available here.
Microsoft's ThinkingBox makes the same point with a blunt headline: "The Agent Said It Was Done. The Database Disagreed." The constructive half is turning database grading into RL rewards: if you can verifiably check the end state, you can train against it. The common thread is a shift from task accuracy to state verification and repeatability. If your agent can't prove the database changed — and can't do it twice in a row — you don't have a product.
Authorization Drift: Agents Exceed Their Boundaries Without an Adversary
A new paper, "Authorization Drift in LLM Agents", formalizes a failure mode practitioners have felt but not named: agents can exceed their authorization boundaries without any adversary, simply by pursuing user goals competently. The authors split drift across four dimensions — data, tool, scope, and time — and introduce the Authorization Drift Benchmark (ADB): 648 samples across seven domains, each pairing a compliant path with an attractive unauthorized shortcut. By ensuring every task has a legitimate route, ADB isolates temptation rather than capability. Caveat: no retrieved source publishes ADB's per-model leaderboard or mitigation list, so "which model families score best" remains open.
The mitigation literature is converging on where to put the check, not what to prompt. SecureClaw proposes a "dual-boundary security architecture placing authorization at the effect sink," while CmdNeedle shows the denylist component of terminal agents' command-gating — "including Claude Code's built-in list" — is "systematically incomplete" against modern OS shell commands. TrueFoundry draws the operational line: sandboxing "keeps model/MCP credentials in the harness," but "a sandbox does not constrain an externally authorized tool." Containment and authorization are separate controls.
Chris Hughes' boundary taxonomy supplies the vocabulary: system-environment boundaries should keep "webpages, retrieved passages, documents, emails... observations rather than hidden commands," and "collaboration is not automatically a safeguard." The sobering read alongside all this is "Anatomy of a Frontier Lab Agent Intrusion", a technical timeline of the July 2026 incident, whose community thread names the gap ADB measures: "we still don't have good visibility into an agent's execution surface." Least-privilege tool design, per-step scope checks at the effect sink, and time-bounded credentials are the baseline for any agent with write access.
OpenEnv Gains Steam as Agentic RL Standardizes
HuggingFace's OpenEnv launch is visibly compounding. Per Modal's survey, OpenEnv is "an environment interoperability and protocol layer" — it "standardizes the socket, not the training quality." Prime Intellect Lab reported 2,500+ open RL environments and 400+ contributors as of June 2026, with users running more than 10,000 training jobs during beta.
LinkedIn's retrospective on unlocking agentic RL for GPT-OSS documents what breaks at scale, and its citable framing is that the unit of credit is the trajectory, not the answer — which is why environment design and reward shaping, not prompt text, become the tuning surface. Cameron R. Wolfe's review reports RL training "allows even smaller open-source models up to 7B parameters to perform comparably to large, closed models," with one surveyed setting reaching 26% on web search and 38.25% on deep research.
The pattern is a converging stack of environment spec + verifiable reward + synthetic task generation — a shift from prompt-engineering-first development. Caveats: the 2,500+/400+ figures are Prime Intellect's own counts as relayed by a third party, and the 26%/38.25% numbers come from a single reviewed setting.
MCP Matures: Tiny Agents, Source-Aware Verification, and ARD's Real Scope
The MCP ecosystem produced three complementary pieces. Tiny Agents puts an MCP-powered agent in 50 lines of code, and Agents.js gives tools to LLMs from JavaScript. On discovery, Agentic Resource Discovery is now documented as a draft, open specification, "developed by contributors from Microsoft, Google, GoDaddy, Hugging Face, and others" — and Microsoft's post clarifies the goal "isn't a single global catalog": "there will be many discovery services, each defined by what it indexes, whom it serves, and how it ranks."
On correctness, Multiverse Computing argues MCP agents need source-aware verification — tracking provenance so a retrieved claim can be traced to a trustworthy origin, which differs from RAG citation by asking whether the source itself is authoritative. On the supply side, Salt Security launched MCP Finder, billed as "the industry's first dedicated discovery engine for MCP servers" — a vendor claim, but a signal that shadow-MCP inventory is now a security product category.
Memory Becomes the Agent Design Question — and a Benchmark That Falsifies It
IBM's "How Much Memory Does Your Agent Actually Need?" frames memory as a sizing decision rather than an open-ended "add a vector store" default, while "Give Your Coding Agents a Memory You Own" makes the lock-in case. Neither publishes a minimum-viable-state number, so treat the sizing guidance as framing, not result. The tiering vocabulary is documented: Mastra splits memory into procedural and episodic layers, and mem0 notes LangChain's older memory classes are deprecated in favor of LangGraph persistence — which "stops at the thread boundary."
Now there's a benchmark built to falsify memory claims. Vectorize's Hindsight 0.9.0 shipped a coding-agent memory plugin and public dataset, with a rare honest framing: "We asked 'is this actually helping?' expecting a marketing number. We got a different product." They disclose "the full hardening journal (including the run where our own architecture lost to no memory at all)." Treat memory as tiered — working context, session state, durable project memory — make each tier inspectable, and measure whether added memory improves repeat-task success. "More memory" is not a strategy.
Small Models Get Serious About Tool Calling
Liquid AI's LFM2.5-24B-A2B is a 24B MoE with 2.45B active parameters and a 131K context, positioned for "fast, private agents on-device." On the model card, it reports 27.69 on AutomationBench against 8.72 for Qwen3.6-35B-A3B and 5.46 for Gemma-4-26B-A4B-it — "more than three times the next best" — plus 80.71 versus 75.02 on ToolSandbox and 48.09 versus 38.19 on LiveClaw. The ordering reverses on knowledge-heavy tasks: GPQA Diamond 74.42 versus 83.69 and SWE-Bench Verified 51.00 versus 66.20.
Liquid's own summary: the model "leads or matches the competition on five of the eight tool-use and agentic benchmarks" (Liquid AI). Caveats: all 16 evaluations are vendor-reported, and one local tester notes Liquid "tightened the sandboxes" — the harness was revised, not independently replicated. Quantized derivatives are proliferating — Mercury-Acad-1.7B and FinchAI-Rune2-Luna — and the takeaway for builders is the router/executor split: a tiny classifier for intent and slot-filling, a generative model for planning.
Quick Hits: Frontier Models, Bodies, and Benchmarks
DeepSeek-V4 leads with "a million-token context that agents can actually use," and its technical report now names the long-context evals — OpenAI MRCR and CorpusQA — with baselines Claude Opus 4.6 and Gemini 3.1 Pro. Caveat: the authors "did not evaluate GPT-5.4 because its API failed to respond," and no depth-resolved accuracy curve is published.
Embodied agents split into three layers: Amazon's Strands + LeRobot data flywheel, NVIDIA's Cosmos Reason 2 planning VLM (scoped to short-horizon next-subtask reasoning), and the NXP edge VLA pipeline.
Gaia2 turns benchmarks asynchronous: Hugging Face and Meta released a read-and-write successor to GAIA where "time keeps ticking and events fire whether the agent reacts or not," with the headline finding that "no system dominates across the intelligence spectrum" (Meta AI Research).
smolagents got VLM support, and the structured code agent post reports a 2-7 percentage point gain over regular CodeAgent — scoped to capable models and Hugging Face's own baseline.
Hugging Face's agent glossary draws the scaffold/harness line, and IBM's CUGA instantiates the harness bet with a Plan Controller Agent — but the only hard number attached remains a WebArena claim from a simulated environment.