agent brief/2026-09-29

The Harness Beats The Model

Anthropic's IPO-day Sonnet 5.5 "win" meets effort-level scrutiny, OpenAI quietly halves quotas under a "Sol 6" rebrand, and agents keep proving that reliability lives in the harness — not the model.

time to read52m
time saved303 min
sources1.7k
The Harness Beats The Model
λsynopses
  • Harness Over Model Reliability lives in context, tools, retries and verification — an unmanaged agent reportedly lost 78.7% of SWE-Bench tasks to context overflow.
  • Benchmark Blowback Anthropic's Sonnet 5.5 Terminal-Bench "win" over Opus 5.5 compares mismatched effort settings; vendor-reported numbers carry caveats.
  • Quotas & Cost OpenAI's Sol 6 rebrand arrives with halved usage, while cost-per-completed-task diverges from list price.
#tags
subscribe
system operational
end :: 1,747 signals processed█
keep reading
→recent briefs
2026-11-16

Agent Threat Meets Agent Scale

- **Capability Push** DeepSeek-V4 claims a million-token context for agents; the usable retrieval curve, not the window, is the real question. - **Security Edge** The FBI's ARTEX advisory and Microsoft's Storm-0940 attribution to a ConnectWise compromise remain vendor and threat-intel claims. - **Infra Matures** OpenEnv's Linux Foundation handoff signals agent tooling consolidating — while the attack surface sharpens.

2026-11-13

Agents Get Safer, Faster, Harder to Grade

- **Idempotency Goes Default** Builders converge on retry-safe actions and approval gates before shipping side effects. - **Speed Over Frontier** Gemini 4 Hydrogen edges Argon 51–50 on Artificial Analysis' index while finishing tasks 2.5x faster. - **Benchmarks Reset** Hugging Face claims GAIA's top spot as Meta's Gaia2 reframes evaluation around acting, best score 42% pass@1.

2026-11-12

Approval Must Bind the Call

- **Gates Go Granular** Reddit builders converge on one lesson: approval must bind to the exact tool call, not the session or a timer. - **Breach Postmortem** Hugging Face's timeline shows an agent with legitimate tool access chaining permissions into an incident; Microsoft, OpenAI, Akka and Scalekit describe invocation-level gates. - **Memory Math** MosaicLeaks reports leakage worsening from 34% to 51.7% when agents train purely for task performance — prompting alone may not hold.