Tag
Actioneer
2 issues found
Oct 29, 2026
Benchmark Crowns Get Contested
Description
- Contested Crowns Google's Gemini 4 Carbon claims 59 on Artificial Analysis v5.0, reportedly ahead of Opus 5.5 at 58 — yet its own OSWorld row lags.
- Harness Matters DABStep's 450+ tasks topped out at 16% accuracy at release, with reasoning models at 0% under a ReAct prompt per Adyen.
- Hold Loosely Name the harness, keep router decisions reversible.
Tags
7AIAI2ActioneerAdversaAdyenAmazon+63 more
397 time saved566 sources23 min read
Sep 22, 2026
Agent Permissions Meet Benchmark Reality
Description
- Permission Fight Alibaba teases a 5–10T-parameter Qwen roadmap and a T-Head chip; Amazon moved to block Meta's Muse shopping agent.
- Honest Numbers Adyen's DABStep put top agents at 16% on hard financial tasks; IBM/UC Berkeley show open models cascade.
- Ship Carefully Grok 4.7 posts Cursor benchmark gains but users report doubled token burn; Ollama confirmed a quota-billing bug.
Tags
ASMLAdyenAlibabaAmazonAnthropicBNP Paribas+55 more
332 time saved1914 sources46 min read