Tag
WSO2
2 issues found
Oct 29, 2026
Benchmark Crowns Get Contested
Description
- Contested Crowns Google's Gemini 4 Carbon claims 59 on Artificial Analysis v5.0, reportedly ahead of Opus 5.5 at 58 — yet its own OSWorld row lags.
- Harness Matters DABStep's 450+ tasks topped out at 16% accuracy at release, with reasoning models at 0% under a ReAct prompt per Adyen.
- Hold Loosely Name the harness, keep router decisions reversible.
Tags
7AIAI2ActioneerAdversaAdyenAmazon+63 more
397 time saved566 sources23 min read
Sep 10, 2026
DeepSeek's Cheap Agents Go Local
Description
- Cheap Inference Shift DeepSeek's open-weights V4.1 Flash claims 98% of Astra's score at 1.4% of cost, with 300–500 tokens/sec reported.
- Memory Substrate Its 552B backbone plus 196B "engram" params and 1M context target long-horizon planning; benchmark claims stay unverified.
- Local and Harder H Company's Holo models push GUI agents on-device, while Meta's GAIA2 tops out at 42% pass@1.
Tags
ASMLAklivityAlibabaAmazonAnthropicApex+69 more
359 time saved2114 sources35 min read