Tag

Vectorize

3 issues found

Oct 29, 2026

Description

Contested Crowns Google's Gemini 4 Carbon claims 59 on Artificial Analysis v5.0, reportedly ahead of Opus 5.5 at 58 — yet its own OSWorld row lags.
Harness Matters DABStep's 450+ tasks topped out at 16% accuracy at release, with reasoning models at 0% under a ReAct prompt per Adyen.
Hold Loosely Name the harness, keep router decisions reversible.

Description

Long-Context Bet: DeepSeek-V4 lands with a 1M-token window, two MoE checkpoints, and its own authors hedging the numbers as "competitive, but not SOTA."
Sparse Attention Thesis: Reportedly ~27% of V3.2's compute at 1M context — the pitch is that compressed sparse attention beats benchmark rank for agents.
Autonomy Post-Mortem: An HF writeup traces a July 2026 agent intrusion running 4.5 days unattended, a reminder to sandbox long-horizon runs.

Description

Cheap Sub-Agents Anthropic's Claude Haiku 5.5 claims 10x lower cost under 100K tokens, per @trq212, with mixed early quality takes.
Generated Interfaces OpenAI's GPT-6 rollout pairs an "Intelligent UI" that picks layouts mid-stream with a claimed 44% faster search response in internal evals.
Tooling Consolidates Hugging Face's Agents 2.0 unifies tool-calling; Red Hat's AI Safety team finds "decision models" like Jev don't reliably beat LLM-as-a-judge.