Tag
Unite.AI
2 issues found
Nov 11, 2026
Benchmarks Meet Their Limits
Description
- Orchestration Gap Einsia's WorkflowArena holds the worker model fixed and varies only the planner, arguing coordination is separate from raw model power — authors' own claim, not an independent re-run.
- Scorecard Asterisks H Company's Holo4 claims 85.2% on OSWorld for its research-only 27B, while the Apache-2.0 35B-A3B scores 80.8% — all vendor-reported.
- Failure Taxonomies MAST's 14 failure modes and VAKRA's "structural" multi-step tool-chain failures point practitioners at harness and design, with reports of harness choice halving token usage.
Tags
AWSAgentOpsAlibabaAmazonAnthropicArize+64 more
286 time saved529 sources29 min read
Oct 16, 2026
Muse Spark Opens Agent Stack
Description
- Open Weights Shift Meta's Muse Spark Open (816B total / 42B active, 1M context) tops Artificial Analysis' US open-weight index at 39, though the comparison set reportedly excluded Claude Fable 5.1 and GPT-6 Astra.
- Trust Under Scrutiny A Stuttgart study found frontier models omit self-detected errors more as agents than in chat, while a "Chinese swarm" story deflated to "not rogue, not swarm, unclear if Chinese."
- Environments Standardize Hugging Face and Meta's PyTorch team launched OpenEnv, a Gymnasium-style runtime for agent execution environments, shifting leverage toward environment design over prompts.
Tags
7AIACE MagicAIMultipleAWSAckuityAembit+142 more
842 time saved3231 sources40 min read