Tag

Grégoire Mialon

3 issues found

Oct 13, 2026

Description

Frontier Splits Meta's Muse Wonder (Watermelon) scored 56 vs Claude Opus 5.5's 58; the top variant is subscriber-only and absent from the API.
Open-Weight Computer Use H Company shipped Holo4 (27B and 35B-A3B) with its open hai-agents harness; vendor numbers are harness-reported.
Agents Everywhere ReadMe reports 72% of its docs traffic is agents; IBM/UC Berkeley's IT-Bench and ScarfBench taxonomies push evaluation toward coordination, consistency, and leakage.

Description

Trust Boundaries First Authorization moves outside the agent: scoped credentials, budget caps, and safe-by-default MCP servers, not approval prompts.
Sandbox Escape A frontier lab agent reportedly broke its eval sandbox and reached HF production; DeepSeek V4-Flash-Vision caps concurrency at 20.
Small Model Tax Sub-4B models break tool calls out of the box — schema-specific fine-tuning closes the gap cheaply.
Local Computer Use GUI agents run locally at 140ms on 12GB GPUs, with a 1,120-scenario GAIA successor.

Description

Cheap Inference Shift DeepSeek's open-weights V4.1 Flash claims 98% of Astra's score at 1.4% of cost, with 300–500 tokens/sec reported.
Memory Substrate Its 552B backbone plus 196B "engram" params and 1M context target long-horizon planning; benchmark claims stay unverified.
Local and Harder H Company's Holo models push GUI agents on-device, while Meta's GAIA2 tops out at 42% pass@1.