@karpathy

• • From Chat to Kernels The paradigm is shifting from simple ReAct loops to "agentic kernels" and DAG-based task architectures, treating agents as stateful operating systems rather than conversational bots.
• • Code-as-Action Dominance New frameworks like smolagents and Transformers Agents 2.0 are proving that agents writing raw Python outperform traditional JSON-based tool calls, significantly raising the bar for autonomous reasoning.
• • Environment Engineering Builders are focusing on "agent harnesses" and sandboxed ecosystems to mitigate context poisoning and manage hierarchical orchestration within complex, real-world repositories.
• • Hardware and Efficiency As DeepSeek slashes frontier reasoning costs and local-first developers lean on Apple Silicon’s unified memory, the infrastructure for low-latency, autonomous systems is finally maturing.

• • Code-as-Action Dominance The industry is pivoting from fragile JSON schemas to raw Python execution, with frameworks like smolagents delivering massive gains in reasoning and tool-use reliability.
• • The VRAM Arms Race Building production-grade agents now requires substantial local compute, with practitioners moving toward 512GB Mac Studios and custom AMD MI50 clusters to support high-reasoning kernels.
• • Hierarchical Agent Frameworks We are moving beyond single-agent prompts into complex ecosystems where tools like Claude Code and MCP allow autonomous subagents to manage technical debt and complex orchestration loops.
• • Deterministic State Machines To close the 'Reliability Gap,' builders are implementing finite state machines and 'Deterministic Gates' to ensure agents remain within operational guardrails rather than relying on open-ended chat prompts.

The Agent Harness Era We are moving from LLMs as 'brains' to agents with 'bodies'—dedicated infrastructure like Claude Code and Google Antigravity that ground autonomous agents in professional software environments and local terminals.

Industrializing Digital FTEs McKinsey’s deployment of 25,000 agents signals the arrival of the 'Digital FTE,' shifting the focus from simple text generation to multi-agent orchestrators managing complex operational workflows at scale.

Code-as-Action Dominance The success of frameworks like Hugging Face’s smolagents proves that executing Python scripts, rather than rigid JSON payloads, is the key to solving complex reasoning tasks and benchmarks like GAIA.

Local Infrastructure Push Between AMD's 200B edge models, Ollama’s MCP integration, and persistent cloud reliability issues, the agentic stack is rapidly consolidating around local execution and 'loop until pass' patterns.

Code-as-Action Dominance The shift from JSON-based tool calling to executable Python logic is no longer theoretical; it’s a benchmark-proven necessity. Hugging Face data shows code-action agents achieving a 40.1% score on GAIA, fundamentally outperforming brittle JSON schemas by reducing parsing hallucinations and improving token efficiency.

Orchestration Layer Maturity We are moving past the "vibe coding" era into a hard-engineered reality of self-healing systems. Tools like the Model Context Protocol (MCP) and gateways like Plex are stabilizing the agentic web, allowing for recursive context management and high-recall search-based reasoning that moves beyond simple prompt engineering.

The Modular Pivot Practitioners are increasingly decoupling the agent stack, favoring specialized expert routing and Monte Carlo Tree Search (MCTS) over monolithic model calls. This modular approach, combined with the rise of 30M parameter micro-agents and high-throughput local hardware like AMD's latest roadmaps, is making autonomous execution at the edge both viable and cost-effective.

Building for Persistence The ultimate goal has shifted from single-turn responses to persistent, self-correcting infrastructure. By implementing "hot-reloading" for agent skills and utilizing reasoning loops to solve complex mathematical conjectures, the community is building a nervous system for AI that acts, adapts, and survives production-grade demands.

The Architectural Shift Moving from autoregressive token prediction to 'world models' that understand physics and causality, as signaled by Meta's Yann LeCun.

Local Reasoning Supremacy Small, specialized models like NousCoder-14B are outperforming GPT-4o on coding tasks through intensive RL and B200-powered training.

Action-Oriented Interfaces The rise of 'pixel-manipulation' agents and Python-first orchestration marks the end of simple text-based interactions and the start of desktop-autonomous systems.

Hardware-Infrastructure Convergence NVIDIA's Rubin and Blackwell architectures are evolving into 'inference factories' to solve the memory bottlenecks currently killing long-horizon planning.