The WASTE engine streams the 2.78‑trillion‑parameter Kimi K3 model (982 GiB container) directly from NVMe, fitting the inference on a 64 GB MacBook Pro at 0.45‑0.62 tokens / s. It shows trillion‑scale LLMs can be run without server‑grade RAM, turning feasibility into an engineering challenge.
Agent Behavior introduces a markdown‑based spec format that lives alongside an AI’s code, letting developers describe expected conduct, like cost‑sensitive actions, and providing reviewers, rubrics, and automated scorers a concrete reference. The open standard aims to make agent trajectories predictable and easier to audit.
The new Model Context Protocol spec (MCP 2.0) drops the session initialization step, letting clients issue a single HTTP request to invoke tools. This stateless design dramatically simplifies client and server code, making MCP easier to audit, scale, and run on modest hardware, which matters for secure, low‑risk LLM agents.