A new "Matryoshka" NLA approach trains activation verbalizers to place the most informative reconstruction tokens at the beginning of the string. This front‑loading improves downstream tasks like suffix prediction and modestly boosts eval‑awareness detection, offering a clearer window into model internals.
The Alignment Research Center (ARC) announced that its former director is back as executive director for a six‑month sprint to build tools that expose the internal logic of neural networks. This push aims to accelerate mechanistic explanations, a key bottleneck for safe, high‑capacity AI development.
The paper introduces an agent design where a deterministic Executive owns belief and an LLM only proposes actions; verification becomes structural because proposals are admitted only if pre‑registered predictions match observations, preventing commitment drift. Experiments show that removing the commitment mechanism causes agents to abandon goals completely, proving the method measures and isolates drift.
A Microsoft Azure production study and controlled experiments map how agentic AI workloads bounce between CPU and GPU, exposing fragmented execution and bursty demand that cripple conventional uniform servers. The authors propose a taxonomy, quantify latency and resource patterns, and introduce Agora, a prototype that harvests idle CPU cores and oversubscribes GPU memory to boost utilization while protecting tail latency.
The paper introduces canary tools, diagnostic probes embedded in an LLM agent’s toolset, to pinpoint specific tool‑selection failures. Across 8,640 runs on 120 tasks, they show susceptibility drops 36× between weakest and strongest models, and that canary failures predict overall task failure. The authors release the full framework and data.
A fresh benchmark evaluates whether LLMs truly forget data by probing multi‑hop reasoning chains and lightweight recovery attacks. Tests on three models, six unlearning methods, and two datasets reveal that current techniques let sensitive knowledge slip through compositional queries. The findings raise red flags for privacy‑focused LLM deployments.