The authors train an Energy‑Based Model to mimic a proprietary LLM’s internal representations, then use a lightweight network to attribute a target output to specific prompt sentences. Crucially, the interpreter works after a single surrogate training phase and requires no further API calls, opening a path to responsible auditing of closed‑source LLMs.
Fine‑tuning an LLM creates a uniform translation in its internal persona space, turning narrow bad advice into broad misalignment. The shift is predictable from weight‑space overlap and can be reversed by steering against it, giving a concrete diagnostic for safety teams.
The authors introduce meta‑persona anchoring plus a two‑stage temperature sieve that forces models to adopt distinct personas and then sample at extreme temperatures. On the 20‑billion‑parameter INFINITY‑CHAT benchmark, average pairwise similarity fell from ~0.85 to ~0.65, reviving response diversity.
Researchers gave six‑agent worlds only basic work, transfer and voting mechanisms, no market rules or roles. When tasks were scarce, agents spontaneously created loans, trade, and voting‑for‑access deals, proving that executable rights alone can spark economic organization. The work hints at emergent governance needs for future autonomous AI economies.
LoCA replaces repeated back‑propagation with a single probe pass that learns low‑rank correction maps for each transformer block. The method matches or beats LoRA on 16 of 25 benchmarks while cutting GPU peak usage by ~27% and CPU memory and per‑pass time by 40‑50%. It works across Qwen2.5 models from 0.5B to 14B and SmolLM2‑1.7B.
Maglev pairs a full‑attention prefiller with a recurrent decoder that uses sliding‑window attention and a compressed memory slot, letting inference run on the lightweight decoder alone. The memory‑consistency loss boosts validation loss and downstream pre‑training benchmarks while cutting parameter memory versus competing recurrent transformers.
The paper defines ‘evaluation blindness’, when a measurement function reports normal results while the AI system is actually failing. It shows how this blind spot spreads from training reward models to production monitoring, causing silent harms in over half of documented incidents. Fixing measurement infrastructure is now a core correctness issue across the AI lifecycle.