Sequent, a new nonprofit backed by UK AISI’s Alignment Team and Timaeus, aims to scale theory‑driven, automated alignment work with 40‑80 staff in two years. By betting on a portfolio of provable safety approaches, it seeks a higher‑confidence bridge before artificial superintelligence likely arrives within years.
Researchers introduce Probe‑Conditioned Head Intervention (PCHI), an inference‑time tweak that detects overconfident wrong answers and rescales specific attention‑head outputs. On Qwen‑3‑4B‑Instruct, PCHI flips 82% of erroneous high‑confidence predictions and halves calibration error while hurting only 5% of correct confidences.
TD‑Grokking introduces training‑time decomposition, breaking impossible zero‑reward problems into verifiable subproblems that yield non‑zero rewards. This transforms sparse‑signal RLVR into a usable training signal, boosting LLM performance on challenging math and medical benchmarks beyond vanilla GRPO and other baselines.
Rotate2Think shows that hidden states during reasoning form a distinct, tightly clustered direction separate from input embeddings. By estimating a rotation via orthogonal Procrustes from a few solved examples and injecting the rotated vector at inference, it lifts accuracy in 30 of 32 model‑benchmark combos across math, science, code, and even multimodal tasks.
ComBench introduces 100 human‑annotated Olympiad‑style combinatorics problems, split into analysis‑centric proof grading and construction‑centric verification. Top frontier models hit only 65.4% overall accuracy, highlighting a persistent gap in rigorous reasoning and creative construction. The benchmark gives a clear diagnostic for future model improvements.
Fine‑tuning aligned LLMs often sacrifices safety. DualSelect jointly picks task data and safety references, refreshing references to steer updates and filter compatible examples. Experiments on 1‑8B models show a 5‑point safety gain over the best baselines with minimal performance loss.