SuperThoughts halves chain‑of‑thought steps, speeding LLM reasoning
SuperThoughts packs pairs of consecutive CoT tokens into one latent vector and decodes two tokens per step via a lightweight Multi‑Token Prediction module, cutting inference length by 20‑30% with only 1‑2 point accuracy loss on math benchmarks. This speeds up long‑horizon reasoning without abandoning discrete token supervision.