DiScoFormer delivers unified density and score estimation for any distribution
AllenAI’s DiScoFormer uses a transformer to output both probability density and its gradient (score) from a sample in one forward pass, removing the need for separate models or retraining. The shared backbone and consistency loss let it adapt on‑the‑fly to out‑of‑distribution data, boosting accuracy across high‑dimensional tasks.