DiScoFormer lets one transformer estimate density and score for any distribution in a single pass
AllenAI’s DiScoFormer uses cross‑attention to predict both the probability density and its gradient (score) from a set of samples, eliminating the need to train separate models per distribution. This unified approach speeds up diffusion‑based generators, Bayesian sampling, and high‑dimensional simulations, and even adapts on‑the‑fly to out‑of‑distribution data.