DeepSeek’s mHC revamps residual links to scale future AI models
DeepSeek’s new paper introduces Manifold-Constrained Hyper-Connections (mHC), an extension of residual links that restores identity mapping while scaling to larger models. The approach patches the instability that plagued earlier hyper‑connection variants, promising faster training and better performance for next‑gen foundation models.