DeepSeek mHC: Scaling Residual Stream Width

DeepSeek introduces Manifold-Constrained Hyper-Connections (mHC) to enable stable training and scaling of residual stream width with minimal compute and memory overhead.