Tencent's Hy4-preview is live: a 770B-param MoE that activates just 49B per token
Tencent has put Hy4-preview on Hugging Face: a 770B-parameter MoE flagship that fires just 49B per token across 256 routed experts over 77 MoE layers. That roughly 6% activation ratio buys frontier-class breadth at a fraction of the inference cost. The weights are live and serveable today via Transformers, vLLM, and SGLang, so it is testable now, not a paper promise.