Yandex’s 80B model activates just 3B parameters per token
Yandex’s AliceAI-Foundation-80B-A3B-Base gives Russian-language model users an 80-billion-parameter base model that activates 3 billion parameters for each token, reducing the active compute compared with its total size. Its hybrid architecture uses mixture-of-experts layers, supports contexts up to 262,144 tokens, and was trained from scratch. The model card includes launch recipes for Transformers, vLLM, SGLang, and Docker.