Beam brings 1M-token coding context to an open 501B model
Teams can run and customize Beam for coding and agentic work under Apache 2.0, with a 1M-token context window and support in Transformers, vLLM, and SGLang. It is a sparse mixture-of-experts model: although the network has 501B parameters, only 23B are active for each token, so each input uses a smaller slice of the system. A Rust-based harness, fine-tuning recipes, and reinforcement-learning support are included.