Mirendil's first model, Fern 0.1, can read up to 10M tokens at once
Mirendil released Fern 0.1, its first model, pretrained from scratch with a context window of up to 10M tokens. The context window is how much text a model can read in one go; here that is about 23 MB of code, or half a million lines. Fern is built for agent work on AI projects, such as debugging a training run from its logs or auditing training data. Access is listed as coming soon.