Smevals finds the cheapest model that meets your quality bar
Smevals is a lightweight Python CLI that runs task‑specific evals across multiple models, prompts, and harnesses. Define tasks in YAML, attach custom graders, and compare runs to spot the least‑expensive model that still hits a quality threshold. Results can be viewed in‑terminal or exported as static web reports.