Soup lets you fine-tune 8‑billion‑parameter LLMs on a 4 GB laptop GPU
Soup streams the base model layer‑by‑layer so only adapters occupy VRAM, letting QLoRA fine‑tune an 8B LLM on a 4 GB card. It supports DPO, ORPO, SimPO and KTO without a second reference copy, cutting memory use by 700 MB. The result matches non‑streamed runs while keeping training local.