Gefen cuts AdamW memory use by 8×, enabling larger LLM fine‑tuning on consumer GPUs
Gefen replaces AdamW with a single‑precision state store, trimming optimizer memory footprint up to eightfold—roughly 6.5 GiB saved per billion parameters—while preserving AdamW‑level convergence. The change is a two‑line code swap, unlocking bigger models or batch sizes on modest hardware.