Beyond LoRA: Benchmarks Reveal Faster, Smaller Fine‑tuning Wins
Hugging Face’s PEFT team benchmarked five alternatives to LoRA—DoRA, LoKr, LoHa, AdaLoRA and FourierFT—across classification, generation and retrieval tasks. Several methods topped LoRA in accuracy while cutting parameter counts by up to 50%, showing you can fine‑tune larger models with less memory. This expands the toolbox for anyone needing efficient adaptation.