Swiftlet runs 80‑billion‑parameter Qwen on Mac with 4 GB RAM, 35B on iPhone
Swiftlet is a Swift‑Metal runtime that streams Mixture‑of‑Experts weights, keeping only a tiny core in memory. It can decode a 80‑billion‑parameter Qwen model on a Mac using just 4.3 GB RAM and a 35‑billion‑parameter version on an iPhone with about 2.5 GB RAM. This brings near‑state‑of‑the‑art LLMs to consumer Apple hardware without a server.