LodeHQ
AI news for people who shipFree, by email

AI · huggingface.co · Sunday, 15 November 2026

Edge0 fits a 145B agent on one consumer GPU

Edge0-145B gives developers a 145B-parameter agent that can run on one RTX 5090 D, instead of requiring a datacenter setup. Its NVFP4 build uses 23.25 GiB of VRAM plus 38.27 GiB of host RAM, and the project reports 98.3 tokens per second for agent decoding. The model is a sparse mixture of experts: 10 of 512 experts are active for each token, keeping the full model large while limiting work per step.

Read the source: huggingface.co ↗In the 15 November issue →