Edge0 fits a 145B agent on one consumer GPU
Edge0-145B gives developers a 145B-parameter agent that can run on one RTX 5090 D, instead of requiring a datacenter setup. Its NVFP4 build uses 23.25 GiB of VRAM plus 38.27 GiB of host RAM, and the project reports 98.3 tokens per second for agent decoding. The model is a sparse mixture of experts: 10 of 512 experts are active for each token, keeping the full model large while limiting work per step.