DeepSeek V4 Flash runs on a single AMD MI300X with full‑model performance
A single AMD MI300X can host DeepSeek‑V4‑Flash (304B‑parameter) entirely in HBM, delivering 168 tok/s single‑stream decode and up to 830 tok/s aggregate on a 64‑stream burst, all without weight offload or quantization. The repo supplies ROCm patches, Docker stack, and tuning tables that fix FP8 and MoE bugs, proving AMD CDNA3 GPUs are production‑ready for large‑scale LLM serving.