Turboquant.cpp cuts embedding size 30× with zero‑training quantization
Turboquant.cpp squeezes high‑dimensional embeddings into 1‑4‑bit integers without any training or codebook learning. The 400‑line C++ lib drops storage by up to 31× and still estimates inner products with low variance, making RAG and vector‑search pipelines dramatically cheaper.