MemStitch slashes LLM agent latency 25× by sharing GPU cache
MemStitch lets successive LLM agents share the same KV cache on the GPU, cutting the prefill step from 1.2 seconds to 48 ms—a 25× time‑to‑first‑token boost. By hashing prompt blocks and mapping them to physical memory, it also halves VRAM usage, enabling faster, cheaper multi‑agent pipelines.