Why 128K Token Context Windows Aren’t Useful for Coding Agents
LLM vendors tout 200k‑plus token windows, but the effective usable range caps near 100k tokens. Attention decay causes the model to forget mid‑session data, breaking coding agents that rely on long context. Developers should treat the window as a budget, benchmark real performance, and offload history into explicit artifacts or new sessions.