LLM vendors tout 200k‑plus token windows, but the effective usable range caps near 100k tokens. Attention decay causes the model to forget mid‑session data, breaking coding agents that rely on long context. Developers should treat the window as a budget, benchmark real performance, and offload history into explicit artifacts or new sessions.
Evil Martians argue that AI‑first workflows force developers to sprint nonstop, eroding fulfillment and spiking burnout. Their post outlines concrete steps, restoring enjoyment, reclaiming ownership, and rejecting constant productivity pressure, to make AI‑assisted development sustainable. Ignoring the human cost risks a talent drain as tools get faster.
Google’s DiffusionGemma model replaces token‑by‑token decoding with diffusion‑based parallel generation, achieving up to 4× faster inference (700+ tokens/sec on RTX 5090, 1000+ tokens/sec on H100). The 26B‑parameter MoE runs within 18 GB VRAM, making real‑time, on‑device generation feasible.