Agentic inference could make AI compute speed irrelevant, reshaping hardware strategy
Ben Thompson argues that as AI agents act autonomously, inference latency will matter less than overall outcome, reducing importance of fast compute and prompting shift to heterogeneous, possibly slower but more efficient architectures. This change will reshape chip design, data‑center architecture, and AI business models.