OpenAI's Jalapeño chip promises far better performance-per-watt for LLM inference
OpenAI and Broadcom unveiled Jalapeño, a custom inference processor built from scratch in nine months to run current and future LLMs. Early tests show it delivers substantially higher performance per watt than existing accelerators, positioning OpenAI to reduce dependence on external chip vendors and scale its AI services.