LodeHQ
AI news for people who shipFree, by email

Data · databricks.com · Tuesday, 26 May 2026

Scaling for MHHS: how Octopus Energy achieved a 50x cost reduction in margin data engineering

Octopus Energy re-architected its margin data pipelines to handle the UK's 48x data surge from Market-wide Half-Hourly Settlement (MHHS). By splitting a monolithic pipeline into three specialized streams, a team of three engineers cut costs 50x—saving $1M/year—while scaling for half-hourly granularity.

Read the source: databricks.com ↗In the 26 May issue →