Polars Distributed on K8s, Dagster Hikes 10x, Lakebase Branches

Polars announced its distributed engine is now available as a Helm‑installable service on Kubernetes, letting users run petabyte‑scale queries with the same Polars API and fast boot times. The open‑source release adds query profiling, data lineage, and works outside Kubernetes too.

Dagster announced new pay‑as‑you‑go pricing for its Solo and Starter plans effective May 1 2026, moving from a flat $10/$100 monthly fee with included credits to $10 + $0.04 per credit and $100 + $0.035 per credit respectively. The change can increase costs ten‑fold for heavy users, prompting community criticism and calls for self‑hosted alternatives.

Databricks Lakebase introduces copy‑on‑write database branching, letting you spin up a terabyte‑scale branch in seconds with zero additional storage. This removes a historic barrier to evolutionary database design, enabling CI/CD‑style schema changes at production scale and redefining DBA and developer collaboration.

The dataset compiled from Richardson et al. (2023) lists the nine planetary boundaries, their quantitative safe‑operating thresholds, uncertainty zones, and the latest observed values, indicating which boundaries are exceeded. Available in CSV via DataHub, it supports analysis of planetary health trends.