Databricks cluster startup can waste €3k / month on firewall traffic
Each Databricks node pulls over 12 GiB of data during startup, and when that traffic is forced through Azure Firewall it can create more than 100 TB of outbound traffic and cost over €3,000 per month. Applying private endpoints, service endpoints and custom routing sidesteps the hidden expense and protects lakehouse budgets.