Atlassian swaps Kinesis for Kafka to handle 150B daily events
Atlassian migrated its StreamHub pipeline from Amazon Kinesis to AWS‑managed Kafka as daily traffic surged to 150 billion events. Tiered Storage slashed storage costs, but the migration also revealed broker, S3, control‑plane, and disk limits that caused high‑profile outages. The post details the hard‑won design patterns that keep massive streaming workloads reliable.