Lightstream: a Rust data stack that beats Arrow Flight at 50Gbps
Lightstream is an open-source Rust data-streaming stack that multiplexes Arrow, Protobuf, and MessagePack frames over TCP, QUIC, WebSockets, HTTP, or more on a single connection. Its EC2 benchmarks show it measured faster than Apache Arrow Flight on every axis, even reconciling parallel streams into one globally ordered output. Python bindings implement Arrow's PyCapsule protocol, so DuckDB and similar tools can stream a Lightstream reader directly.