Comet cuts Spark‑Iceberg query latency and fuels Rust development
Apache DataFusion’s Comet layer runs Spark reads on Iceberg tables through the native Rust engine, keeping Java planning but executing with Arrow. In a 3 TB TPC‑DS benchmark it sped up 102 of 103 queries and gave Iceberg Rust a massive differential‑testing harness, catching bugs that flow back to Java.