DataFusion Pushes Down Sorts to Skip Full Scans on Almost‑Sorted Data
DataFusion now detects and exploits exact or partial sortedness in Parquet files automatically. For ORDER BY and ORDER BY ... LIMIT N queries it reorders scans using min/max statistics, applies dynamic filters and skips the blocking sort, cutting full‑scan costs and peak memory on time‑series or log data.