Spotify’s RAP index makes petabyte data lakes serve instant point queries
Spotify built Random Access Parquet (RAP), an external index that maps user keys directly to file offsets and row numbers inside unmodified Parquet files. By replacing distributed SQL scan chains with parallel ranged reads, RAP delivers sub‑second lookups across petabyte‑scale data lakes, enabling faster personalization and AI‑agent responses.