Kairos tests one byte space across six data types
Kairos proposes one foundation-model design for text, images, audio, video, lidar, and control streams, so the same byte-level system could process very different data types. It combines linear and sliding-window attention, block-wise residuals, sparse experts, and a multi-scale codec, then fits a 440-byte sentence at 1–15M parameters. The checks reached roughly 10^-3 loss, but the paper has not tested generalization or multimodal training.