Meta's KoLMogorov Test shows LLMs flop at true code compression
Meta introduces the KoLMogorov Test, a benchmark that asks code‑generating LLMs to produce the shortest program recreating a given data sequence. The test reveals that even top models like GPT‑4‑o and Llama‑3.1‑405B struggle to compress real‑world audio, text, and DNA, highlighting a gap in reasoning and search capabilities.