AI scrapers now consume Linux’s spare CPU
At git.kernel.org, abusive crawlers consume more CPU rendering HTML commits than every legitimate access combined, including git clones. Across five geographically distributed nodes, 14 cores are tied up serving scrapers that repeatedly traverse billions of duplicate URLs instead of cloning the repositories. The cost is not theoretical: open infrastructure is being forced to spend capacity feeding model training pipelines.