Logistic Regression Beats XGBoost on World Cup Match Predictions – Simpler Wins
On 358 historic international matches, a plain logistic regression achieved the lowest log‑loss, while XGBoost performed worse than a uniform guess. The experiment shows that with limited features, the bias‑variance trade‑off favors the smallest model, warning practitioners against defaulting to heavyweight boosters.