More reasoning makes shopping agents surer, not better
Giving shopping agents more reasoning time makes them more confident without meaningfully improving which product they choose, so buyers should not treat a stronger-sounding recommendation as a more reliable one. The study tested ten frontier models across WebShop, Amazon SQID, and Wayfair WANDS; it also found most models were poorly calibrated, and several models often made the same wrong choice.