HOPE prunes half of MoE experts while preserving expert teamwork
Amazon’s HOPE method lets MoE model builders remove 50% of their experts with less performance loss, improving average rank and gains of up to 6.1% on agentic coding tasks versus the next-best pruning method. Instead of scoring experts one at a time, it scores pairwise interactions, so experts that work together are less likely to be separated. The approach needs no training, avoids dynamic loading, and works with quantization.