LodeHQ
AI news for people who shipFree, by email

AI · huggingface.co · Sunday, 15 November 2026

HOPE prunes half of MoE experts while preserving expert teamwork

Amazon’s HOPE method lets MoE model builders remove 50% of their experts with less performance loss, improving average rank and gains of up to 6.1% on agentic coding tasks versus the next-best pruning method. Instead of scoring experts one at a time, it scores pairwise interactions, so experts that work together are less likely to be separated. The approach needs no training, avoids dynamic loading, and works with quantization.

Read the source: huggingface.co ↗In the 15 November issue →