Expert Imbalance (TODO)

During training, we try to ensure that the router evenly balances load to all the experts. However, it is quite difficult in practice.