Intelligence on device
The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction
