AI inference glossary
Parallelism

All-to-all

In plain English

All-to-all is a coordinated exchange where every GPU sends a different package of data to every other GPU.

Technical definition

All-to-all is a collective pattern in which every participating rank sends distinct data to every other rank.

Engineering details

Expert-parallel MoE layers use an all-to-all dispatch to send tokens to their selected experts and another combine operation to return expert outputs. Traffic volume and imbalance depend on token routing.

Why it matters

All-to-all is more demanding than simple point-to-point transfers and can become network bound as EP grows. Specialized kernels overlap communication with compute and optimize token packing to keep the fabric busy.

How to read it in InferenceX

Rack-scale NVLink can keep wide-EP all-to-all traffic inside the scale-up domain. Multi-node recipes over InfiniBand or RoCE must overcome a much lower per-GPU scale-out bandwidth.