Unified All Reduce and PSJul 29, 2022←A Unified Architecture for Accelerating Distributed DNN Training in Heteogeneous GPU/CPU Clusters What Is Bisection Bandwidth→