Defer the data-parallel gradient all-reduce to update() under gradient accumulation - #5099
Open
NuojCheng wants to merge 2 commits into
Open
Defer the data-parallel gradient all-reduce to update() under gradient accumulation#5099NuojCheng wants to merge 2 commits into
NuojCheng wants to merge 2 commits into
