Skip to content

[PyTorch] Type the grouped wgrad from main_grad for distributed weights - #3397

Open
fanshiqing wants to merge 4 commits into
NVIDIA:mainfrom
fanshiqing:shiqingf/fix_gtp_grad_reduce_in_fp32
Open

[PyTorch] Type the grouped wgrad from main_grad for distributed weights#3397
fanshiqing wants to merge 4 commits into
NVIDIA:mainfrom
fanshiqing:shiqingf/fix_gtp_grad_reduce_in_fp32

[PyTorch] Drop weight_grad_buffers; type distributed-weight wgrads vi…

1b2a404
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 16, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO