Skip to content

[PyTorch] Quantize distributed BF16 weights in the fused grouped MLP - #3695

Open
xrennvidia wants to merge 2 commits into
NVIDIA:mainfrom
xrennvidia:xren/fused_grouped_mlp_gtp_bf16_weight_requant
Open

xrennvidia wants to merge 2 commits into
NVIDIA:mainfrom
xrennvidia:xren/fused_grouped_mlp_gtp_bf16_weight_requant

[PyTorch] Drop NVFP4 rowwise input copies from the fused grouped MLP …

8dcfa2e
Select commit
Loading
Failed to load commit list.