Repository navigation
CollectiveX: give b200-nscale DeepEP V2 its RDMA rate from the registry / CollectiveX:从注册表为 b200-nscale 的 DeepEP V2 提供 RDMA 速率 - #4639
Merged
Conversation
…ry / CollectiveX:从注册表为 b200-nscale 的 DeepEP V2 提供 RDMA 速率 The vLLM v0.32.0 image does not ship ibstat, so DeepEP V2's SM model read a scale-out rate of 0 on b200-nscale and normal-mode EP16 died with ZeroDivisionError in get_theoretical_num_sms, as it did on h200-dgxc before #4615. The registry now sets rdma_gbs to 50 GB/s, the per-GPU rate of the pool's 400 Gb/s InfiniBand rails. Two comments that still said the override applies only on EFA now say it applies wherever the registry sets rdma_gbs. vLLM v0.32.0 镜像不包含 ibstat,导致 b200-nscale 上 DeepEP V2 的 SM 模型读到的 scale-out 速率为 0, normal 模式 EP16 在 get_theoretical_num_sms 中因 ZeroDivisionError 失败,与 #4615 之前 h200-dgxc 的情况相同。注册表现在将 rdma_gbs 设为 50 GB/s,即该资源池 400 Gb/s InfiniBand 链路的每 GPU 速率。 两处仍称该覆盖仅适用于 EFA 的注释,改为说明它适用于注册表设置了 rdma_gbs 的所有资源池。
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
On b200-nscale, DeepEP V2 normal-mode EP16 (
b200-nscale-deepep-v2-{bf16,fp8}-n2) fails increate_buffer:The vLLM v0.32.0 image has no
ibstat, so DeepEP's SM model reads a scale-out rate of 0. This is the same failure #4615 fixed on h200-dgxc.platform_config.json: b200-nscalenetwork.rdma_gbs = 50, the per-GPU rate of its 400 Gb/s InfiniBand rails (what theibstatprobe would derive).methodology.mdlists b200-nscale with the pools that take the rate from the registry.ep_deepep_v2.pythat said the override is EFA-only now say it applies whereverrdma_gbsis set.EP8 is single-node, so the model never uses the scale-out rate there and its SM count is unchanged. Low-latency mode does not use the model.
python -m pytest collectivex/tests: 249 passed, 12 skipped. The two shards will be rerun on b200-nscale from this branch.中文
在 b200-nscale 上,DeepEP V2 normal 模式 EP16(
b200-nscale-deepep-v2-{bf16,fp8}-n2)在create_buffer中失败:DeepEP 的 SM 模型因 vLLM v0.32.0 镜像不含ibstat而读到 scale-out 速率为 0,在get_theoretical_num_sms中触发 ZeroDivisionError。这与 #4615 在 h200-dgxc 上修复的问题相同。platform_config.json:b200-nscale 设置network.rdma_gbs = 50,即其 400 Gb/s InfiniBand 链路的每 GPU 速率(也是ibstat探测会得出的值)。methodology.md将 b200-nscale 列入从注册表获取速率的资源池。ep_deepep_v2.py中两处称该覆盖仅适用于 EFA 的注释,改为适用于所有设置了rdma_gbs的情况。EP8 为单节点,模型不使用 scale-out 速率,SM 数量不变;low-latency 模式不使用该模型。
python -m pytest collectivex/tests:249 通过,12 跳过。两个分片将在 b200-nscale 上基于此分支重新运行。AI disclosure
This change was diagnosed and written with an AI coding assistant, and reviewed by the author.