Skip to content

[FEATURE]: Allow cuda build on host without a device when TORCH_CUDA_ARCH_LIST is set #5300

Closed

Description

@ccoulombe

Describe the feature

When TORCH_CUDA_ARCH_LIST is set, allow gpu build to succeed by not searching for a device and resulting in

RuntimeError: No CUDA GPUs are available

when the host does not have a device.

This is especially important for HPC centre where build nodes may not have a GPU device, and where we build for multiple architectures.

Thanks!!

Activity

  1. JazyJiang commented on Oct 22, 2026

    @JazyJiang
    Collaborator

    Closing as completed. When no GPU is visible, the CUDA extension build now respects TORCH_CUDA_ARCH_LIST, and picks a default list from the CUDA version if it is unset (#6459). So BUILD_EXT=1 pip install . works on a GPU-less node. This is on main and will be in the next release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions