Skip to content

fix(config): support TCPStore startup in daemon workers - #1714

Open
shihaobai wants to merge 1 commit into
mainfrom
bsh/config-server-tcp-store
Open

shihaobai wants to merge 1 commit into
mainfrom
bsh/config-server-tcp-store

Conversation

@shihaobai

Copy link
Copy Markdown
Collaborator

Hypercorn daemon workers cannot start multiprocessing children, so ConfigServer TCPStore creation fails. Launch the store with a subprocess, monitor its original parent and reap it before replacement. Skip the local NCCL-port check when ConfigServer owns the store, allowing rank-zero restart.

Validation on main 9640f76: 51 CPU tests pass. With the image's Hypercorn 0.18, unmodified main returns HTTP 500; the fix passes initial creation and same-port replacement with real TCPStore roundtrips, and leaves no store child after Hypercorn exits.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant