You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
MiniMax H3 transformer does not expose attention masks for padded joint sequences #14870
MiniMaxH3TransformerBlock.forward accepts an attention_mask, but MiniMaxH3Transformer3DModel.forward does not. Standard Ulysses context parallelism needs masked padding when the packed text/video/audio sequence length is not divisible by the parallel degree. The copied forward used by verl-omni #635 is a temporary workaround that may break on a Diffusers upgrade.
The assertion fails because the argument is absent.
Expected behavior
Accept an optional boolean key-padding mask and pass it to every transformer block, including during gradient checkpointing. Calls without a mask should remain unchanged.
Activity