All pull requests

Pull requests

• feat: add configurable prefill queue scheduling

  #1591·hiworldwzj opened Sep 23, 2026Collaborator·

  ·

• Wzj eplb draft testing.

  #1589·hiworldwzj opened Sep 22, 2026Collaborator·

  ·

• feat: add autotuned Triton causal conv1d

  #1586·shihaobai opened Sep 20, 2026Collaborator·

  ·

• Add ReplaySSM support for linear attention

  #1585·sufubao opened Sep 20, 2026Collaborator·

  ·

• feat: add GLM-5.3 Flash with MTP and vision support

  #1575·shihaobai opened Sep 15, 2026Collaborator·

  ·

• refactor: unify model configuration through Hugging Face config classes

  #1574·sufubao opened Sep 15, 2026Collaborator·

  ·

• fix(security): replace pickle deserialization with JSON in config_server WebSocket registration (GH-1563)

  #1568·Ashfaqbs opened Sep 12, 2026Contributor·

  ·
  1

• feat(mtp): add windowed draft KV cache for DFlash-style models

  #1566·Owleye4 opened Sep 11, 2026Collaborator·

  ·

• feat: add hardware platform and plugin support

  #1565·zhangts20 opened Sep 11, 2026Collaborator·

  ·
  1

• fix(cache): reuse historical CPU tail pages for hybrid attention

  #1564·sufubao opened Sep 11, 2026Collaborator·

  ·

• fix(server): stop bare excepts from swallowing cancellation and shutdown

  #1557·harshadkhetpal opened Sep 9, 2026·

  ·

• feat(mtp): add optional ASD acceptance policy for greedy MTP verification

  #1555·Kissmetothemoon opened Sep 9, 2026·

  ·
  2

• fix(sampling_params): reject out-of-range token ids at intake

  #1554·SuperMarioYL opened Sep 9, 2026Contributor·

  ·

• feat(mtp): support DFlash2 for Qwen3.8

  #1548·Owleye4 opened Sep 7, 2026Collaborator·

  ·

• Support request-level cache for hybrid sliding-window attention

  #1545·shihaobai opened Sep 4, 2026Collaborator·

  ·

• add eplb function

  #1531·blueswhen opened Sep 1, 2026Collaborator·

  ·

• fix(dp): wait forward before gather_req

  #1506·WANDY666 opened Aug 26, 2026Contributor·

  ·

• perf(pd): compact token forwarding packets

  #1487·WANDY666 opened Aug 24, 2026Contributor·

  ·

• perf(pd): omit unused output logprob metadata

  #1486·WANDY666 opened Aug 24, 2026Contributor·

  ·

• fix: apply x_stride1 in the rmsnorm normalize pass

  #1468·truong-v opened Aug 17, 2026Contributor·

  ·
  1

• feat: imbalance statistics

  #1466·blueswhen opened Aug 14, 2026Collaborator·

  ·

• fix(security): stop pickling the multinode ip handshake (GH-1413)

  #1458·DivyaNarahari97 opened Aug 11, 2026·

  ·

• fix(sampling): keep stop sequence token ids aligned with their strings

  #1456·DivyaNarahari97 opened Aug 10, 2026·

  ·

• Fix/allowed token ids validation

  #1455·DivyaNarahari97 opened Aug 10, 2026·

  ·

• fix(multinode): use JSON instead of pickle for node-IP exchange to prevent RCE

  #1419·Anai-Guo opened Aug 2, 2026·

  ·
  1

  1