Issues

• Use standard Hugging Face environment variables.

  AI-Hypercomputer/jetstream-pytorch#210 · Filter by author arueth opened on Jun 4, 2025

• [Feature Request] Per request sampling params

  AI-Hypercomputer/jetstream-pytorch#185 · Filter by author qihqi opened on Sep 24, 2024
  3

  

• Make sure the server does not crash if the input is too long

  AI-Hypercomputer/jetstream-pytorch#183 · Filter by author qihqi opened on Sep 11, 2024

• [RFC] Formalizing commandline arguments.

  AI-Hypercomputer/jetstream-pytorch#182 · Filter by author qihqi opened on Sep 10, 2024
  

• Issues with prefill & generate

  AI-Hypercomputer/jetstream-pytorch#173 · Filter by author qihqi opened on Aug 21, 2024

• Error Running run_ray_serve_interleave with Llama3 8B

  AI-Hypercomputer/jetstream-pytorch#169 · Filter by author ryanaoleary opened on Aug 7, 2024

• Empty response returned for prompt responses when using run_server_with_ray.py and batch_size > 1

  AI-Hypercomputer/jetstream-pytorch#137 · Filter by author richardsliu opened on Jun 27, 2024
  2

• Checkpoint conversion script breaks for meta-llama/llama-2-7b on HF

  AI-Hypercomputer/jetstream-pytorch#135 · Filter by author vivianrwu opened on Jun 24, 2024

• Return Tuple(interleaveEngList, prefillEngineList, decodeEngineList) in create ray engine

  AI-Hypercomputer/jetstream-pytorch#107 · Filter by author FanhaiLu1 opened on May 29, 2024

• Add regression test to detect service broken and performance degradation

  AI-Hypercomputer/jetstream-pytorch#94 · Filter by author FanhaiLu1 opened on May 21, 2024
  2