[Sched] Enhance the logic to remove stopped requests from queues (#20739)

This commit is contained in:
Woosuk Kwon
2025-07-12 15:33:13 -07:00
committed by GitHub
parent 6e2c176e1f
commit f45a332886
3 changed files with 92 additions and 17 deletions
+1 -1
View File
@@ -7,7 +7,7 @@ requests >= 2.26.0
tqdm
blake3
py-cpuinfo
transformers >= 4.51.1
transformers >= 4.53.2
huggingface-hub[hf_xet] >= 0.33.0 # Required for Xet downloads.
tokenizers >= 0.21.1 # Required for fast incremental detokenization.
protobuf # Required by LlamaTokenizer.