3 people 957d512e96 [Bugfix][Frontend] Preserve streaming chunk boundaries in RequestOutputCollector (#58941) ...

Signed-off-by: David Cheung <d7cheung@gmail.com>
Co-authored-by: Benedikt Falk <bfalk@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-10-15 16:38:28 +00:00

..

__init__.py

[RL][Frontend] Return token-level weight-version spans on final outputs (#59582)

2026-10-11 11:33:29 +08:00

admission_control.py

[Frontend] Share max_num_queued_reqs across API server processes (#54746)

2026-09-15 14:50:26 +00:00

async_llm.py

[Bugfix][Frontend] Preserve streaming chunk boundaries in RequestOutputCollector (#58941)

2026-10-15 16:38:28 +00:00

coordinator.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

core_client.py

[Bugfix] Terminate streaming sessions on ABORT/ERROR and prevent zombie sessions (#58942)

2026-10-15 13:32:19 +00:00

core.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

detokenizer.py

[Bugfix][Spec Decode] Trim token_ids/logprobs left past a stop string under speculative decoding (#47616)

2026-10-09 14:22:31 -07:00

exceptions.py

[Frontend] Clean Client Facing 500 Report (#58043)

2026-10-14 14:27:58 -04:00

input_processor.py

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

llm_engine.py

[RL][Frontend] Return token-level weight-version spans on final outputs (#59582)

2026-10-11 11:33:29 +08:00

logprobs.py

[Feature] Add fixed-token prefill scoring (#54335)

2026-09-28 07:50:09 -07:00

output_processor.py

[Bugfix][Frontend] Preserve streaming chunk boundaries in RequestOutputCollector (#58941)

2026-10-15 16:38:28 +00:00

parallel_sampling.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

tensor_ipc.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[Bugfix] Eliminate frontend ZMQ port TOCTOU with inherited listeners (#54113)

2026-10-08 06:25:27 +00:00