3 people dedbf6be8b [V1][Metrics] Preserve prefix-cache stats on zero-output steps (#48668) ...

Signed-off-by: Rishi Puri <riship@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-08-09 01:58:38 +00:00

..

__init__.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

async_llm.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

coordinator.py

[Elastic EP] Async preparation (#47288)

2026-07-28 05:19:13 -07:00

core_client.py

[Frontend] Watch frontend processes during engine startup (#43417)

2026-08-06 11:17:24 -07:00

core.py

[BugFix] Dense multinode DP rescope with regression test (#49212)

2026-08-05 18:12:03 -07:00

detokenizer.py

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391)

2026-07-23 18:14:06 +08:00

exceptions.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

input_processor.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

llm_engine.py

[V1][Metrics] Preserve prefix-cache stats on zero-output steps (#48668)

2026-08-09 01:58:38 +00:00

logprobs.py

[Model Runner V2] Add logprob_token_ids support (#40559)

2026-05-01 10:02:03 -07:00

output_processor.py

[Frontend] expose stream_interval as req sampling param (#49754)

2026-07-27 11:30:37 +08:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

tensor_ipc.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[BugFix] Reject invalid data-parallel RPC ports (#51469)

2026-08-08 12:23:26 +08:00