Chauncey f0fbc98c48 [Frontend] Share max_num_queued_reqs across API server processes (#54746) ...

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

2026-09-15 14:50:26 +00:00

..

__init__.py

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

2026-08-20 15:42:49 -07:00

admission_control.py

[Frontend] Share max_num_queued_reqs across API server processes (#54746)

2026-09-15 14:50:26 +00:00

async_llm.py

[Frontend] Share max_num_queued_reqs across API server processes (#54746)

2026-09-15 14:50:26 +00:00

coordinator.py

[Bugfix][DP] Don't assume the engines started when forwarding a wake (#51481)

2026-08-18 13:49:35 -07:00

core_client.py

[Elastic EP] Reuse CUDA graphs across reconfiguration (#54985)

2026-09-12 10:26:39 -04:00

core.py

[Refactor] Remove utils dead code (#53941)

2026-09-08 11:22:09 -04:00

detokenizer.py

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391)

2026-07-23 18:14:06 +08:00

exceptions.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

input_processor.py

[Bugfix] Validate routed-expert prompt offsets before engine submission (#56844)

2026-09-15 09:17:41 +08:00

llm_engine.py

[warmup] overlap renderer warmup and engine core initialization (#54557)

2026-09-03 19:44:21 +00:00

logprobs.py

[Feature][DSpark]: Logprobs adaptive verification (#52242)

2026-08-25 10:22:33 -04:00

output_processor.py

[Frontend] Share max_num_queued_reqs across API server processes (#54746)

2026-09-15 14:50:26 +00:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

tensor_ipc.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[ROCm] Give EngineCore cleanup grace after request abort (#52281)

2026-08-19 11:39:59 -05:00