Nicolò Lucchesi a7156060c1 [Core] Make parallel sampling (n>1) reqs admission atomic (#53936) ...

Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>

2026-09-18 18:08:44 +02:00

..

__init__.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

admission_control.py

[Frontend] Share max_num_queued_reqs across API server processes (#54746)

2026-09-15 14:50:26 +00:00

async_llm.py

[Core] Make parallel sampling (n>1) reqs admission atomic (#53936)

2026-09-18 18:08:44 +02:00

coordinator.py

[Bugfix][DP] Don't assume the engines started when forwarding a wake (#51481)

2026-08-18 13:49:35 -07:00

core_client.py

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

core.py

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

detokenizer.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

exceptions.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

input_processor.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

llm_engine.py

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

logprobs.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

output_processor.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

parallel_sampling.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

tensor_ipc.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00