Wentao Ye 4988df2eb8 [Config] Update default _max_num_batched_tokens from 8192 to 16384 (#51726) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2026-08-11 11:09:34 -04:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Config] Update default _max_num_batched_tokens from 8192 to 16384 (#51726)

2026-08-11 11:09:34 -04:00

async_llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

protocol.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00