4 people 263c4ff95f [Bugfix][Spec Decode] Cache the Mamba state at the block-grid position of EAGLE resume (#53945) ...

Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Adam Shaver <ashaver@nvidia.com>
Signed-off-by: akshaver <168006157+akshaver@users.noreply.github.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: roikoren755 <26850796+roikoren755@users.noreply.github.com>

2026-09-08 09:59:58 -04:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Bugfix][Spec Decode] Cache the Mamba state at the block-grid position of EAGLE resume (#53945)

2026-09-08 09:59:58 -04:00

async_llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

protocol.py

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00