Murali AndoorveeduandSourashis Roy db66e018ea [Bugfix] Fix for Spec model TP + Chunked Prefill (#10232) ...

Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
Signed-off-by: Sourashis Roy <sroy@roblox.com>
Co-authored-by: Sourashis Roy <sroy@roblox.com>

2024-11-26 09:11:16 -08:00

..

block

Prefix Cache Aware Scheduling [1/n] (#10128)

2024-11-22 21:15:55 -08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

block_manager.py

Prefix Cache Aware Scheduling [1/n] (#10128)

2024-11-22 21:15:55 -08:00

evictor.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

interfaces.py

Prefix Cache Aware Scheduling [1/n] (#10128)

2024-11-22 21:15:55 -08:00

placeholder_block_space_manager.py

Prefix Cache Aware Scheduling [1/n] (#10128)

2024-11-22 21:15:55 -08:00

scheduler.py

[Bugfix] Fix for Spec model TP + Chunked Prefill (#10232)

2024-11-26 09:11:16 -08:00