Nick Hill 3aee6573dc [V1] Aggregate chunked prompt logprobs in model runner (#14875) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-03-24 12:27:57 -04:00

..

sched

[V1] Aggregate chunked prompt logprobs in model runner (#14875)

2025-03-24 12:27:57 -04:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

encoder_cache_manager.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

kv_cache_manager.py

[V1] Prompt logprobs + APC compatibility; prompt logprobs reqs cannot fill APC (#13949)

2025-03-08 01:48:12 +00:00

kv_cache_utils.py

[v1] Refactor KVCacheConfig (#14079)

2025-03-21 04:56:27 -07:00