Nick HillandNicolò Lucchesi 1b15df2546 [BugFix] Fix handling of num_computed_tokens with connector (#18232) ...

Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

2025-05-19 09:03:25 -07:00

..

sched

[BugFix] Fix handling of num_computed_tokens with connector (#18232)

2025-05-19 09:03:25 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

[V1][Metrics] add support for kv event publishing (#16750)

2025-04-30 07:44:45 -07:00

encoder_cache_manager.py

Enforce valid max_num_batched_tokens when disable_chunked_mm_input=True (#16447)

2025-04-11 08:09:52 +00:00

kv_cache_manager.py

[v1] Support multiple KV cache groups in GPU model runner (#17945)

2025-05-14 18:54:54 -07:00

kv_cache_utils.py

[v1] Support multiple KV cache groups in GPU model runner (#17945)

2025-05-14 18:54:54 -07:00

single_type_kv_cache_manager.py

[v1][KVCacheManager] Avoid full cache hit by controlling max_length (#17999)

2025-05-13 06:50:38 +00:00