Mark McLoughlin 340d7b1b21 [V1][Spec Decoding] Add num_drafts and num_accepted_tokens_per_position metrics (#16665) ...

Signed-off-by: Mark McLoughlin <markmc@redhat.com>

2025-04-24 08:57:40 -07:00

..

sched

[V1][Spec Decoding] Add num_drafts and num_accepted_tokens_per_position metrics (#16665)

2025-04-24 08:57:40 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

[V1][Minor] Optimize get_cached_block (#16135)

2025-04-06 20:48:14 +00:00

encoder_cache_manager.py

Enforce valid max_num_batched_tokens when disable_chunked_mm_input=True (#16447)

2025-04-11 08:09:52 +00:00

kv_cache_manager.py

[V1] Remove pre-allocation for KV cache (#16941)

2025-04-22 00:52:18 -07:00

kv_cache_utils.py

[Feature] Estimate max-model-len use available KV cache memory (#16168)

2025-04-08 19:12:51 -07:00

specialized_manager.py

[V1] Implement sliding window attention in kv_cache_manager (#14097)

2025-04-01 00:33:17 -07:00