6 people ff5f6d41b1 [Bugfix] Scale KV page size for hidden states extraction with TP (#50894) ...

Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Orestis Zambounis <orestis-z@users.noreply.github.com>
Signed-off-by: Orestis Zambounis <23146389+orestis-z@users.noreply.github.com>
Signed-off-by: Speculators Bot <bot@speculators.ai>
Signed-off-by: Speculators Bot <speculatorsbot@gmail.com>
Co-authored-by: Orestis Zambounis <orestis-z@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Speculators Bot <speculatorsbot@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-09-14 10:07:09 -04:00

..

sched

[Core] Fix ValueError on KV load failure with a hybrid KV cache (#50388)

2026-09-13 21:03:05 +08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_pool.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

encoder_cache_manager.py

[Bugfix][V1] Keep an encoder cache entry until its last occurrence is freed (#54284)

2026-08-29 05:08:01 +00:00

kv_cache_coordinator.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

kv_cache_manager.py

[Bugfix][KV Connector] MooncakeStore: exclude non-prefix-cacheable (QSA ring) groups; fix align-mode check (#55027)

2026-09-13 19:18:16 -07:00

kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

kv_cache_utils.py

[Bugfix] Scale KV page size for hidden states extraction with TP (#50894)

2026-09-14 10:07:09 -04:00

single_type_kv_cache_manager.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00