vLLM/tests/v1/kv_connector/unit at c19c263ac8ea3fd6e1d2d689f0e4e725855d89cf - vLLM

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183 )

2026-10-13 03:05:39 +00:00

__init__.py

2025-05-12 09:46:16 -07:00

conftest.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169 )

2026-10-09 15:48:37 -04:00

test_bidirectional_kv_transfer.py

[XPU] limit FA kernel block size to multipleOf 64 (#57297 )

2026-10-12 10:25:32 +08:00

test_cache_pollution_prevention.py

[Metrics] Expose cached prompt tokens by cache tier (#56318 )

2026-10-06 14:52:05 -04:00

test_config.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_decode_bench_connector.py

[PCP][DCP] Support DCP target model with non-DCP Dspark (#56723 )

2026-09-26 18:12:35 -04:00

test_error_propagation.py

[Metrics] Expose cached prompt tokens by cache tier (#56318 )

2026-10-06 14:52:05 -04:00

test_example_connector.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_flexkv_connector.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_handshake_pp_aggregation.py

[Bugfix][EPD] Skip sampling for encoder-only async steps (#58490 )

2026-09-27 20:35:09 -07:00

test_hf3fs_client.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_hf3fs_connector.py

[Bugfix] Fix np.float64 leaking into the KV transfer metrics log (#57068 )

2026-09-16 18:09:05 +00:00

test_hf3fs_metadata_server.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_hidden_states_connector.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183 )

2026-10-13 03:05:39 +00:00

test_hisparse_connector.py

[Bugfix][HiSparse] Fix TP group hang on steps without scheduled tokens (#60941 )

2026-10-12 17:38:12 +00:00

test_hisparse_stats.py

[HiSparse] Report host-pool block residency as HiSparse metrics (#59485 )

2026-10-09 16:45:34 -06:00

test_hma_auto_config.py

[KV Transfer] Enable HMA by default for connectors that support it (#41847 )

2026-05-26 12:28:51 +02:00

test_invalid_blocks_correctness.py

[Metrics] Expose cached prompt tokens by cache tier (#56318 )

2026-10-06 14:52:05 -04:00

test_kv_connector_lifecycle.py

[Attention] Remove cascade attention (#61126 )

2026-10-12 10:41:07 -07:00

test_kv_load_failure_recovery.py

[Metrics] Expose cached prompt tokens by cache tier (#56318 )

2026-10-06 14:52:05 -04:00

test_lmcache_connector.py

[Bugfix][KVConnector] Finalize saves on steps without a forward (#57775 )

2026-09-25 00:06:36 +00:00

test_lmcache_integration.py

[V0 Deprecation] Deprecate virtual engine (#37195 )

2026-03-18 14:30:14 -07:00

test_mooncake_connector_hma.py

[XPU] limit FA kernel block size to multipleOf 64 (#57297 )

2026-10-12 10:25:32 +08:00

test_mooncake_connector_hybrid_mamba.py

[XPU] limit FA kernel block size to multipleOf 64 (#57297 )

2026-10-12 10:25:32 +08:00

test_mooncake_connector.py

[XPU] limit FA kernel block size to multipleOf 64 (#57297 )

2026-10-12 10:25:32 +08:00

test_mooncake_stats.py

[Bugfix] Fix np.float64 leaking into the KV transfer metrics log (#57068 )

2026-09-16 18:09:05 +00:00

test_mooncake_store_connector.py

[Metrics] Expose cached prompt tokens by cache tier (#56318 )

2026-10-06 14:52:05 -04:00

test_mooncake_store_coordinator.py

[Bugfix][Mooncake] Use the EAGLE replay boundary when retaining sliding-window tails (#61012 )

2026-10-11 09:15:18 +00:00

test_mooncake_store_hma_e2e.py

[Bugfix][Mooncake] Save the EAGLE attention proof with hybrid Mamba partial tails (#60695 )

2026-10-10 00:08:08 +00:00

test_mooncake_store_layout.py

[KV Connector] Support heterogeneous TP sharing in Mooncake Store Connector (#53129 )

2026-09-01 10:18:06 -07:00

test_mooncake_store_scheduler.py

[Bugfix][Mooncake] Save the EAGLE attention proof with hybrid Mamba partial tails (#60695 )

2026-10-10 00:08:08 +00:00

test_mooncake_store_worker.py

[Bugfix][Mooncake] Save the EAGLE attention proof with hybrid Mamba partial tails (#60695 )

2026-10-10 00:08:08 +00:00

test_moriio_connector.py

[Bugfix][MoRIIO] Prevent remote KV reload after decoder preemption (#53250 )

2026-10-08 22:28:16 +08:00

test_moriio_hma_scheduler.py

[MoRIIO] Require pending remote prefill for READ cache hits (#60638 )

2026-10-13 20:19:53 +08:00

test_moriio_kv_layout.py

[Bugfix][KV Connector][ROCm] Fix MoRI-IO KV block-offset for speculative decoding (MTP) (#55053 )

2026-10-07 11:33:30 -05:00

test_moriio_proxy_routing.py

[Bugfix][MoRIIO] Keep discovery heartbeats running while workers hold the GIL (#59441 )

2026-10-03 14:55:18 +00:00

test_moriio_routing_fairness.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_moriio_routing.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_toy_proxy_server.py

[Bugfix] MoRIIO toy P/D proxy: add /health (#45222 )

2026-07-14 22:56:46 +00:00

test_moriio_tp_ack.py

[Bugfix][MoRIIO] Keep discovery heartbeats running while workers hold the GIL (#59441 )

2026-10-03 14:55:18 +00:00

test_moriio_transfer_completion.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_unmap.py

llmd+vllm+mori-ep(inter node wide-ep)+mori-io(write) for 2p2d with dp=ep=16 tp=1 (#45043 )

2026-08-04 00:13:15 +00:00

test_moriio_write_done_routing.py

[Bugfix][KVConnector] Fix MoRI-IO WRITE-mode requests stranded in WAITING_FOR_REMOTE_KVS (#57705 )

2026-10-12 22:29:31 +00:00

test_multi_connector.py

[XPU] limit FA kernel block size to multipleOf 64 (#57297 )

2026-10-12 10:25:32 +08:00

test_nixl_connector_hma.py

[XPU] limit FA kernel block size to multipleOf 64 (#57297 )

2026-10-12 10:25:32 +08:00

test_nixl_connector.py

[Attention] Remove cascade attention (#61126 )

2026-10-12 10:41:07 -07:00

test_nixl_desc_geometry.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169 )

2026-10-09 15:48:37 -04:00

test_nixl_heartbeat.py

[Bugfix][KV Connector] Reap expired NIXL leases behind a heartbeated head (#58292 )

2026-09-25 17:23:44 +00:00

test_nixl_push_connector.py

[Bugfix][NIXL] Recover locally invalidated pull peer metadata (#55471 )

2026-10-05 18:46:53 -07:00

test_nixl_rocm_gpu_mem_diag.py

[ROCm] Fix CI runtime and tests for MI355 DPX (#58244 )

2026-09-24 23:15:11 -05:00

test_nixl_simple_cpu_offload.py

[Metrics] Expose cached prompt tokens by cache tier (#56318 )

2026-10-06 14:52:05 -04:00

test_offloading_connector.py

[Core][Mamba] Remove leftovers of mamba_cache_mode="all" (#60043 )

2026-10-13 00:58:59 -07:00

test_output_aggregator.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_remote_decode_lifecycle.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_remote_prefill_lifecycle.py

[Core][Mamba] Remove leftovers of mamba_cache_mode="all" (#60043 )

2026-10-13 00:58:59 -07:00

test_scheduler_kv_connector_override.py

[Core][KV Connector] Resolve connector block tables for every scheduled request (#54853 )

2026-09-09 02:15:53 +00:00

test_simple_cpu_offload_connector.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_simple_cpu_offload_metrics.py

[Metrics][KV Offload] Add Prometheus metrics for SimpleCPUOffloadConnector (#57251 )

2026-09-26 17:17:11 -07:00

test_tp_mapping.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_transfer_topology_sharded.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718 )

2026-08-21 17:47:49 -07:00

utils.py

[XPU] limit FA kernel block size to multipleOf 64 (#57297 )

2026-10-12 10:25:32 +08:00