vLLM/tests/v1/kv_connector/unit at 382970ee6ca490aeaaaf4e32c53695b581ff61ba - vLLM

offloading_connector

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423 )

2026-09-21 09:56:11 -07:00

__init__.py

[P/D] NIXL Integration (#17751 )

2025-05-12 09:46:16 -07:00

conftest.py

[CI][Test] Mock CPU backend block sizes in kv_connector unit conftest (#56671 )

2026-09-14 18:48:53 +08:00

test_bidirectional_kv_transfer.py

[Nixl] Separate transport-failure metrics from KV expiry (#55854 )

2026-09-18 18:08:59 +02:00

test_cache_pollution_prevention.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_config.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_decode_bench_connector.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_error_propagation.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_example_connector.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_flexkv_connector.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_handshake_pp_aggregation.py

[MM] Move supports_multimodal_inputs and cache out of registry (#57913 )

2026-09-21 07:43:07 -07:00

test_hf3fs_client.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_hf3fs_connector.py

[Bugfix] Fix np.float64 leaking into the KV transfer metrics log (#57068 )

2026-09-16 18:09:05 +00:00

test_hf3fs_metadata_server.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_hidden_states_connector.py

[Bugfix][KVConnector] Make ExampleHiddenStatesConnector abort-safe (#56841 )

2026-09-18 21:53:02 +00:00

test_hisparse_connector.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_hisparse_stats.py

[4/N] Expose HiSparse cache metrics via KV connector stats (#56061 )

2026-09-12 10:47:55 -07:00

test_hma_auto_config.py

[KV Transfer] Enable HMA by default for connectors that support it (#41847 )

2026-05-26 12:28:51 +02:00

test_invalid_blocks_correctness.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_kv_connector_lifecycle.py

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949 )

2026-05-13 10:45:53 -07:00

test_kv_load_failure_recovery.py

[Bugfix][NIXL] Avoid receive reports for notification-only requests (#57570 )

2026-09-18 13:33:02 -07:00

test_lmcache_connector.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_lmcache_integration.py

[V0 Deprecation] Deprecate virtual engine (#37195 )

2026-03-18 14:30:14 -07:00

test_mooncake_connector_hma.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_mooncake_connector_hybrid_mamba.py

[Bugfix][KV Connector] Fix Mooncake physical-block transfer length (#54272 )

2026-09-01 13:23:46 -07:00

test_mooncake_connector.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_mooncake_stats.py

[Bugfix] Fix np.float64 leaking into the KV transfer metrics log (#57068 )

2026-09-16 18:09:05 +00:00

test_mooncake_store_connector.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_mooncake_store_coordinator.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_mooncake_store_hma_e2e.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_mooncake_store_layout.py

[KV Connector] Support heterogeneous TP sharing in Mooncake Store Connector (#53129 )

2026-09-01 10:18:06 -07:00

test_mooncake_store_scheduler.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_mooncake_store_worker.py

[Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242 )

2026-09-17 13:16:41 +08:00

test_moriio_connector.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_hma_scheduler.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_kv_layout.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_proxy_routing.py

[Bugfix] MoRIIO toy P/D proxy: fix DP-rank index aliasing + harden for high-concurrency bursts (#46115 )

2026-07-17 12:35:04 -07:00

test_moriio_routing_fairness.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_moriio_routing.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_toy_proxy_server.py

[Bugfix] MoRIIO toy P/D proxy: add /health (#45222 )

2026-07-14 22:56:46 +00:00

test_moriio_tp_ack.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_transfer_completion.py

[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode (#51052 )

2026-09-20 17:30:34 -04:00

test_moriio_unmap.py

llmd+vllm+mori-ep(inter node wide-ep)+mori-io(write) for 2p2d with dp=ep=16 tp=1 (#45043 )

2026-08-04 00:13:15 +00:00

test_multi_connector.py

[Nixl] Separate transport-failure metrics from KV expiry (#55854 )

2026-09-18 18:08:59 +02:00

test_nixl_connector_hma.py

[Bugfix][NIXL] Fix DCP pulls across MLA cache regions (#57389 )

2026-09-21 11:57:49 -04:00

test_nixl_connector.py

[Bugfix][NIXL] Avoid receive reports for notification-only requests (#57570 )

2026-09-18 13:33:02 -07:00

test_nixl_desc_geometry.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_nixl_heartbeat.py

[Nixl][PD] Lease renewal TTL KV blocks on P (#41383 )

2026-05-11 09:27:30 +00:00

test_nixl_push_connector.py

[Nixl] Separate transport-failure metrics from KV expiry (#55854 )

2026-09-18 18:08:59 +02:00

test_nixl_rocm_gpu_mem_diag.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_nixl_simple_cpu_offload.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_offloading_connector.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_output_aggregator.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_remote_decode_lifecycle.py

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

test_remote_prefill_lifecycle.py

[BugFix][KV Connector] Fix Deadlock with KVConnector + MTP under KV Pressure (#57104 )

2026-09-16 22:22:07 +00:00

test_scheduler_kv_connector_override.py

[Core][KV Connector] Resolve connector block tables for every scheduled request (#54853 )

2026-09-09 02:15:53 +00:00

test_simple_cpu_offload_connector.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_tp_mapping.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212 )

2026-09-16 10:57:24 -07:00

test_transfer_topology_sharded.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718 )

2026-08-21 17:47:49 -07:00

utils.py

[BugFix][KV Connector] Fix Deadlock with KVConnector + MTP under KV Pressure (#57104 )

2026-09-16 22:22:07 +00:00