3 people b544587408 [Core][Feat] Pluggable KVCacheConfigBuilder for platform/model-specific KV cache planning (#53558) ...

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>

2026-10-16 23:16:47 +00:00

..

prefix_cache

[Core][Mamba] Remove leftovers of mamba_cache_mode="all" (#60043)

2026-10-13 00:58:59 -07:00

__init__.py

Implement Async Scheduling (#19970)

2025-07-14 23:01:46 -07:00

test_async_scheduler.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

test_contiguous_kv_packing.py

[Core][Mamba] Remove leftovers of mamba_cache_mode="all" (#60043)

2026-10-13 00:58:59 -07:00

test_deferred_block_free.py

[Scheduler] Soften Long Prefill Tokens Threshhold (#57951)

2026-09-21 17:19:42 -07:00

test_encoder_cache_manager.py

[Bugfix][V1] Reject encoder-cache hits with mismatched embedding counts (#57696)

2026-09-24 08:40:47 +00:00

test_kv_cache_config_builder.py

[Core][Feat] Pluggable KVCacheConfigBuilder for platform/model-specific KV cache planning (#53558)

2026-10-16 23:16:47 +00:00

test_kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

test_kv_cache_planning.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

test_kv_cache_utils.py

[Perf][Core] Skip the null head of sliding-window block tables (#61724)

2026-10-15 16:14:51 -07:00

test_kv_sharing.py

[Refactor] Remove dead or duplicate tests (#58446)

2026-09-24 10:29:56 -04:00

test_mamba_align_chunk_split.py

[Misc] Rename --enable-mamba-fine-grained-prefix-cache (#53945 follow-up) (#57382)

2026-09-20 09:50:34 -07:00

test_output.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_prefix_caching.py

[Core][Mamba] Remove leftovers of mamba_cache_mode="all" (#60043)

2026-10-13 00:58:59 -07:00

test_prefix_replay.py

[Bugfix][DSv4.1] Skip SWA bounded replay for KV loads that carry the window (#59197)

2026-10-07 15:28:42 -07:00

test_priority_preemption_bug.py

fix: resolve silent request skipping in PRIORITY scheduling (#49206)

2026-08-06 22:21:21 +00:00

test_priority_scheduler_random.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

test_repetition_detection.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_reset_prefix_cache_e2e.py

[CI/Build][AMD] Use float16 in test_reset_prefix_cache_e2e to avoid accuracy issues (#29997)

2025-12-05 08:42:25 +00:00

test_scheduler_e2e.py

[CI] Replace large models with tiny alternatives in tests (#24057)

2025-10-16 15:51:27 +01:00

test_scheduler.py

[Spec Decode] Don't reserve DFlash/DSpark draft slots in the scheduler token budget (#59468)

2026-10-16 01:23:58 +08:00

test_single_type_kv_cache_manager.py

[Perf][Core] Skip the null head of sliding-window block tables (#61724)

2026-10-15 16:14:51 -07:00

test_swa_inflight_window_free.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_worker_slot_overflow.py

[Core] Rework scheduler skipped_waiting queue (#58947)

2026-09-28 20:03:16 +00:00

utils.py

[Core] Apply prefill_schedule_interval outside data parallelism (#54627)

2026-10-15 11:03:13 -05:00