3 people 1dc2d854c1 [Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227) ...

Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>

2026-09-18 15:01:24 -07:00

..

prefix_cache

[Test][Core] Add hybrid model prefix cache hit-rate coverage (#57127)

2026-09-16 19:17:45 -07:00

__init__.py

Implement Async Scheduling (#19970)

2025-07-14 23:01:46 -07:00

test_async_scheduler.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_contiguous_kv_packing.py

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

test_deferred_block_free.py

[Bugfix][Core] Stop zero-progress preemption cascades for deferred KV frees (#49675)

2026-09-11 00:40:10 +00:00

test_encoder_cache_manager.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

test_kv_cache_utils.py

[Bugfix][Metrics] Do not log a 0.0% prefix cache hit rate before any query (#54990)

2026-09-17 18:19:13 +00:00

test_kv_sharing.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_mamba_align_chunk_split.py

[Bugfix][Spec Decode] Cache the Mamba state at the block-grid position of EAGLE resume (#53945)

2026-09-08 09:59:58 -04:00

test_output.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_prefix_caching.py

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

test_prefix_replay.py

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

test_priority_preemption_bug.py

fix: resolve silent request skipping in PRIORITY scheduling (#49206)

2026-08-06 22:21:21 +00:00

test_priority_scheduler_random.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

test_repetition_detection.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_reset_prefix_cache_e2e.py

[CI/Build][AMD] Use float16 in test_reset_prefix_cache_e2e to avoid accuracy issues (#29997)

2025-12-05 08:42:25 +00:00

test_scheduler_e2e.py

[CI] Replace large models with tiny alternatives in tests (#24057)

2025-10-16 15:51:27 +01:00

test_scheduler.py

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

test_single_type_kv_cache_manager.py

[Bugfix] Fix incorrect Mamba block allocation estimate that prevents request admission (#57050)

2026-09-16 07:23:20 +00:00

test_swa_inflight_window_free.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_worker_slot_overflow.py

[BugFix][MRV2] Ensure all req slots are accounted for when scheduling (#46974)

2026-07-02 10:19:24 -07:00

utils.py

[Scheduler] Add --max-num-active-seqs to cap RUNNING admission (#56758)

2026-09-17 10:22:12 +08:00