siyuandIsotr0py c723a831a8 [Fast Start] Cache the MTP draft model in a separate daemon group (#57312) ...

Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>

2026-09-22 03:13:38 +00:00

..

__init__.py

Test: added acceptance length tests (#32030)

2026-01-20 18:55:15 +00:00

test_acceptance_estimator.py

[Model Runner V2] Acceptance estimation for adaptive verification (#52228)

2026-09-14 15:58:48 -07:00

test_acceptance_length.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_adaptive_verification.py

[Model][ROCm] Enable DeepSeek V4 Vision (#55107)

2026-09-11 09:17:30 -07:00

test_backup_token_async_spec.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_dflash2.py

[Perf] Add fused DFlash2 grouped convolution (#55960)

2026-09-17 21:38:59 +00:00

test_dflash_causality.py

[Model] Add Cohere2MoE Eagle3 auxiliary hidden states (#49819)

2026-09-17 20:09:36 +00:00

test_dflash_lookahead.py

Fix DFlash prefix cache corruption due to missing lookahead block (#42971)

2026-06-02 12:06:33 +00:00

test_dflash_prepare_inputs.py

[MRV2] Revert explicit Triton JIT warmup migration (#56654)

2026-09-13 04:07:56 +00:00

test_draft_attention_backend_override.py

[Fast Start] Cache the MTP draft model in a separate daemon group (#57312)

2026-09-22 03:13:38 +00:00

test_draft_moe_backend_override.py

[Fast Start] Cache the MTP draft model in a separate daemon group (#57312)

2026-09-22 03:13:38 +00:00

test_dspark_topk.py

[Spec Decode] Add NVFP4 DSpark gathered top-k projection (#55713)

2026-09-09 17:33:46 +00:00

test_dynamic_sd_cug.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_dynamic_sd.py

Disable dynamic speculative decoding when DP is enabled (#45963)

2026-07-07 12:52:41 +00:00

test_eagle_draft_attn_metadata.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_eagle_step_kernel.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_eagle.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_extract_hidden_states.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_llm_base_proposer_sampling.py

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

test_llm_base_proposer.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_max_len.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_mtp_structured_output.py

[Refactor] StructuredOutputManager x Speculative Decoding Refactor (#48200)

2026-09-15 09:48:49 -04:00

test_mtp.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_ngram.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

test_rejection_sampler_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_request_acceptance.py

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

2026-08-20 15:42:49 -07:00

test_speculators_correctness.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_speculators_eagle3.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_synthetic_rejection_sampler_utils.py

[Feat] Unified Synthetic Acceptance Rate for V1 and V2 (#40662)

2026-04-24 00:48:08 +00:00

test_vocab_mapping.py

[Feature] Universal speculative decoding for heterogeneous vocabularies (TLI) (#38174)

2026-07-02 01:34:20 -07:00