Giancarlo DelfinandWoosuk Kwon 3d5f4d4cd5 [Perf][Spec Decode] Avoid triton recompiles in the acceptance estimator (#57107) ...

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>

2026-09-28 13:46:25 -07:00

..

autoregressive

[Perf][MRV2] Allow FULL decode graphs for one-token prompt tails (#58400)

2026-09-28 12:48:52 -07:00

dflash

[PCP][DCP] Support DCP target model with non-DCP Dspark (#56723)

2026-09-26 18:12:35 -04:00

dflash2

[SpecDecode] Add LiLiCorr drafter (#57934)

2026-09-25 10:08:28 -04:00

draft_model

[Model Runner V2][Spec Decode] Support spec decode with draft model (#43091)

2026-09-28 19:38:05 +00:00

dspark

[MRV2] Miscellaneous code cleanup (#57980)

2026-09-23 01:51:52 -07:00

eagle

[Fast Start] Cache the MTP draft model in a separate daemon group (#57312)

2026-09-22 03:13:38 +00:00

gemma4

[Kernel] Resubmit PR 48666 - Gemma4 FP8 KV FA4 head dim 512 backend selection (#53175)

2026-09-23 20:29:06 -07:00

lilicorr

[SpecDecode] Add LiLiCorr drafter (#57934)

2026-09-25 10:08:28 -04:00

mtp

[PCP][Spec Decode] Adds PCP support for single-module MTP and replicated DSpark. (#56107)

2026-09-10 22:07:53 -07:00

multi_module_mtp

[Perf][MRV2] Allow FULL decode graphs for one-token prompt tails (#58400)

2026-09-28 12:48:52 -07:00

__init__.py

[Model Runner V2][Spec Decode] Support spec decode with draft model (#43091)

2026-09-28 19:38:05 +00:00

acceptance_estimator.py

[Perf][Spec Decode] Avoid triton recompiles in the acceptance estimator (#57107)

2026-09-28 13:46:25 -07:00

adaptive_verification.py

[Spec Decode] Enable Gemma4 DSpark adaptive verification with FlashInfer (#57263)

2026-09-26 17:01:17 +08:00

extract_hidden_states.py

[Model Runner V2][Spec Decode] Skip DP sync before EAGLE/MTP draft prefill (#53694)

2026-08-26 20:59:35 -07:00

rejection_sampler_utils.py

[SpecDecode] Restore residual-logits comments in _resample_kernel (#58166)

2026-09-22 08:07:31 -07:00

rejection_sampler.py

[Bugfix][MRV2][Spec Decode] Reject draft slots that were never proposed (#58784)

2026-09-28 13:07:15 -07:00

speculator.py

[Model Runner V2][Spec Decode] Support spec decode with draft model (#43091)

2026-09-28 19:38:05 +00:00

utils.py

[Bugfix][Spec Decode] Avoid fastsafetensors deadlock for PP draft models (#54416)

2026-09-12 14:22:30 +08:00