Yizhou a311916a29 [MRV2][Spec] Fuse AR speculator multi-step decodes back into one CUDA graph (#46849) ...

Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>

2026-08-11 15:06:22 +08:00

..

autoregressive

[MRV2][Spec] Fuse AR speculator multi-step decodes back into one CUDA graph (#46849)

2026-08-11 15:06:22 +08:00

dflash

[Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892)

2026-07-30 15:54:15 -07:00

dspark

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

2026-08-05 19:12:46 -07:00

eagle

[Bugfix] DFlash fc sized wrong when num_target_layers != num_hidden_layers (#48524)

2026-07-21 14:42:52 -07:00

gemma4

[Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786)

2026-06-27 18:38:07 -07:00

mtp

[Model Runner V2][MTP] Share topk index buffer between draft steps (#47352)

2026-08-10 15:46:13 -07:00

multi_module_mtp

[Bugfix][Model Runner V2] Restore multimodal draft capability detection (#50417)

2026-08-03 14:18:14 -07:00

__init__.py

[Spec Decode] DSpark (#46995)

2026-07-01 08:30:24 -07:00

rejection_sampler_utils.py

[Model Runner V2] Fix -1 placeholder draft token ids in rejection sam… (#50939)

2026-08-06 16:32:00 -07:00

rejection_sampler.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

speculator.py

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

2026-08-05 19:12:46 -07:00

utils.py

[Perf] Use blocking CUDA events to avoid busy polling cuda driver lock (#47081)

2026-07-07 09:36:10 +00:00