ChaunceyandNick Hill 72c0d67657 [Feat] Support thinking_token_budget in Model Runner V2 (#46727) ...

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-08-07 03:36:18 +00:00

..

autoregressive

[Bugfix][Model Runner V2] Restore multimodal draft capability detection (#50417)

2026-08-03 14:18:14 -07:00

dflash

[Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892)

2026-07-30 15:54:15 -07:00

dspark

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

2026-08-05 19:12:46 -07:00

eagle

[Bugfix] DFlash fc sized wrong when num_target_layers != num_hidden_layers (#48524)

2026-07-21 14:42:52 -07:00

gemma4

[Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786)

2026-06-27 18:38:07 -07:00

mtp

Revert "[Perf][GLM-5.2] Blackwell decode optimizations" (#49768)

2026-07-24 16:04:59 -07:00

multi_module_mtp

[Bugfix][Model Runner V2] Restore multimodal draft capability detection (#50417)

2026-08-03 14:18:14 -07:00

__init__.py

[Spec Decode] DSpark (#46995)

2026-07-01 08:30:24 -07:00

rejection_sampler_utils.py

[Model Runner V2] Fix -1 placeholder draft token ids in rejection sam… (#50939)

2026-08-06 16:32:00 -07:00

rejection_sampler.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

speculator.py

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

2026-08-05 19:12:46 -07:00

utils.py

[Perf] Use blocking CUDA events to avoid busy polling cuda driver lock (#47081)

2026-07-07 09:36:10 +00:00