3 people 0a94d85a66 [Bugfix][MRV2] Require all requests to be decoding for uniform-decode dispatch (#51865) ...

Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>

2026-08-11 17:15:06 -07:00

..

autoregressive

[Bugfix][MRV2] Require all requests to be decoding for uniform-decode dispatch (#51865)

2026-08-11 17:15:06 -07:00

dflash

[Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892)

2026-07-30 15:54:15 -07:00

dspark

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

2026-08-05 19:12:46 -07:00

eagle

[Bugfix] DFlash fc sized wrong when num_target_layers != num_hidden_layers (#48524)

2026-07-21 14:42:52 -07:00

gemma4

[Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786)

2026-06-27 18:38:07 -07:00

mtp

[Model Runner V2][MTP] Share topk index buffer between draft steps (#47352)

2026-08-10 15:46:13 -07:00

multi_module_mtp

[Bugfix][MRV2] Require all requests to be decoding for uniform-decode dispatch (#51865)

2026-08-11 17:15:06 -07:00

__init__.py

[Spec Decode] DSpark (#46995)

2026-07-01 08:30:24 -07:00

rejection_sampler_utils.py

[Model Runner V2] Fix -1 placeholder draft token ids in rejection sam… (#50939)

2026-08-06 16:32:00 -07:00

rejection_sampler.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

speculator.py

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

2026-08-05 19:12:46 -07:00

utils.py

[Perf] Use blocking CUDA events to avoid busy polling cuda driver lock (#47081)

2026-07-07 09:36:10 +00:00