4 people 01af92e175 [Feature][Model Runner V2] Support extract_hidden_states speculation (#49811) ...

Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>

2026-08-20 11:13:43 -04:00

..

autoregressive

[Bugfix][MRV2] Require all requests to be decoding for uniform-decode dispatch (#51865)

2026-08-11 17:15:06 -07:00

dflash

[Spec decode] Support Kimi-K3 DCP with DSpark (#52188)

2026-08-17 13:08:45 -07:00

dspark

[Bugfix][Spec Decode] DSpark: inherit the target's attention backend when the speculative config names none (#52288)

2026-08-15 09:32:59 +08:00

eagle

[Bugfix] DFlash fc sized wrong when num_target_layers != num_hidden_layers (#48524)

2026-07-21 14:42:52 -07:00

gemma4

Revert "[Kernel] Gemma-4 FA4 FP8 Kernel" (#52987)

2026-08-19 10:48:46 -07:00

mtp

[Model Runner V2][MTP] Share topk index buffer between draft steps (#47352)

2026-08-10 15:46:13 -07:00

multi_module_mtp

[Bugfix][MRV2] Require all requests to be decoding for uniform-decode dispatch (#51865)

2026-08-11 17:15:06 -07:00

__init__.py

[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)

2026-08-20 11:13:43 -04:00

adaptive_verification.py

[Spec Decode] DSpark confidence-scheduled verification (#47808)

2026-08-12 12:27:48 -07:00

extract_hidden_states.py

[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)

2026-08-20 11:13:43 -04:00

rejection_sampler_utils.py

[Model Runner V2][Spec Decode] Fix draft logits cache column stride in gumbel_sample (#53017)

2026-08-19 17:39:30 -07:00

rejection_sampler.py

[Spec Decode] DSpark confidence-scheduled verification (#47808)

2026-08-12 12:27:48 -07:00

speculator.py

[Spec decode] Support Kimi-K3 DCP with DSpark (#52188)

2026-08-17 13:08:45 -07:00

utils.py

[Perf] Use blocking CUDA events to avoid busy polling cuda driver lock (#47081)

2026-07-07 09:36:10 +00:00