Nick Hill 26587f9519 [BugFix][ModelRunner V2] Fix stale attn metadata in speculator prefill cudagraph capture (#48261) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-07-13 09:39:15 -07:00

..

autoregressive

[BugFix][ModelRunner V2] Fix stale attn metadata in speculator prefill cudagraph capture (#48261)

2026-07-13 09:39:15 -07:00

dflash

[BugFix][ModelRunner V2] Fix stale attn metadata in speculator prefill cudagraph capture (#48261)

2026-07-13 09:39:15 -07:00

dspark

[Spec Decode] Support hybrid (SWA + full attention) DFlash drafters (#47914)

2026-07-08 11:12:45 -04:00

eagle

[Spec Decode] Support hybrid (SWA + full attention) DFlash drafters (#47914)

2026-07-08 11:12:45 -04:00

gemma4

[Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786)

2026-06-27 18:38:07 -07:00

mtp

[Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786)

2026-06-27 18:38:07 -07:00

__init__.py

[Spec Decode] DSpark (#46995)

2026-07-01 08:30:24 -07:00

rejection_sampler_utils.py

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in block verification kernels (#47383)

2026-07-02 07:32:38 -07:00

rejection_sampler.py

[Model Runner V2][Spec Decode] Implement block verification for rejection sampling (#46781)

2026-06-30 08:07:24 -07:00

speculator.py

[BugFix][ModelRunner V2] Fix stale attn metadata in speculator prefill cudagraph capture (#48261)

2026-07-13 09:39:15 -07:00

utils.py

[Perf] Use blocking CUDA events to avoid busy polling cuda driver lock (#47081)

2026-07-07 09:36:10 +00:00