Benjamin Chislett 4c5bc41ba6 [Bugfix][Spec Decode] Fix probabilistic sampling for parallel drafting (#45956) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

2026-06-24 05:36:23 +00:00

..

dynamic

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

__init__.py

[V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359)

2025-02-16 09:39:08 -08:00

custom_class_proposer.py

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

dflash.py

[Core][Model] Gemma4: Unified FA4 for all layers + FlashAttention mm_prefix support (#42175)

2026-06-09 17:45:39 -07:00

draft_model.py

[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732)

2026-04-23 22:28:27 +00:00

eagle.py

[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732)

2026-04-23 22:28:27 +00:00

extract_hidden_states.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

gemma4.py

[Bugfix] Fix Gemma4 MTP block_table batch_size mismatch under concurrent load (#43982)

2026-06-03 17:11:10 -07:00

llm_base_proposer.py

[Bugfix][Spec Decode] Fix probabilistic sampling for parallel drafting (#45956)

2026-06-24 05:36:23 +00:00

medusa.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

metadata.py

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

metrics.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

ngram_proposer_gpu.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

ngram_proposer.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

step3p5.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

suffix_decoding.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

utils.py

[CPU] Skip Triton kernel monkey-patches when Triton-CPU is available (#44991)

2026-06-18 18:59:30 +08:00