Woosuk Kwon b09bd69b5b [Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861)

2026-08-19 00:13:52 -07:00

..

dynamic

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

__init__.py

[V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359)

2025-02-16 09:39:08 -08:00

custom_class_proposer.py

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

dflash.py

Add Muse Glimmer model support (#51655)

2026-08-14 12:28:56 +08:00

draft_model.py

[Feature] Universal speculative decoding for heterogeneous vocabularies (TLI) (#38174)

2026-07-02 01:34:20 -07:00

eagle.py

[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732)

2026-04-23 22:28:27 +00:00

extract_hidden_states.py

[Perf] Avoid some more unnecessary GPU<->CPU syncs (#51458)

2026-08-08 17:13:26 -07:00

gemma4.py

[Tests][Spec Decode] Add gemma4 MTP acceptance rates test (#47920)

2026-07-27 16:15:54 -07:00

llm_base_proposer.py

[Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861)

2026-08-19 00:13:52 -07:00

medusa.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

metadata.py

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

metrics.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

ngram_proposer_gpu.py

[Perf] Optimize clamp to clamp_ (#48143)

2026-07-16 18:41:07 -04:00

ngram_proposer.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

step3p5.py

[Perf] Optimize clamp to clamp_ (#48143)

2026-07-16 18:41:07 -04:00

suffix_decoding.py

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

utils.py

[CPU] Skip Triton kernel monkey-patches when Triton-CPU is available (#44991)

2026-06-18 18:59:30 +08:00

vocab_mapping.py

[Feature] Universal speculative decoding for heterogeneous vocabularies (TLI) (#38174)

2026-07-02 01:34:20 -07:00