Michael GoinandClaude Opus 4.6 2f821faeae [Spec Decode] Support hybrid attention models in extract_hidden_states (#39949) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-13 10:45:53 -07:00

..

__init__.py

[V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359)

2025-02-16 09:39:08 -08:00

custom_class_proposer.py

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

dflash.py

[Spec Decode] Allow multimodal models with a warning (#41752)

2026-05-05 22:16:44 -07:00

draft_model.py

[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732)

2026-04-23 22:28:27 +00:00

eagle.py

[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732)

2026-04-23 22:28:27 +00:00

extract_hidden_states.py

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949)

2026-05-13 10:45:53 -07:00

gemma4.py

[Spec Decode] Add Gemma4 MTP speculative decoding support (#41745)

2026-05-06 22:39:29 +08:00

llm_base_proposer.py

[Models] Cohere Eagle + fix to Cohere MoE (#42078)

2026-05-08 21:46:26 -07:00

medusa.py

[CI] Enable mypy import following for vllm/spec_decode (#33282)

2026-01-30 06:43:32 +00:00

metadata.py

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

metrics.py

[Metrics] Some small refactoring for better maintainability (#33898)

2026-03-20 16:11:34 +00:00

ngram_proposer_gpu.py

[Perf][1/n] Eliminate various GPU<->CPU syncs (#41429)

2026-05-11 20:36:03 +00:00

ngram_proposer.py

[Performance] Split FlashAttn attention and cache update (#25954)

2026-01-23 17:28:06 -08:00

suffix_decoding.py

[CI] Enable mypy import following for vllm/spec_decode (#33282)

2026-01-30 06:43:32 +00:00

utils.py

[Feat] Unified Synthetic Acceptance Rate for V1 and V2 (#40662)

2026-04-24 00:48:08 +00:00