7 people 02e55d2af3 [KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169) ...

Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

2026-10-09 15:48:37 -04:00

..

dynamic

[V1][Spec Decode] Add Dynamic SD (#32374)

2026-06-14 00:14:27 -07:00

__init__.py

[V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359)

2025-02-16 09:39:08 -08:00

custom_class_proposer.py

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

dflash.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

draft_model.py

[PCP][DCP] Support DCP target model with non-DCP Dspark (#56723)

2026-09-26 18:12:35 -04:00

eagle.py

[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732)

2026-04-23 22:28:27 +00:00

extract_hidden_states.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

gemma4.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

llm_base_proposer.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

medusa.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

metadata.py

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

metrics.py

[Doc][Metrics] Fix spec-decode PromQL examples to use the exposed names (#55016)

2026-09-14 21:15:28 +00:00

ngram_proposer_gpu.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ngram_proposer.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

step3p5.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

suffix_decoding.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

vocab_mapping.py

[Perf] Remove CPU-GPU sync in heterogeneous vocabulary speculative decoding (#57396)

2026-09-22 18:34:19 -04:00