Michael GoinandNick Hill ac36a7a1e7 [MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-07-23 18:13:13 +08:00

..

logits_processor

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

ops

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

metadata.py

[Reasoning] Support for speculative decoding with thinking budget (#34668)

2026-04-29 06:14:52 +00:00

rejection_sampler.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

sampler.py

[Reasoning] Optimize TPOT for thinking budget when used with speculative decoding (#46662)

2026-07-14 18:55:40 +00:00

thinking_budget_state.py

[Reasoning] Optimize TPOT for thinking budget when used with speculative decoding (#46662)

2026-07-14 18:55:40 +00:00