rishitdholakia13andCursor 32e632dfeb [Reasoning] Optimize TPOT for thinking budget when used with speculative decoding (#46662) ...

Signed-off-by: rishitdholakia13 <rishit+github@cohere.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

2026-07-14 18:55:40 +00:00

..

logits_processor

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

ops

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in sampler kernels (#46560)

2026-06-24 11:00:57 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

metadata.py

[Reasoning] Support for speculative decoding with thinking budget (#34668)

2026-04-29 06:14:52 +00:00

rejection_sampler.py

[Reasoning] Optimize TPOT for thinking budget when used with speculative decoding (#46662)

2026-07-14 18:55:40 +00:00

sampler.py

[Reasoning] Optimize TPOT for thinking budget when used with speculative decoding (#46662)

2026-07-14 18:55:40 +00:00

thinking_budget_state.py

[Reasoning] Optimize TPOT for thinking budget when used with speculative decoding (#46662)

2026-07-14 18:55:40 +00:00