jthomson04 1528e079e2 [Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826) ...

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>

2025-12-02 21:25:52 +00:00

..

attention

[Attention][CUDAGraph] Remove CG padding from attention backends (#29352)

2025-12-02 13:48:08 -05:00

core

[Core] Support reseting all running requests' KV while calling reset_prefix_cache (#28827)

2025-12-02 02:25:05 +00:00

engine

[Chore] Move tokenizer initialization methods (#29793)

2025-12-02 13:33:37 +08:00

executor

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

kv_offload

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

metrics

[Misc] Add ReplicaId to Ray metrics (#24267)

2025-12-02 03:21:44 +00:00

pool

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

sample

[Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826)

2025-12-02 21:25:52 +00:00

spec_decode

Add Mistral Large 3 and Ministral 3 (#29757)

2025-12-02 10:29:00 +00:00

structured_output

[Chore] Move tokenizer initialization methods (#29793)

2025-12-02 13:33:37 +08:00

worker

[Core] Eliminate redundant is_encoder_decoder lookups (20-40us/step) (#29800)

2025-12-02 07:08:07 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579)

2025-11-26 14:07:13 -05:00

kv_cache_interface.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

request.py

[Core] Support reseting all running requests' KV while calling reset_prefix_cache (#28827)

2025-12-02 02:25:05 +00:00

serial_utils.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00