Woosuk Kwon e9af6ba62a [Model Runner V2] Optimize Gumbel Sampling Kernel (#29210) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2025-11-21 15:52:28 -08:00

..

gpu

[Model Runner V2] Optimize Gumbel Sampling Kernel (#29210)

2025-11-21 15:52:28 -08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

cpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

cpu_worker.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

dp_utils.py

[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for device selection on cuda-like devices (#27564)

2025-10-30 11:41:44 -04:00

ec_connector_model_runner_mixin.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

gpu_input_batch.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

gpu_model_runner.py

[Core] Align whisper closer to other multimodal models (#27292)

2025-11-21 12:01:54 +00:00

gpu_ubatch_wrapper.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

gpu_worker.py

GPU Model Runner V2 (#25266)

2025-11-21 08:20:55 -08:00

kv_connector_model_runner_mixin.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

lora_model_runner_mixin.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_input_batch.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_model_runner.py

Revert "[Redo] #26368 (#28771)" (#29121)

2025-11-20 21:27:45 -08:00

tpu_worker.py

[Misc] Move dynamic seed initialization to EngineArgs (#29165)

2025-11-21 15:27:44 +00:00

ubatch_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ubatching.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

utils.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

worker_base.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

xpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

xpu_worker.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00