Wushi Dong 0037b5746a [Core] Eliminate redundant is_encoder_decoder lookups (20-40us/step) (#29800) ...

Signed-off-by: Wushi Dong <dongws@meta.com>

2025-12-02 07:08:07 +00:00

..

gpu

[Model Runner V2] Use packed mask for prompt bin counts (#29756)

2025-11-30 14:15:42 -08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Bugfix] Fix block size in block_table with PCP (#29094)

2025-11-22 01:34:28 +00:00

cpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

cpu_worker.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

dp_utils.py

[BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698)

2025-11-28 20:19:01 -08:00

ec_connector_model_runner_mixin.py

[Doc]: fixing typos in multiple files. (#29685)

2025-11-28 08:41:41 -08:00

gpu_input_batch.py

[Core] Support reseting all running requests' KV while calling reset_prefix_cache (#28827)

2025-12-02 02:25:05 +00:00

gpu_model_runner.py

[Core] Eliminate redundant is_encoder_decoder lookups (20-40us/step) (#29800)

2025-12-02 07:08:07 +00:00

gpu_ubatch_wrapper.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

gpu_worker.py

[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783)

2025-11-30 14:24:25 +08:00

kv_connector_model_runner_mixin.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342)

2025-11-26 10:53:15 -07:00

lora_model_runner_mixin.py

[LoRA] Cleanup LoRA unused code (#29611)

2025-11-28 22:52:58 -08:00

tpu_input_batch.py

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

tpu_model_runner.py

[Core] Enable inputs_embeds_size separate from hidden_size (#29741)

2025-11-30 17:31:12 +08:00

tpu_worker.py

[TPU] add tpu_inference (#27277)

2025-11-26 14:46:36 -08:00

ubatch_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ubatching.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

utils.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

worker_base.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

xpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

xpu_worker.py

Make PyTorch profiler gzip and CUDA time dump configurable (#29568)

2025-12-01 04:30:46 +00:00