Luciano MartinsandLuciano Martins 979f5511d7 [Bugfix][Gemma4] Keep image bidirectional attention within the sliding window (#47217) ...

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>

2026-07-02 19:57:41 -07:00

..

cpu

[CPU] Remove speculative decoding stream overrides from CPUModelRunner (#47162)

2026-07-01 06:12:49 +00:00

gpu

[ModelRunner V2][BugFix] Free all model refs on shutdown (#47483)

2026-07-02 19:32:48 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

cp_utils.py

[Bug] Fix dcp error message (#40053)

2026-04-20 10:52:32 -04:00

cpu_model_runner.py

[CPU] Remove speculative decoding stream overrides from CPUModelRunner (#47162)

2026-07-01 06:12:49 +00:00

cpu_worker.py

[CPU][Spec Decode] Warn about throughput loss when libiomp5 is not preloaded (#44419)

2026-06-08 03:45:08 -07:00

dp_utils.py

[Perf][1/n] Eliminate various GPU<->CPU syncs (#41429)

2026-05-11 20:36:03 +00:00

ec_connector_model_runner_mixin.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

encoder_cudagraph_defs.py

[MM][Perf][CG] Support dual-path ViT full CUDA graph for DeepSeek-OCR (#43586)

2026-06-16 04:35:20 -07:00

encoder_cudagraph.py

[MM][Perf][CG] Support dual-path ViT full CUDA graph for DeepSeek-OCR (#43586)

2026-06-16 04:35:20 -07:00

gpu_input_batch.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

gpu_model_runner.py

[Bugfix][Gemma4] Keep image bidirectional attention within the sliding window (#47217)

2026-07-02 19:57:41 -07:00

gpu_ubatch_wrapper.py

[ROCm][DeepEP] Stabilize high-throughput DBO for DP+EP (#46990)

2026-06-29 14:28:02 -07:00

gpu_worker.py

Weight sync refactor + move sparse nccl engine (#44353)

2026-07-01 01:25:19 -07:00

kv_connector_model_runner_mixin.py

[Spec Decode] Support mixed KV page sizes for DFlash (#45181)

2026-06-21 22:45:14 +08:00

lora_model_runner_mixin.py

[Bugfix] LoRA for DeepSeek V3.2 (#35077)

2026-04-22 19:33:50 +08:00

mamba_utils.py

[Model Runner V2] support mamba hybrid models align prefix cache (#42406)

2026-06-29 14:09:16 -07:00

tpu_input_batch.py

[Cleanup] Remove unused ModelRunner V1 InputBatch.num_tokens field (#30218)

2025-12-18 09:17:00 -08:00

ubatch_utils.py

[BugFix] Preserve max_seq_len in ubatch metadata during CUDA graph capture (#40961)

2026-05-05 04:29:34 +00:00

ubatching.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[Model Runner V2] Support zeroing freshly allocated KV blocks for hybrid + fp8 KVCache (#43990)

2026-06-02 05:56:53 +00:00

worker_base.py

Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)

2026-06-20 13:38:10 -07:00

workspace.py

[Bugfix] Fix workspace resize leaking reserved GPU memory (#39226)

2026-04-23 20:50:05 +00:00

xpu_model_runner.py

[Platform] Replace torch.cuda.Event with torch.Event (#47140)

2026-06-30 08:39:59 -07:00

xpu_worker.py

[XPU] Optimize XPU worker shutdown logic to prevent resource leak (#46433)

2026-06-30 15:27:21 +08:00