4 people 512f522192 [Model] Gemma4: add bidirectional vision attention for sliding layers with window guard (#40534) ...

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Luciano Martins <lucianomartins@google.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2026-04-24 08:27:46 +00:00

..

gpu

[MRV2] Ensure warmup covers prefill path (#40746)

2026-04-24 01:33:26 +00:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

Fix Mamba state corruption from referencing stale block table entries (#37728) (#37728) (#37728)

2026-03-24 10:29:59 -07:00

cp_utils.py

[Bug] Fix dcp error message (#40053)

2026-04-20 10:52:32 -04:00

cpu_model_runner.py

[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732)

2026-04-23 22:28:27 +00:00

cpu_worker.py

[CPU] Refactor CPU affinity and memory management (#39781)

2026-04-17 21:01:08 +08:00

dp_utils.py

[Refactor] Clean up log once scope="local" (#40540)

2026-04-22 16:42:43 -04:00

ec_connector_model_runner_mixin.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

encoder_cudagraph_defs.py

[MM][Perf][CG] Support ViT full CUDA graph for Qwen3-VL video inference (#38061)

2026-04-14 16:49:32 +08:00

encoder_cudagraph.py

[MM][CG] Optimize default max_frames_per_batch auto-infer for ViT CUDA graph video inference (#40445)

2026-04-21 14:47:53 +00:00

gpu_input_batch.py

Generative Scoring (#34539)

2026-03-31 16:02:11 -07:00

gpu_model_runner.py

[Model] Gemma4: add bidirectional vision attention for sliding layers with window guard (#40534)

2026-04-24 08:27:46 +00:00

gpu_ubatch_wrapper.py

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980)

2026-04-08 18:56:32 -07:00

gpu_worker.py

[Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware (#40193)

2026-04-23 14:57:03 +00:00

kv_connector_model_runner_mixin.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

lora_model_runner_mixin.py

[Bugfix] LoRA for DeepSeek V3.2 (#35077)

2026-04-22 19:33:50 +08:00

mamba_utils.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

tpu_input_batch.py

[Cleanup] Remove unused ModelRunner V1 InputBatch.num_tokens field (#30218)

2025-12-18 09:17:00 -08:00

ubatch_utils.py

[Core] Avoid seq_lens_cpu GPU->CPU sync (#40654)

2026-04-24 00:35:55 +00:00

ubatching.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479)

2026-04-14 19:57:13 -07:00

worker_base.py

Measure encoder compile time seperate from llm backbone (#39240)

2026-04-14 10:52:49 -04:00

workspace.py

[Bugfix] Fix workspace resize leaking reserved GPU memory (#39226)

2026-04-23 20:50:05 +00:00

xpu_model_runner.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

xpu_worker.py

[XPU] check is_xccl_available before oneccl warmup (#39302)

2026-04-09 12:42:17 -07:00