3 people 46a83642f6 [Perf] Pin CPU tensors before non_blocking H2D in three MM paths (#54292) ...

Signed-off-by: Keyi Li <likey6688@gmail.com>
Co-authored-by: Keyi Li <likey6688@gmail.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>

2026-08-28 20:13:40 -07:00

..

__init__.py

[Bugfix][Model Loader] Defer post-load attention weight processing (#49519)

2026-08-10 19:16:57 -07:00

attention.py

Revert "[Kernel] Gemma-4 FA4 FP8 Kernel" (#52987)

2026-08-19 10:48:46 -07:00

chunked_local_attention.py

[Attention]: Use KVCacheSpec for AttentionMetadataBuilder type hints (#50148)

2026-07-31 11:20:18 +00:00

cross_attention.py

[Core] Avoid seq_lens_cpu GPU->CPU sync (#40654)

2026-04-24 00:35:55 +00:00

encoder_only_attention.py

[MyPy] Enable mypy for vllm/model_executor/layers/ (#40159)

2026-04-21 20:15:02 -07:00

kv_transfer_utils.py

[compile] Allow strings in custom ops without regressing compilation times (#38123)

2026-04-10 07:26:37 +00:00

mla_attention.py

[CPU][MLA] Fix prefill backend selection so MLA runs end-to-end on CPU (#51471)

2026-08-28 12:36:55 +08:00

mm_encoder_attention.py

[Perf] Pin CPU tensors before non_blocking H2D in three MM paths (#54292)

2026-08-28 20:13:40 -07:00

prefill_prefix_lm_attention.py

[Model] Add HrmTextForCausalLM (Hierarchical Reasoning Model — Text) (#43098)

2026-06-16 22:41:41 +08:00

rswa_attention.py

[Model] Support Unlimited OCR (#46564)

2026-06-27 23:09:18 -07:00

sparse_mla_attention.py

[Attention] Enable masked MHA for GLM-5 head dimensions (#53785)

2026-08-27 21:17:12 +00:00

sparse_mla_mask.py

[Attention] Vectorize sparse MLA mask loads (#52217)

2026-08-18 20:32:41 -07:00

static_sink_attention.py

[compile] Allow strings in custom ops without regressing compilation times (#38123)

2026-04-10 07:26:37 +00:00