3 people 238cb2b191 [Perf][GLM-5.3-Flash] Dense/masked-MHA sparse prefill for the NoPE (256, 0, 256) layout + skip the NoPE K concat (#55738) ...

Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-09-14 09:36:39 +00:00

..

attention

[Perf][GLM-5.3-Flash] Dense/masked-MHA sparse prefill for the NoPE (256, 0, 256) layout + skip the NoPE K concat (#55738)

2026-09-14 09:36:39 +00:00

fused_moe

[Bugfix][CPU] Fix DeepSeek-R1 (FP8 MLA + MoE) correctness on CPU backend (#56773)

2026-09-14 17:30:28 +08:00

fusion

[Model] Support DeepSeek-V4.1-Flash (#56214)

2026-09-11 02:11:19 -07:00

hpc

[Kernel] Remove unused fake implementation (#55535)

2026-09-06 17:54:32 -07:00

mamba

[6/N][warmup][DSv4] Migrate sampling, and DFlash JIT kernels (#56323)

2026-09-12 17:24:24 -07:00

minimax_rms_norm

[ROCm][MiniMax-M2] Dispatch fused QK-norm + AllReduce via AITER (#44849)

2026-07-14 03:10:16 +00:00

pooler

[Bugfix] Honor STEP token pooling in DispatchPooler.for_seq_cls (#55307)

2026-09-08 04:13:09 +00:00

quantization

[Refactor] Normalize DeepSeek V4.1 model package naming (#56741)

2026-09-13 23:17:50 -07:00

rotary_embedding

[Bugfix] Align vLLM YaRN with Transformers and stop re-scaling max_model_len (#56446)

2026-09-11 13:01:38 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Performance] Add Triton kernel for Gemma3n sparse GELU (#48498)

2026-09-14 07:42:15 +00:00

attention_layer_base.py

[3/N][KV-Cache Layout Refactor] Standardize Mamba cache; drop get_transfer_cache_regions (#44456)

2026-07-21 09:16:15 +00:00

conv.py

[Refactor] Remove multiple dead codes (#50285)

2026-08-03 10:59:08 -04:00

fused_allreduce_gemma_rms_norm.py

[ROCm][Perf][M3] Fused allreduce+GemmaRMSNorm fast path (#54787)

2026-09-08 07:21:49 +00:00

fused_embed_norm.py

Replicated embedding and norm fusion for DSV3 flat model (#48484)

2026-08-18 14:53:21 +08:00

fused_qk_norm_rope.py

[Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)

2026-08-24 18:28:49 -07:00

indexer_topk.py

[Perf][Kernel] Integrate DeepSelect TopK for the DSA sparse indexer (#56464)

2026-09-13 00:44:37 -07:00

layernorm.py

[XPU] Add fused GemmaRMSNorm path for eager execution (#53678)

2026-09-03 06:11:20 +08:00

lightning_attn.py

[Kernel][Test] Extend lightning_attn and awq_triton kernel tests to XPU (#43307)

2026-06-04 14:25:59 -04:00

linear.py

[ROCm][Bugfix] Fix AITER preshuffled FP8 block-scale kernel (#56433)

2026-09-11 11:44:57 +00:00

logits_processor.py

[Hy4] support Hy4-preview model (#54160)

2026-08-29 12:07:28 +08:00

mhc.py

[ROCm][DSV4.1][Perf] Use AITER mHC for the delayed pre block (#56503)

2026-09-12 00:35:48 +00:00

mla.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer_kpool.py

[PCP][DCP] Enable PCP+DCP on sparse-MLA models (#56157)

2026-09-12 23:24:44 +00:00

sparse_attn_indexer.py

[Perf][Kernel] Integrate DeepSelect TopK for the DSA sparse indexer (#56464)

2026-09-13 00:44:37 -07:00

utils.py

[ROCm][Bugfix][Perf] Tune multi-stream shared experts use; wvSplitKrc fixes (#56098)

2026-09-10 15:14:22 -07:00

vocab_parallel_embedding.py

[Qwen4Exp] Support UVA PLE-offload and Engram tensor parallelism (#54371)

2026-09-09 07:32:34 -07:00