MOVZXandHinata 41f6691c26 [Qwen4Exp] Host-resident token embedding tables (VLLM_HOST_EMBED_TABLE) ...

Keeps the token embedding table in pinned host memory behind a UVA view for the
stage-0 target and the last-stage MTP drafter, freeing GPU memory for KV. TP
sharding, masking and the all-reduce are retained. The knob is registered as a
compile-cache factor.

Co-Authored-By: Hinata <hinata@idihore.id>
Signed-off-by: MOVZX <movzx@yahoo.com>

2026-10-09 19:43:53 +07:00

..

attention

[Perf][PCP] Shard decode requests across PCP ranks (#52162)

2026-10-01 23:50:13 -04:00

fused_moe

[feat] FlashInfer CuteDSL MegaMoE integration (#54049)

2026-10-02 15:43:33 -04:00

fusion

[MM] Keep device input normalization fused when encoder compilation is enabled (#59195)

2026-09-30 11:08:24 +00:00

hpc

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

mamba

Merge remote-tracking branch 'upstream/main' into patches

2026-10-03 22:06:10 +07:00

minimax_rms_norm

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

pooler

[LoRA] Support variable num_labels for sequence classification (#57766)

2026-09-28 14:58:35 +00:00

quantization

[ROCm][Kimi-K3] Add opt-in gfx942 MXFP4-to-int4 conversion (#51274)

2026-10-03 14:28:02 +08:00

rotary_embedding

[CI][Bugfix] Relax packed_qk_rope_ correctness test to one ULP (#59008)

2026-09-28 17:29:59 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[ROCm] Use silu_and_mul_with_clamp's torch._C op (#52052)

2026-09-22 18:30:14 -05:00

attention_layer_base.py

[Bugfix][HiSparse] Fix MTP acceptance collapse under FULL graphs with a saturated GPU pool (#59309)

2026-10-01 23:04:21 -07:00

conv.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

fused_allreduce_gemma_rms_norm.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

fused_embed_norm.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

fused_qk_norm_rope.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

indexer_topk.py

[ROCm][Perf][GLM-5.3-Flash] Add AITER topk backend for decodes (#58167)

2026-10-02 11:47:41 +01:00

layernorm.py

[XPU] Dispatch nn.LayerNorm to fused SYCL kernel via CustomOp (#57172)

2026-09-30 12:19:33 +00:00

lightning_attn.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

linear.py

[ROCm][Bugfix] Revert #56433 + #51692 to fix accuracy breakdown for DeepSeek-V4 (#57132)

2026-09-16 18:58:23 +00:00

logits_processor.py

[SpecDecode] Add LiLiCorr drafter (#57934)

2026-09-25 10:08:28 -04:00

mhc.py

[ROCm][DSv4.1][Perf] Run the delayed mHC seams through aiter's fused Triton kernel (#58655)

2026-09-29 10:19:10 +08:00

mla.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

resampler.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

rocm_paged_mxfp4_indexer.py

[ROCm][DSv4.1] Paged MXFP4 sparse indexer on aiter's MQA-logits kernel (#58671)

2026-09-29 14:37:57 +08:00

sparse_attn_indexer.py

[Perf][PCP] Shard decode requests across PCP ranks (#52162)

2026-10-01 23:50:13 -04:00

sparse_mqa_indexer.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

utils.py

[CPU] Conv1d optimised kernel for aarch64 (#54093)

2026-09-30 20:23:42 +08:00

vocab_parallel_embedding.py

[Qwen4Exp] Host-resident token embedding tables (VLLM_HOST_EMBED_TABLE)

2026-10-09 19:43:53 +07:00