Wei Zhao 6748217fb9 [Bugfix] Fix Kimi K3 NVFP4 MoE weight conversion OOM (#55407) ...

Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>

2026-09-07 11:45:25 +08:00

..

attention

[Kernel] Remove unused fake implementation (#55535)

2026-09-06 17:54:32 -07:00

fused_moe

[ROCm][Perf][DeepSeek V4] Fuse native FP8 shared expert with MXFP4 routed experts (#53161)

2026-09-06 19:42:21 -07:00

fusion

[Fusion] Manual ActivationQuantFusionPass initial application (#51415)

2026-09-03 13:37:31 -04:00

hpc

[Kernel] Remove unused fake implementation (#55535)

2026-09-06 17:54:32 -07:00

mamba

[Kernel] Remove unused fake implementation (#55535)

2026-09-06 17:54:32 -07:00

minimax_rms_norm

[ROCm][MiniMax-M2] Dispatch fused QK-norm + AllReduce via AITER (#44849)

2026-07-14 03:10:16 +00:00

pooler

[Perf] Avoid h2d copies from non-pinned CPU tensors (#54299)

2026-08-29 12:06:30 +08:00

quantization

[Bugfix] Fix Kimi K3 NVFP4 MoE weight conversion OOM (#55407)

2026-09-07 11:45:25 +08:00

rotary_embedding

[Kernel] Remove unused fake implementation (#55535)

2026-09-06 17:54:32 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[XPU] Route activation CustomOps to SYCL kernels (#53734)

2026-09-01 09:19:52 +08:00

attention_layer_base.py

[3/N][KV-Cache Layout Refactor] Standardize Mamba cache; drop get_transfer_cache_regions (#44456)

2026-07-21 09:16:15 +00:00

conv.py

[Refactor] Remove multiple dead codes (#50285)

2026-08-03 10:59:08 -04:00

fused_allreduce_gemma_rms_norm.py

buffer size insuffient Dspark sd for FlashInfer MNNVL allreduce (#50932)

2026-08-27 11:01:08 -04:00

fused_embed_norm.py

Replicated embedding and norm fusion for DSV3 flat model (#48484)

2026-08-18 14:53:21 +08:00

fused_qk_norm_rope.py

[Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)

2026-08-24 18:28:49 -07:00

layernorm.py

[XPU] Add fused GemmaRMSNorm path for eager execution (#53678)

2026-09-03 06:11:20 +08:00

lightning_attn.py

[Kernel][Test] Extend lightning_attn and awq_triton kernel tests to XPU (#43307)

2026-06-04 14:25:59 -04:00

linear.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00

logits_processor.py

[Hy4] support Hy4-preview model (#54160)

2026-08-29 12:07:28 +08:00

mhc.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

mla.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer_kpool.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

sparse_attn_indexer.py

[Perf][Kernel] Tune cooperative topk for medium batch-sizes (#53382)

2026-08-31 13:44:38 -07:00

utils.py

[Bugfix][CPU] Fix several bugs (#54042)

2026-08-31 15:33:06 +08:00

vocab_parallel_embedding.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00