sychen52 947138b6c2 Add nvfp4 kv cache support (#40177) ...

Signed-off-by: Shiyang Chen <shiychen@nvidia.com>

2026-05-01 04:55:16 +00:00

..

attention

[Attention][TurboQuant] Share dequant buffers, eliminate float16_copy (#40941)

2026-04-27 13:48:36 +08:00

fla

[Bugfix] correct h matrix layout in chunk_kda output kernel (#40956)

2026-04-30 16:22:41 +08:00

fused_moe

[Kernel][MoE] Support GELU on TRT-LLM NvFP4 fused MoE for Gemma4 (#41050)

2026-05-01 03:37:43 +00:00

mamba

[Bugfix ] fix bailing_moe_linear (#40859)

2026-04-27 22:39:23 -07:00

pooler

[Perf] Optimize AllPool.forward by slicing first, 51% faster in the method level benchmark (#41163)

2026-04-29 08:11:04 -07:00

quantization

Add nvfp4 kv cache support (#40177)

2026-05-01 04:55:16 +00:00

rotary_embedding

[Bugfix] Fix repeated DSv4 RoPE cache initialization (#41148)

2026-04-29 20:29:55 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[DSV4] Add silu clamp limit to shared expert (#40950)

2026-04-27 00:37:43 -07:00

attention_layer_base.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

batch_invariant.py

[BE][Torch 2.12] Remove workaround code for fixed cublas issue (#40845)

2026-04-28 21:07:24 -07:00

conv.py

[Misc] Always use forward_mulmat for Conv3d on newer versions of torch. (#38487)

2026-03-30 05:39:41 +00:00

deepseek_compressor.py

[DSV4] Enable Multi-stream for Pre-Attn GEMM (#41061)

2026-04-28 09:08:55 -07:00

deepseek_v4_attention.py

[DeepSeek] Use torch.mm for bf16xbf16->fp32 gemm (#41300)

2026-04-30 16:28:57 -07:00

kda.py

[MyPy] Enable mypy for vllm/model_executor/layers/ (#40159)

2026-04-21 20:15:02 -07:00

layernorm.py

[MyPy] Enable mypy for vllm/model_executor/layers/ (#40159)

2026-04-21 20:15:02 -07:00

lightning_attn.py

[Bugfix] Use null block (0) for padded block table entries (#35431)

2026-03-30 14:02:51 -07:00

linear.py

[Model] Add MiMo-V2.5 support (#40967)

2026-04-27 13:26:51 +00:00

logits_processor.py

[PluggableLayer][3/N] Apply PluggableLayer to llm_head and vocab embedding layer (#33465)

2026-04-10 16:12:59 +08:00

mhc.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

mla.py

[Feature]: IndexCache support for DSA models (#37735)

2026-04-29 15:15:35 -04:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

utils.py

[DeepSeek] Use torch.mm for bf16xbf16->fp32 gemm (#41300)

2026-04-30 16:28:57 -07:00

vocab_parallel_embedding.py

Bug/test eagle dp v0 (#38938)

2026-04-13 20:50:08 +00:00