4 people dc8df110bc add warning when FP8 KV cache misses prefill query quantization (#39752) ...

Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris02.lyris.clusters.nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2026-04-14 14:43:05 -04:00

..

kernels

[Bugfix][Kernel][ROCm] Fix triton_w4a16 scales mismatch when BLOCK_K > group_size (#39705)

2026-04-13 14:29:45 -04:00

layers

add warning when FP8 KV cache misses prefill query quantization (#39752)

2026-04-14 14:43:05 -04:00

model_loader

[Bug] Fix TypeError when hf_config.architectures is None during model loading (#38849)

2026-04-13 12:13:21 +01:00

models

[PluggableLayer][3/N] Apply PluggableLayer to moe-related layers. (#33556)

2026-04-14 09:55:00 -04:00

offloader

Bugfix for offloading+prefetch for GLM-4.7-FP8 (#37178)

2026-03-17 21:22:09 +08:00

warmup

[MoE] Move DEEP_GEMM into experts/ subdirectory (#39005)

2026-04-08 19:23:08 +00:00

__init__.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

custom_op.py

Add ability to replace oot ops when using lora (#37181)

2026-03-16 18:04:15 -07:00

parameter.py

[Mypy] Fix mypy for vllm/model_executor (except vllm/model_executor/layers) (#37904)

2026-03-24 17:14:01 +00:00

utils.py

[BugFix] Fix EPLB fail for MoeFP4 model with Marlin backend (#33262)

2026-01-29 16:52:11 +08:00