Wei ZhaoandMichael Goin 2e693f48e7 [Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307) ...

Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2026-03-12 07:32:31 -07:00

..

basic_correctness

Make Gemma and Gemma 2 accept inputs_embeds like Gemma 3 (#36787)

2026-03-11 18:12:43 +00:00

benchmarks

[Benchmark] Simplify SLA scan (#35306)

2026-02-25 22:35:41 -08:00

compile

[torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551)

2026-03-11 10:56:55 -07:00

config

[Bugfix] Exclude language_model_only key from MM AOT compile hash but include in model one (#34508)

2026-02-13 13:59:00 +00:00

cuda

[Bugfix] Fix CUDA compatibility path setting for both datacenter and consumer NVIDIA GPUs (#33992)

2026-02-25 18:15:51 -08:00

detokenizer

[CI/Build] Remove use of skip_v1 (#34699)

2026-02-18 12:19:11 +08:00

distributed

Fix ExaoneMoeMTP test that never ran in Transformers v4 (#36792)

2026-03-11 17:10:23 +00:00

engine

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

entrypoints

[CI] Fix mypy for vllm/reasoning (#35742)

2026-03-12 12:21:33 +00:00

evals

[ROCm][CI] Fix ROCm GPT-OSS Eval test group (#36179)

2026-03-09 17:55:20 -07:00

kernels

[Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307)

2026-03-12 07:32:31 -07:00

lora

[ROCm][CI] Accept Different But Valid Output for test_olmoe_tp (#35224)

2026-03-07 13:50:52 -08:00

model_executor

[Bugfix][Model] Fix FP8 k_scale/v_scale not loaded for Qwen3-MoE (#35656)

2026-03-04 13:15:38 +00:00

models

[Bugfix][Model] Fix DeepSeek-OCR TensorSchema crash on empty images_crop (#36670)

2026-03-12 15:35:54 +08:00

multimodal

[Refactor] Modular video loader backend refactoring (#35202)

2026-03-06 06:06:59 -08:00

plugins

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

plugins_tests

[Examples][1/n] Resettle basic examples. (#35579)

2026-03-08 20:22:53 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[CI] Bump mypy version to 1.19.1 (#36104)

2026-03-10 09:18:28 -07:00

reasoning

[NemotronH] Small fix reasoning parser (#36635)

2026-03-11 02:44:41 -07:00

renderers

[bugfix] add api process rank in default multimodal request (#36150)

2026-03-06 12:00:09 +00:00

rocm/aiter

[Bugfix][Hardware][AMD] Fix exception types in AITER MLA FP8 check (#31177)

2026-01-06 14:10:59 +08:00

samplers

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153)

2026-03-06 01:16:56 -08:00

standalone_tests

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514)

2026-02-17 12:22:56 +00:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

[Bugfix] Fix Qwen-VL tokenizer implementation (#36140)

2026-03-05 08:07:19 -08:00

tool_parsers

[Bugfix] Fix minimax_m2 tool parser when stream interval > 1 (#35895)

2026-03-12 10:25:14 +08:00

tool_use

[Bugfix] Fix minimax_m2 tool parser when stream interval > 1 (#35895)

2026-03-12 10:25:14 +08:00

tools

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[Deprecation][1/2] Remove items deprecated in v0.18 (#36470)

2026-03-09 03:43:23 -07:00

utils_

[BugFix] avoid infinite loop with VLLM_PORT and get_open_ports_list (#36191)

2026-03-05 22:15:29 -08:00

v1

[CI] Fix mypy for vllm/reasoning (#35742)

2026-03-12 12:21:33 +00:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[Nightly CI] Remove CT Model (#33530)

2026-02-01 19:09:09 -08:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[V0 Deprecation] Remove unused swap_space parameter (#36216)

2026-03-07 22:09:55 +08:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289)

2025-12-10 14:13:01 -05:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Refactor] Move task outside of PoolingParams.verify (#33796)

2026-02-05 09:33:11 +00:00

test_ray_env.py

[Ray] Propagate third-party env vars to Ray workers via prefix matching (#34383)

2026-02-17 01:08:42 -08:00

test_regression.py

[ROCm][CI] Prep Tests For Change To ROCM_ATTN As New Default Backend On ROCm (#36025)

2026-03-09 13:27:55 -05:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

[Tests] Skip model weight download for render-only test server (#36813)

2026-03-12 06:24:42 +00:00