4 people 554340f3d3 [Attention] Support NVFP4 KV cache on SM8x and SM12x with FlashInfer (#46963) ...

Signed-off-by: lesj0610 <lesj0610@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: lesj0610 <lesj0610@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

2026-10-07 13:24:21 -04:00

..

basic_correctness

[Feature] Release the CUDA graph pool on sleep (#59160)

2026-10-04 01:13:10 +00:00

benchmarks

[Profiler] Add per-session profiling controls to Python and Rust frontends (#57875)

2026-10-06 05:21:19 +00:00

compile

[ROCm] Fuse MLA dual RMSNorm + FP8 group quant for DeepSeek-R1 (#54857)

2026-10-06 11:26:38 -05:00

config

[Bugfix][Quantization] Detect NVFP4 in ModelOpt mixed-precision checkpoints (#56050)

2026-10-02 12:30:22 +00:00

cuda

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

detokenizer

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

device_allocator

[Bugfix] Don't drop the rest of the allocator config when toggling expandable segments (#57982)

2026-09-25 17:34:19 -05:00

distributed

[Perf][MoE] Eliminate staging from NCCL symmetric reduce-scatter (#49194)

2026-10-06 07:37:01 -07:00

engine

[Security] Gate per-request multimodal processor kwargs (#58830)

2026-09-26 11:10:35 +00:00

entrypoints

[CI][RL] Consolidate RL entrypoint tests under tests/entrypoints/rl (#59948)

2026-10-07 08:29:09 +00:00

evals

[Misc] Add chat-completion options to gsm8k_eval.py CLI (#60114)

2026-10-06 20:13:44 +00:00

fusion

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ir

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

jit_monitor

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

kernels

[Attention] Support NVFP4 KV cache on SM8x and SM12x with FlashInfer (#46963)

2026-10-07 13:24:21 -04:00

lora

[LoRA] Remove tensorizer (#60024)

2026-10-05 07:01:56 -07:00

model_executor

[Bugfix][Model Loader] Support reload_weights with runai_streamer load format (#58124)

2026-10-07 14:04:35 +00:00

models

[CI] Bump Transformers version to 5.19.0 (#60381)

2026-10-07 10:01:41 -07:00

multimodal

[Security] Restrict Pillow image formats on untrusted media paths (#60022)

2026-10-05 10:40:15 +00:00

parser

[Frontend] Port the MiniMax M3 tool parser to the parser engine (#59743)

2026-10-06 05:46:27 +00:00

platforms

[CPU][GDN] Support NIXL DS convolution-state layout (#53300)

2026-09-24 14:55:20 +08:00

plugins

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

plugins_tests

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

prompts

…

quantization

[Quantization] Prefer Humming before Marlin backends on SM90 (#56997)

2026-10-06 12:31:35 -07:00

reasoning

[Frontend] Port Step-3.5 parsers to the streaming parser engine (#59321)

2026-10-01 22:18:37 +00:00

renderers

[CI] Add supports_multimodal_inputs to test_executor_replace's mock config (#59476)

2026-09-30 19:04:47 +00:00

rocm

[ROCm][CI] Add test coverage for VLLM_ROCM_MOE_PADDING memory-stride padding transparency (#59332)

2026-10-02 11:23:22 -05:00

samplers

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

spec_decode

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

standalone_tests

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

system_messages

…

tokenizers_

[Misc] Remove code paths for Transformers < 5.16.1 (#59762)

2026-10-02 11:17:24 +00:00

tool_parsers

[Rust Frontend] Remove the PyO3 tool-parser bridge (#59744)

2026-10-06 05:46:27 +00:00

tool_use

[Bugfix][Frontend] Malformed $defs in a tool schema should be a 400, not a 500 (#54850)

2026-10-06 01:37:20 +00:00

tools

[Agents] Add pre-commit check for agent files and skills (#59657)

2026-10-02 09:38:22 -07:00

tracing

[Refactor] Remove dead tests code (#58916)

2026-09-30 04:39:03 +00:00

transformers_utils

[Model] Use upstream GLM-5.3 and Qwen4-Exp configs and processor (#57387)

2026-10-02 02:25:18 +00:00

utils_

[Bugfix] Give each data-parallel engine its own global RNG streams (#59788)

2026-10-05 17:38:18 +00:00

v1

[Bugfix] Seed hybrid mamba state index with mamba_block_size on prefix-cache hits (#55601)

2026-10-07 17:09:50 +00:00

vllm_test_utils

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

watermarking

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

__init__.py

…

ci_envs.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

conftest.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

test_attention_backend_registry.py

[Attention] Require explicit DCP support from attention implementations (#55780)

2026-09-08 14:04:27 -07:00

test_audio_media_size_precheck.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

test_cmake_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_config.py

[ModelRunner V2] Speculative Decoding NGram GPU Implementations (#40704)

2026-10-06 13:32:59 -07:00

test_connections.py

Reject oversized media before fully downloading it (#51896)

2026-08-24 01:15:09 +00:00

test_embedded_commit.py

…

test_envs.py

[Bugfix][CPU] Fix macOS multimodal SHM cache initialization (#57142)

2026-09-18 09:05:13 +00:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

…

test_logger.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)

2026-08-26 21:00:54 +08:00

test_outputs.py

[Bugfix][Core] Preserve speculative metrics when coalescing outputs (#55708)

2026-10-07 08:35:14 +08:00

test_pcp_dp.py

[PCP] Support prefill context parallelism with data parallelism (#57075)

2026-09-23 22:32:36 -04:00

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Bugfix] Set breakable graph env before Ray actor import (#53293)

2026-08-28 23:11:50 +00:00

test_ray_env.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_regression.py

…

test_request_input_bounds.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_sampling_params.py

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_uvicorn_logging.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_version.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[CI] Allowlist-shrink batch 2: wire 9 tests/models/ files into Buildkite, fix 2 stale bugs found (#59050)

2026-10-06 21:16:53 -07:00

test_zentorch_version_pin.py

[ZenCPU][Test] Add zentorch/torch version pin consistency test (#52888)

2026-10-06 13:12:19 +08:00

utils.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00