3 people f648eed23d [Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810) ...

Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

2026-09-20 10:58:55 +00:00

..

basic_correctness

[XPU] sleep mode: fix KV cache release test (#57485)

2026-09-18 15:49:17 +00:00

benchmarks

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

compile

[Bugfix] Max-load throughput cliff when max_num_seqs is not a multiple of 8 (#57355)

2026-09-17 18:09:18 +00:00

config

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

cuda

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

detokenizer

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

distributed

[XPU][UT]Fix test_mnnvl_alltoall device and distributed backend (#57591)

2026-09-20 10:53:00 +08:00

engine

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

entrypoints

[Deprecation] Remove assistant_token_mask support (#57520)

2026-09-19 00:17:51 +08:00

evals

[Distributed][MoonEP] BF16 integration of MoonEP balanced EP backend (#52101)

2026-09-18 10:34:01 -04:00

fusion

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ir

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

jit_monitor

[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)

2026-08-13 13:12:40 -05:00

kernels

[Bugfix][GLM-5.3-Flash] Address kpool tail blocks by the padded indexer stride in the NVIDIA prefill seed kernel (#57477)

2026-09-20 18:15:04 +08:00

lora

[Misc] Remove unnecessary Transformers version guards (#57556)

2026-09-18 15:01:35 +00:00

model_executor

[Core][Kernel] Share persistent workspaces for Marlin and Humming (#57421)

2026-09-20 17:28:33 +08:00

models

[ROCm][DSV4][Perf] Use FP8 WO_A output projection (#54894)

2026-09-20 09:13:55 +00:00

multimodal

[Refactor] Use dynamic MM cache in processor (#57674)

2026-09-19 15:38:00 +00:00

parser

[Frontend] Fix the parsing of missing string= in DeepSeek V4 (#56271)

2026-09-18 05:11:24 +00:00

platforms

[CPU] Support FP16/BF16 persisted GDN state on AMX (#52191)

2026-08-31 16:32:20 +08:00

plugins

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

plugins_tests

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

prompts

…

quantization

[Quantization] Let ModelOpt MXFP8 layers load pre-processed weights Purpose (#57316)

2026-09-19 09:16:39 +00:00

reasoning

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

renderers

[Bugfix][Frontend] Bound the prompt after multimodal expansion (#57076)

2026-09-20 08:52:27 +00:00

rocm

[Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009)

2026-09-03 11:06:09 +08:00

samplers

[Bugfix][Frontend] Handle aborted requests in beam search (#56249)

2026-09-15 08:17:30 +00:00

spec_decode

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

standalone_tests

[ROCm][CI] Use the same-build wheel in Python-only CI (#49514)

2026-08-16 22:52:24 -05:00

system_messages

…

tokenizers_

[Bugfix][Multimodal] Preserve DeepSeek V4 image block spacing (#56882)

2026-09-18 18:44:39 +08:00

tool_parsers

[Frontend] Upgrade XGrammar to 0.2.7 and Rust structural tags to 0.3.0 (#57272)

2026-09-18 11:44:05 +00:00

tool_use

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

tools

[CI][ROCm] Deprecate DinD for MI250 test groups (#56162)

2026-09-18 14:13:35 -07:00

tracing

…

transformers_utils

[fix] Mistral-Large-3 accuracy regression on main (#57563)

2026-09-18 14:19:16 +00:00

utils_

[Frontend] Only show the summary line of config docstrings in --help (#57357)

2026-09-17 12:53:11 +00:00

v1

[Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810)

2026-09-20 10:58:55 +00:00

vllm_test_utils

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

watermarking

[watermarking hardening] Add e2e test and basic GSM8K quality tests (#56309)

2026-09-14 11:29:13 -04:00

__init__.py

…

ci_envs.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

conftest.py

[CI][ROCm] Deprecate DinD for MI250 test groups (#56162)

2026-09-18 14:13:35 -07:00

test_access_log_filter.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_attention_backend_registry.py

[Attention] Require explicit DCP support from attention implementations (#55780)

2026-09-08 14:04:27 -07:00

test_audio_media_size_precheck.py

fix(security): enforce VLLM_MAX_AUDIO_CLIP_FILESIZE_MB on all audio paths (#53561)

2026-08-24 21:37:02 +00:00

test_cmake_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_config.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_connections.py

Reject oversized media before fully downloading it (#51896)

2026-08-24 01:15:09 +00:00

test_embedded_commit.py

…

test_envs.py

[Bugfix][CPU] Fix macOS multimodal SHM cache initialization (#57142)

2026-09-18 09:05:13 +00:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_logger.py

[CI] Support FORCE_COLOR env var; enable colors in CPU CI output (#56913)

2026-09-16 22:40:21 -04:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)

2026-08-26 21:00:54 +08:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Bugfix] Set breakable graph env before Ray actor import (#53293)

2026-08-28 23:11:50 +00:00

test_ray_env.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_request_input_bounds.py

[Bugfix] Validate routed-expert prompt offsets before engine submission (#56844)

2026-09-15 09:17:41 +08:00

test_sampling_params.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

[Bugfix][CPU] Fix DeepSeek V4.1 import without Triton (#57654)

2026-09-19 05:46:13 +00:00

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[Bugfix][CPU] Fall back to CpuPlatform when zentorch fails to import (#54923)

2026-09-16 17:15:12 +08:00

utils.py

[XPU][UT]Fix test_mnnvl_alltoall device and distributed backend (#57591)

2026-09-20 10:53:00 +08:00