3 people b544587408 [Core][Feat] Pluggable KVCacheConfigBuilder for platform/model-specific KV cache planning (#53558) ...

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>

2026-10-16 23:16:47 +00:00

..

basic_correctness

[Core] Drop the Ray driver-node GPU pin left over from the legacy executor (#61713)

2026-10-15 16:00:18 -07:00

benchmarks

[Bugfix][Benchmark] Fix probe latency and duration in bench serve (#60511)

2026-10-15 05:50:30 +00:00

compile

[ROCm] [fusion] support ROCm aiter fusion of per tensor quant + rmsnorm (#52831)

2026-10-16 15:19:07 -05:00

config

[Chore] Use upstream Transformers DeepseekV4Config (#61392)

2026-10-15 01:08:08 -07:00

cuda

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

detokenizer

[Bugfix][Spec Decode] Trim token_ids/logprobs left past a stop string under speculative decoding (#47616)

2026-10-09 14:22:31 -07:00

device_allocator

[Bugfix] Don't drop the rest of the allocator config when toggling expandable segments (#57982)

2026-09-25 17:34:19 -05:00

distributed

[Feature][PCP] Add DeepSeek-V4.1-Flash support (#59857)

2026-10-15 23:17:51 -07:00

engine

[Bugfix][Platform] Fall back to torch when device-level NVML memory is unsupported (GB10) (#57378)

2026-10-14 12:45:29 +00:00

entrypoints

[Bugfix][Frontend] Keep the parser's tool call IDs in batch derender (#61852)

2026-10-16 10:27:17 +00:00

evals

[CI][AMD] Move 17 test groups from MI300 to MI355 and test large DeepSeek/Nemotron evals on AITER (#61955)

2026-10-16 10:58:59 -05:00

fusion

[Fusion] Support 3D activation quantization fusion and enable it for Pixtral (#59612)

2026-10-09 15:12:03 +08:00

ir

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

jit_monitor

[Perf] JIT monitor: hook TileLang JITImpl.compile instead of __call__ (#58685)

2026-10-08 00:11:59 +00:00

kernels

[Kernel] Add router GEMM kernels for (5120, 256) and BF16 output to ll_bf16_gemm (#62042)

2026-10-16 15:39:46 -07:00

lora

[Bugfix][LoRA] Apply PEFT rank_pattern / alpha_pattern scaling per module (#59801)

2026-10-12 21:49:30 +08:00

model_executor

[Perf] Share Triton JIT warmup compilation pool across registered kernels (#61422)

2026-10-16 08:59:42 -04:00

models

[ROCm][Perf][Kimi-K3] Use AITER Gluon chunk_kda for KDA prefill (#59552)

2026-10-16 22:58:56 +00:00

multimodal

[Bugfix][Multimodal] Honor RGB PNG transparency when loading images (#61986)

2026-10-16 23:09:12 +00:00

parser

[Perf][Parser] Stream MiniMax M2 tool argument values incrementally (16 KB call: 5.9 s to 26 ms) (#62035)

2026-10-16 22:46:02 +00:00

platforms

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

plugins

[Bugfix][MRV2] Keep input_ids on later PP stages for raw-token models (#61016)

2026-10-15 12:54:21 -07:00

plugins_tests

[Bugfix][MRV2] Keep input_ids on later PP stages for raw-token models (#61016)

2026-10-15 12:54:21 -07:00

prompts

…

quantization

[Bugfix] Make Humming DeviceInfo lookups traceable under torch.compile (#61858)

2026-10-15 11:12:21 -07:00

reasoning

[Frontend] Port Step-3.5 parsers to the streaming parser engine (#59321)

2026-10-01 22:18:37 +00:00

renderers

[Bugfix] Honor OPT token embedding width for prompt embeddings (#61736)

2026-10-16 04:41:50 +00:00

rocm

[ROCm][CI] Add test coverage for VLLM_ROCM_MOE_PADDING memory-stride padding transparency (#59332)

2026-10-02 11:23:22 -05:00

samplers

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

spec_decode

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

standalone_tests

[CI] Add nightly Python 3.14 smoke test (#60456)

2026-10-12 10:11:26 -07:00

tokenizers_

[Bugfix] Honor code_revision in config-based tokenizer loading (#61611)

2026-10-16 05:21:12 +00:00

tool_parsers

[Bugfix] Fix Apertus streaming scientific notation (#61812)

2026-10-15 16:49:57 +00:00

tool_use

[Frontend] Support CustomToolCall in the non-Harmony Responses API (#57322)

2026-10-12 17:22:55 +08:00

tools

[Agents] Add pre-commit check for agent files and skills (#59657)

2026-10-02 09:38:22 -07:00

tracing

[Refactor] Remove dead tests code (#58916)

2026-09-30 04:39:03 +00:00

transformers_utils

[Chore] Use upstream Transformers DeepseekV4Config (#61392)

2026-10-15 01:08:08 -07:00

utils_

[Frontend] Advertise --enable-x/--disable-x for boolean CLI flags (#61479)

2026-10-15 01:08:02 -07:00

v1

[Core][Feat] Pluggable KVCacheConfigBuilder for platform/model-specific KV cache planning (#53558)

2026-10-16 23:16:47 +00:00

vllm_test_utils

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

watermarking

[watermarking] Add DFlash support to dual-key gumbel-max watermarking (#59554)

2026-10-15 22:06:06 +00:00

__init__.py

…

ci_envs.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

conftest.py

[CI] Keep vLLM log propagation on through the first LLM init in caplog_vllm (#61535)

2026-10-14 15:10:35 +08:00

test_attention_backend_registry.py

[Platform] Allow BackendEnum dynamic register (#41091)

2026-10-08 09:56:19 +08:00

test_audio_media_size_precheck.py

[Security] Bound decoded and downloaded media per request (#61226)

2026-10-13 10:17:14 +00:00

test_cmake_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_config.py

[ROCm][Qwen4Exp] Support HC and MoE sequence parallelism on ROCm (#61471)

2026-10-15 20:11:17 -05:00

test_connections.py

[Security] Bound decoded and downloaded media per request (#61226)

2026-10-13 10:17:14 +00:00

test_embedded_commit.py

…

test_envs.py

[Bugfix] Keep VLLM_RAY_BUNDLE_INDICES out of the compile cache key (#61211)

2026-10-16 20:59:48 +00:00

test_force_first_config.py

…

test_fxgraphcache_pickle_patch.py

…

test_logger.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)

2026-08-26 21:00:54 +08:00

test_outputs.py

[Bugfix][Core] Preserve speculative metrics when coalescing outputs (#55708)

2026-10-07 08:35:14 +08:00

test_pcp_dp.py

[PCP] Support prefill context parallelism with data parallelism (#57075)

2026-09-23 22:32:36 -04:00

test_pooling_params.py

[Feature][Pooling] Add offline fixed-length late chunking (#60164)

2026-10-13 11:16:21 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Bugfix] Set breakable graph env before Ray actor import (#53293)

2026-08-28 23:11:50 +00:00

test_ray_env.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_regression.py

…

test_request_input_bounds.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_sampling_params.py

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_uvicorn_logging.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_version.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[CPU][Zen] Update zentorch to 2.14.0.1 & enable float16 on Venice and later (#61411)

2026-10-15 00:23:50 -07:00

test_zentorch_version_pin.py

[ZenCPU][Test] Add zentorch/torch version pin consistency test (#52888)

2026-10-06 13:12:19 +08:00

utils.py

[MRV2] Switch CI tests still running on MRV1 unnecessarily (#61014)

2026-10-11 09:57:07 -07:00