Ronaldandaoshen02 479eeb32d2 [Bugfix][MRV2] Isolate sleep-mode KV allocations (#53508) ...

Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>

2026-08-27 15:08:28 -07:00

..

basic_correctness

[Bugfix][MRV2] Isolate sleep-mode KV allocations (#53508)

2026-08-27 15:08:28 -07:00

benchmarks

[Rust][Benchmark] Align speed-bench CLI flags with Python and add flag parity test (#51592)

2026-08-20 08:50:51 +00:00

compile

speculative decoding under tensor parallelism (TP>1) , workspace creation select max hidden dim of target and draft model (#52193)

2026-08-24 21:33:36 +00:00

config

[Config][EC] Normalize producer-only encoder config (#53656)

2026-08-25 07:53:04 +00:00

cuda

[Bugfix][Platform] Stop re-initializing NVML on every device-capability check (fixes #50381) (#50393)

2026-08-07 08:30:00 +00:00

detokenizer

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391)

2026-07-23 18:14:06 +08:00

distributed

[Bugfix] Avoid TCPStore port collision for co-located non-DP Ray engines (#53666)

2026-08-27 19:58:14 +00:00

engine

[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)

2026-08-25 07:02:32 +00:00

entrypoints

[Bugfix][Frontend] Let pooling requests set padding (#51157)

2026-08-27 11:06:20 +00:00

evals

Bugfix: use PCP slot mappings for PIECEWISE capture (#53869)

2026-08-27 05:39:36 +00:00

fusion

Add the QuantizedActivation linear-kernel contract (#44260)

2026-06-12 13:48:15 -07:00

ir

[Perf] Set IR Op Priority Once at Worker Init (#42631)

2026-05-15 15:56:13 +00:00

jit_monitor

[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)

2026-08-13 13:12:40 -05:00

kernels

[Perf][DSv4] Use native CUDA SwiGLU clamp kernel for Humming MoE (throughput +1.40%) (#53685)

2026-08-27 13:52:45 -07:00

lora

[Misc] Use VLLMValidationError in offline inference input validation (#53432)

2026-08-23 08:43:51 -07:00

model_executor

[Attention] Enable masked MHA for GLM-5 head dimensions (#53785)

2026-08-27 21:17:12 +00:00

models

[Kimi K3][Kernel] Support DS conv-state layout in fused KDA decode kernel (#53396)

2026-08-26 23:54:50 -07:00

multimodal

[Bugfix][Multimodal] Reject malformed base64 audio with 400 instead of 500 (#53744)

2026-08-25 17:31:42 +00:00

parser

[Bugfix][Parser] Scope reasoning-end detection to the current turn via turn-boundary tokens (#54089)

2026-08-27 16:57:32 -04:00

plugins

[MISC] Cleanup deprecated parameters (#53559)

2026-08-24 10:19:04 -07:00

plugins_tests

[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)

2026-08-25 07:02:32 +00:00

prompts

…

quantization

[Quantization][Humming] Support MXFP4 weight + block-FP8 activation for MoE (#51332)

2026-08-25 10:21:00 -04:00

reasoning

Fix Cohere ChatV2 citation and tool handling issues (#52175)

2026-08-21 15:23:17 -07:00

renderers

[warmup] overlap renderer warmup and engine core initialization (#52764)

2026-08-27 11:42:08 +08:00

samplers

[ROCm] Remove stale SDPA and skinny GEMM workarounds (#50907)

2026-08-11 14:19:16 -04:00

spec_decode

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

standalone_tests

[ROCm][CI] Use the same-build wheel in Python-only CI (#49514)

2026-08-16 22:52:24 -05:00

system_messages

…

tokenizers_

[Bugfix][Tokenizer] Replace bare asserts in the DeepSeek V4 encoder (#53747)

2026-08-25 16:30:23 +00:00

tool_parsers

[Frontend] Prevent Kimi K3 reserved markers in response text (#52889)

2026-08-21 09:06:52 -07:00

tool_use

Add Muse Glimmer model support (#51655)

2026-08-14 12:28:56 +08:00

tools

[Rocm][CI] add dockerfile.xpu to rocm ci artifact (#53949)

2026-08-27 01:06:48 -07:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[Model] Add Qwen3-Omni DSpark support (#52560)

2026-08-22 15:35:22 -07:00

utils_

[Model] Remove ten deprecated model architectures (#53608)

2026-08-24 17:06:00 -07:00

v1

[Bugfix][MRV2] Isolate sleep-mode KV allocations (#53508)

2026-08-27 15:08:28 -07:00

vllm_test_utils

…

weight_loading

[Model] Remove ten deprecated model architectures (#53608)

2026-08-24 17:06:00 -07:00

__init__.py

…

ci_envs.py

…

conftest.py

[XPU][Tests] Make tests device-agnostic (#51968)

2026-08-20 02:25:41 -07:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

2026-08-21 17:47:49 -07:00

test_audio_media_size_precheck.py

fix(security): enforce VLLM_MAX_AUDIO_CLIP_FILESIZE_MB on all audio paths (#53561)

2026-08-24 21:37:02 +00:00

test_cmake_utils.py

[CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901)

2026-08-15 07:01:52 -07:00

test_config.py

[Model Runner V2] Use MRV2 for all models by default (#53183)

2026-08-27 11:59:34 -07:00

test_connections.py

Reject oversized media before fully downloading it (#51896)

2026-08-24 01:15:09 +00:00

test_embedded_commit.py

…

test_envs.py

[Bugfix] Redact api_key in non-default args log (#52523)

2026-08-19 15:52:53 +08:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)

2026-08-26 21:00:54 +08:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_request_input_bounds.py

[Bugfix] Return HTTP 400 instead of 501 for unknown chat roles in DeepSeek encoders (#53071)

2026-08-20 09:23:41 +00:00

test_sampling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

Exclude the cpu backend from vLLM's active-Triton-driver count (#53530) (#53530)

2026-08-25 04:13:13 +00:00

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[ROCm][CI] Select CPU platform for native no-GPU jobs (#49515)

2026-08-14 23:30:56 -07:00

utils.py

[CI] Harden RemoteVLLMServer GPU cleanup checks (#52282)

2026-08-19 14:17:17 -05:00