vLLM/tests at f12fe10c5c377ccd401b66c39df3ffb394fa067c - vLLM

basic_correctness

[CI][Test] Deflake test_mem.py sleep-mode asserts via allocator bookeeping (#54312 )

2026-08-29 12:05:17 -07:00

benchmarks

[Bugfix][Benchmark] Make streaming TTFT/E2E latency accounting consistent across endpoints (#55508 )

2026-09-13 05:20:54 +00:00

compile

[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793 )

2026-09-14 10:26:15 -07:00

config

[Multimodal] Use GPU NVDEC for EPD encoder-only instance video media IO (#53675 )

2026-09-11 22:20:11 +08:00

cuda

[Bugfix][Platform] Stop re-initializing NVML on every device-capability check (fixes #50381 ) (#50393 )

2026-08-07 08:30:00 +00:00

detokenizer

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391 )

2026-07-23 18:14:06 +08:00

distributed

[Bugfix][KV Offload] Check cgroup memory before SHM allocation (#54014 )

2026-09-16 09:17:50 +03:00

engine

[DS V4.1][Engram] Support async prefetch for offloaded engram lookups and engram DP sharding (#56512 )

2026-09-13 02:44:23 -07:00

entrypoints

[Kernel] Use Murmur3 RNG for Gumbel sampling (#51367 )

2026-09-15 23:52:26 -07:00

evals

[Bugfix][HiSparse] Preserve per-layer offsets in KV cache bindings (#57027 )

2026-09-15 20:27:11 +00:00

fusion

[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793 )

2026-09-14 10:26:15 -07:00

ir

[CI][IR] Speed up vLLM IR test group (#55965 )

2026-09-08 21:28:06 -05:00

jit_monitor

[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159 )

2026-08-13 13:12:40 -05:00

kernels

[ROCm][AITER] Skip AITER norm kernels when flattening to 2D would copy (#55991 )

2026-09-16 07:26:56 +00:00

lora

[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793 )

2026-09-14 10:26:15 -07:00

model_executor

[DSA] Wire DeepGEMM sparse MQA logits into the DeepSeek V4.1 indexer (#56254 )

2026-09-15 14:07:14 -07:00

models

[Bugfix] Make GPU sync checks safe under torch.compile (#56904 )

2026-09-15 21:37:08 -07:00

multimodal

[Multimodal] Use GPU NVDEC for EPD encoder-only instance video media IO (#53675 )

2026-09-11 22:20:11 +08:00

parser

[Refactor] StructuredOutputManager x Speculative Decoding Refactor (#48200 )

2026-09-15 09:48:49 -04:00

platforms

[CPU] Support FP16/BF16 persisted GDN state on AMX (#52191 )

2026-08-31 16:32:20 +08:00

plugins

[Frontend] Move engine/protocol.py out openai folder (#54492 )

2026-08-31 10:13:50 +00:00

plugins_tests

[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659 )

2026-08-25 07:02:32 +00:00

prompts

…

quantization

[ROCm] [Bugfix] Enable Load and Inference of GLM-5.3-Flash Quark MXFP4 Checkpoint (#56176 )

2026-09-16 01:25:29 +00:00

reasoning

[Frontend] create unified Cohere parser (#56392 )

2026-09-12 04:04:46 -04:00

renderers

[Bugfix] Unreadable prompt_embeds payload should be a 400, not a 500 (#55451 )

2026-09-16 05:53:36 +00:00

rocm

[Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009 )

2026-09-03 11:06:09 +08:00

samplers

[Bugfix][Frontend] Handle aborted requests in beam search (#56249 )

2026-09-15 08:17:30 +00:00

spec_decode

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570 )

2026-07-30 05:02:51 -07:00

standalone_tests

[ROCm][CI] Use the same-build wheel in Python-only CI (#49514 )

2026-08-16 22:52:24 -05:00

system_messages

…

tokenizers_

[Bugfix][Frontend] Support Responses text types in DeepSeek V4.1 (#56299 )

2026-09-14 10:43:09 +08:00

tool_parsers

[Frontend] Use XGrammar schema constraints for DeepSeek V4.1 (#56408 )

2026-09-15 04:36:16 -04:00

tool_use

[Frontend] Move engine/protocol.py out openai folder (#54492 )

2026-08-31 10:13:50 +00:00

tools

[CI][ROCm] Avoid redundant image pulls during smoke validation (#54408 )

2026-08-31 21:48:25 -05:00

tracing

…

transformers_utils

[Bugfix] Align vLLM YaRN with Transformers and stop re-scaling max_model_len (#56446 )

2026-09-11 13:01:38 +00:00

utils_

[Bugfix][KV Offload] Check cgroup memory before SHM allocation (#54014 )

2026-09-16 09:17:50 +03:00

v1

[Bugfix][KV Offload] Track cache recency once per request (#51787 )

2026-09-16 10:47:26 +03:00

vllm_test_utils

…

watermarking

[watermarking hardening] Add e2e test and basic GSM8K quality tests (#56309 )

2026-09-14 11:29:13 -04:00

weight_loading

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809 )

2026-09-08 12:45:12 -07:00

__init__.py

…

ci_envs.py

…

conftest.py

[Bugfix][CPU] Fix several bugs (#54042 )

2026-08-31 15:33:06 +08:00

test_access_log_filter.py

…

test_attention_backend_registry.py

[Attention] Require explicit DCP support from attention implementations (#55780 )

2026-09-08 14:04:27 -07:00

test_audio_media_size_precheck.py

fix(security): enforce VLLM_MAX_AUDIO_CLIP_FILESIZE_MB on all audio paths (#53561 )

2026-08-24 21:37:02 +00:00

test_cmake_utils.py

[CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901 )

2026-08-15 07:01:52 -07:00

test_config.py

[Config] Infer HiSparse attention config from HiSparseConnector (#57041 )

2026-09-15 19:44:26 +00:00

test_connections.py

Reject oversized media before fully downloading it (#51896 )

2026-08-24 01:15:09 +00:00

test_embedded_commit.py

…

test_envs.py

[Frontend] Replace VLLM_ENABLE_SCALE_OUT_ENDPOINTS with --enable-scale-out (#55176 )

2026-09-14 10:02:14 +00:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425 )

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205 )

2026-04-10 08:29:35 +00:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479 )

2026-06-04 06:49:31 +00:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704 )

2026-08-26 21:00:54 +08:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665 )

2026-07-29 04:20:40 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446 )

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Bugfix] Set breakable graph env before Ray actor import (#53293 )

2026-08-28 23:11:50 +00:00

test_ray_env.py

fix nixl side-channel host selection (#41806 )

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176 )

2026-05-09 19:47:09 -07:00

test_request_input_bounds.py

[Bugfix] Validate routed-expert prompt offsets before engine submission (#56844 )

2026-09-15 09:17:41 +08:00

test_sampling_params.py

[Bugfix] Validate extension integers before engine serialization (#55606 )

2026-09-08 16:30:06 +08:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446 )

2026-08-11 04:33:10 +00:00

test_triton_utils.py

Exclude the cpu backend from vLLM's active-Triton-driver count (#53530 ) (#53530 )

2026-08-25 04:13:13 +00:00

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[Bugfix] Log platform plugin detection failures (#52285 )

2026-09-01 19:11:52 +00:00

utils.py

[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247 )

2026-09-11 13:19:57 +08:00