3 people fa312090cb [Frontend] Accept each connection on the least loaded API worker (#60723) ...

Signed-off-by: hao-aaron <aaronhao@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-09 04:40:13 +00:00

..

basic_correctness

[ROCm][Bugfix] Map sleep-mode cuMem memory for the host (#60367)

2026-10-08 04:26:12 +00:00

benchmarks

[Frontend] Support min_p in the Responses API (#48084)

2026-10-08 20:38:17 +00:00

compile

[Compile] Remove torch.compile-based sequence parallelism and AsyncTP (#60517)

2026-10-08 08:28:23 -07:00

config

[Bugfix][Quantization] Detect NVFP4 in ModelOpt mixed-precision checkpoints (#56050)

2026-10-02 12:30:22 +00:00

cuda

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

detokenizer

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

device_allocator

[Bugfix] Don't drop the rest of the allocator config when toggling expandable segments (#57982)

2026-09-25 17:34:19 -05:00

distributed

[BugFix][DiffusionGemma][CPU] Copy async output snapshots instead of aliasing reused buffers (#59829)

2026-10-08 19:16:51 -07:00

engine

[Bugfix] Reject negative --device-ids indices instead of selecting the wrong device (#49053)

2026-10-08 13:01:25 +00:00

entrypoints

[Frontend] Accept each connection on the least loaded API worker (#60723)

2026-10-09 04:40:13 +00:00

evals

[Bugfix] [Spec Decode] DeepSeek V4/V4.1 NVFP4: keep ignored MTP/DSpark experts on MXFP4 (#59655)

2026-10-08 00:10:32 +00:00

fusion

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ir

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

jit_monitor

[Perf] JIT monitor: hook TileLang JITImpl.compile instead of __call__ (#58685)

2026-10-08 00:11:59 +00:00

kernels

[Bugfix][MoE] Size the permute scratch from its inputs (#60447)

2026-10-08 15:32:07 -04:00

lora

[Bugfix][LoRA] Validate incompatible MoE adapter formats (#59924)

2026-10-09 09:49:13 +08:00

model_executor

[Quantization] Enable shared expert fusion compatibility with online shared_expert quantization (showcase: along Quark MXFP4 routed experts) (#55686)

2026-10-08 12:04:46 -04:00

models

[Model] Add zerank-2 reranker (#60415)

2026-10-09 03:01:51 +00:00

multimodal

Remove Python 3.10 support now that it is EOL (#60402)

2026-10-08 02:30:52 -07:00

parser

[Bugfix][Structured Output] Feed the token that implicitly ends reasoning to the grammar (#59627)

2026-10-08 19:38:33 +00:00

platforms

[CPU][GDN] Support NIXL DS convolution-state layout (#53300)

2026-09-24 14:55:20 +08:00

plugins

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

plugins_tests

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

prompts

…

quantization

[Quantization] Enable shared expert fusion compatibility with online shared_expert quantization (showcase: along Quark MXFP4 routed experts) (#55686)

2026-10-08 12:04:46 -04:00

reasoning

[Frontend] Port Step-3.5 parsers to the streaming parser engine (#59321)

2026-10-01 22:18:37 +00:00

renderers

[CI] Add supports_multimodal_inputs to test_executor_replace's mock config (#59476)

2026-09-30 19:04:47 +00:00

rocm

[ROCm][CI] Add test coverage for VLLM_ROCM_MOE_PADDING memory-stride padding transparency (#59332)

2026-10-02 11:23:22 -05:00

samplers

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

spec_decode

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

standalone_tests

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

system_messages

…

tokenizers_

[Perf] Reduce fallback decode CPU by 69% at 32K (#60497)

2026-10-08 21:42:56 +00:00

tool_parsers

[Bugfix][Tool Parser] Use LongCat tags in the LongCat structural tag (#60747)

2026-10-08 21:20:54 -07:00

tool_use

[Bugfix][ToolParser] Stream every tool call when one delta completes several (#60354)

2026-10-08 01:07:35 +00:00

tools

[Agents] Add pre-commit check for agent files and skills (#59657)

2026-10-02 09:38:22 -07:00

tracing

[Refactor] Remove dead tests code (#58916)

2026-09-30 04:39:03 +00:00

transformers_utils

[Bugfix][Quant] Read safetensors headers of checkpoints with other file names (#60411)

2026-10-08 01:38:41 -05:00

utils_

[Bugfix] Scope deprecated CLI argument warnings to the parser that defines them (#59917)

2026-10-08 15:29:04 +00:00

v1

[Perf][Multimodal] Sort multimodal encoder inputs by modality (#60196)

2026-10-09 10:55:36 +08:00

vllm_test_utils

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

watermarking

[Bugfix] Don't warn about missing watermark config for default requests (#60412)

2026-10-08 15:29:20 +00:00

__init__.py

…

ci_envs.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

conftest.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

test_attention_backend_registry.py

[Platform] Allow BackendEnum dynamic register (#41091)

2026-10-08 09:56:19 +08:00

test_audio_media_size_precheck.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

test_cmake_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_config.py

[Compile] Remove torch.compile-based sequence parallelism and AsyncTP (#60517)

2026-10-08 08:28:23 -07:00

test_connections.py

Reject oversized media before fully downloading it (#51896)

2026-08-24 01:15:09 +00:00

test_embedded_commit.py

…

test_envs.py

[Bugfix][CPU] Fix macOS multimodal SHM cache initialization (#57142)

2026-09-18 09:05:13 +00:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_logger.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)

2026-08-26 21:00:54 +08:00

test_outputs.py

[Bugfix][Core] Preserve speculative metrics when coalescing outputs (#55708)

2026-10-07 08:35:14 +08:00

test_pcp_dp.py

[PCP] Support prefill context parallelism with data parallelism (#57075)

2026-09-23 22:32:36 -04:00

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Bugfix] Set breakable graph env before Ray actor import (#53293)

2026-08-28 23:11:50 +00:00

test_ray_env.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_request_input_bounds.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_sampling_params.py

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_uvicorn_logging.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_version.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_zen_cpu_platform_detection.py

[CI] Allowlist-shrink batch 2: wire 9 tests/models/ files into Buildkite, fix 2 stale bugs found (#59050)

2026-10-06 21:16:53 -07:00

test_zentorch_version_pin.py

[ZenCPU][Test] Add zentorch/torch version pin consistency test (#52888)

2026-10-06 13:12:19 +08:00

utils.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00