3 people 38cc054fc2 [Perf][Kernel] Vectorized flat abs-max for dynamic per-tensor FP8 quantization (#58194) ...

Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>

2026-09-25 09:19:48 -06:00

..

basic_correctness

[ROCm] Fix CI runtime and tests for MI355 DPX (#58244)

2026-09-24 23:15:11 -05:00

benchmarks

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

compile

[Cleanup] Remove online quantization support in fp8.py in favor of online shorthands (#53585)

2026-09-24 12:48:14 -07:00

config

fix(config): apply presence_penalty/frequency_penalty from override-generation-config (#50769)

2026-09-24 08:48:18 -07:00

cuda

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

detokenizer

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

distributed

[Perf][Distributed] Add low-SM multimem reduce-scatter for SM100/SM103 (#55072)

2026-09-25 03:27:21 +00:00

engine

[CPU] Add device-memory-utilization CLI alias (#56547)

2026-09-22 17:37:15 +08:00

entrypoints

[Pooling] Preserve reranker tokenization with document limits (#57666)

2026-09-25 11:04:41 -04:00

evals

[ROCm] Fix CI runtime and tests for MI355 DPX (#58244)

2026-09-24 23:15:11 -05:00

fusion

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ir

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

jit_monitor

[ROCm][Bugfix] Register MRV2 sampler JIT warmups (#58092)

2026-09-23 03:17:13 -05:00

kernels

[Perf][Kernel] Vectorized flat abs-max for dynamic per-tensor FP8 quantization (#58194)

2026-09-25 09:19:48 -06:00

lora

[Misc] Remove unnecessary Transformers version guards (#57556)

2026-09-18 15:01:35 +00:00

model_executor

[UX][Frontend] Introduce vllm preload cli for fast restart (#56680)

2026-09-25 06:56:39 +00:00

models

[SpecDecode] Add LiLiCorr drafter (#57934)

2026-09-25 10:08:28 -04:00

multimodal

[EPD] Support metadata-only audio inputs (#57887)

2026-09-23 09:03:50 +08:00

parser

[Bugfix][Frontend] Count reasoning tokens for Harmony, DeepSeek-V3 and Step3 parsers (#58626)

2026-09-25 00:12:29 +00:00

platforms

[CPU][GDN] Support NIXL DS convolution-state layout (#53300)

2026-09-24 14:55:20 +08:00

plugins

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

plugins_tests

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

prompts

…

quantization

[Bugfix][Quantization] Fix MXFP8 startup crash on layers below mm_mxfp8 shape limits (#54223)

2026-09-25 02:54:11 +00:00

reasoning

[Bugfix][Frontend] Count reasoning tokens for Harmony, DeepSeek-V3 and Step3 parsers (#58626)

2026-09-25 00:12:29 +00:00

renderers

[Frontend] Remove the slow tokenizer mode (#58545)

2026-09-24 08:48:28 -07:00

rocm

[Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009)

2026-09-03 11:06:09 +08:00

samplers

[Dependency] Upgrade FlashInfer version to 0.7.0 (#58069)

2026-09-23 22:45:23 -07:00

spec_decode

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

standalone_tests

[ROCm][CI] Use the same-build wheel in Python-only CI (#49514)

2026-08-16 22:52:24 -05:00

system_messages

…

tokenizers_

[Frontend] Remove the slow tokenizer mode (#58545)

2026-09-24 08:48:28 -07:00

tool_parsers

[Bugfix][Tool Parser] Migrate Granite to the streaming Parser Engine (#49648)

2026-09-23 10:37:40 +00:00

tool_use

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

tools

[Refactor] Move auxiliary files out of the repository root (#58572)

2026-09-24 12:38:56 -07:00

tracing

…

transformers_utils

[Bugfix] Resolve the Hub revision once per repo (#56092)

2026-09-24 08:48:24 -07:00

utils_

[Frontend] Only show the summary line of config docstrings in --help (#57357)

2026-09-17 12:53:11 +00:00

v1

[MRV2] Minor model_runner.py code cleanup (#58610)

2026-09-25 07:59:27 -07:00

vllm_test_utils

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

watermarking

[watermarking hardening] Add e2e test and basic GSM8K quality tests (#56309)

2026-09-14 11:29:13 -04:00

__init__.py

…

ci_envs.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

conftest.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

test_access_log_filter.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_attention_backend_registry.py

[Attention] Require explicit DCP support from attention implementations (#55780)

2026-09-08 14:04:27 -07:00

test_audio_media_size_precheck.py

fix(security): enforce VLLM_MAX_AUDIO_CLIP_FILESIZE_MB on all audio paths (#53561)

2026-08-24 21:37:02 +00:00

test_cmake_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_config.py

[SpecDecode] Add LiLiCorr drafter (#57934)

2026-09-25 10:08:28 -04:00

test_connections.py

Reject oversized media before fully downloading it (#51896)

2026-08-24 01:15:09 +00:00

test_embedded_commit.py

…

test_envs.py

[Bugfix][CPU] Fix macOS multimodal SHM cache initialization (#57142)

2026-09-18 09:05:13 +00:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

…

test_logger.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)

2026-08-26 21:00:54 +08:00

test_outputs.py

…

test_pcp_dp.py

[PCP] Support prefill context parallelism with data parallelism (#57075)

2026-09-23 22:32:36 -04:00

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Bugfix] Set breakable graph env before Ray actor import (#53293)

2026-08-28 23:11:50 +00:00

test_ray_env.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_regression.py

…

test_request_input_bounds.py

[Bugfix][Frontend] Validate mixed prompt embedding mask lengths (#57006)

2026-09-22 05:50:31 +00:00

test_sampling_params.py

[Perf] DiffusionGemma: constrained reads over the request's logprob_token_ids (#58216)

2026-09-24 13:15:08 -07:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

[Bugfix][CPU] Fix DeepSeek V4.1 import without Triton (#57654)

2026-09-19 05:46:13 +00:00

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[Bugfix][CPU] Fall back to CpuPlatform when zentorch fails to import (#54923)

2026-09-16 17:15:12 +08:00

utils.py

[ROCm][CI] Query HIP device memory for test GPU teardown waits. (#57450)

2026-09-20 15:20:39 -05:00