Misha GoinandOpenAI Codex bfb6c13499 [Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>

2026-08-20 16:26:24 -04:00

..

basic_correctness

[Core] Add CuMemAllocator.discard() for tag-selective GPU memory release (#52514)

2026-08-16 23:15:14 +08:00

benchmarks

[Rust][Benchmark] Align speed-bench CLI flags with Python and add flag parity test (#51592)

2026-08-20 08:50:51 +00:00

compile

[ROCm][CI] Speed up test_rocm_aiter_qk_norm_rope_kvcache_fusion (#53004)

2026-08-19 21:20:21 -05:00

config

Promote prefix_cache_retention_interval to an argument and change the default to 0 (#52216)

2026-08-17 13:20:50 +00:00

cuda

[Bugfix][Platform] Stop re-initializing NVML on every device-capability check (fixes #50381) (#50393)

2026-08-07 08:30:00 +00:00

detokenizer

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391)

2026-07-23 18:14:06 +08:00

distributed

[refactor] consolidate cp attn ops (#52839)

2026-08-19 18:04:11 -07:00

engine

Promote prefix_cache_retention_interval to an argument and change the default to 0 (#52216)

2026-08-17 13:20:50 +00:00

entrypoints

fix: report stop_sequence stop_reason in Anthropic Messages API (#45807)

2026-08-20 03:23:43 +00:00

evals

Remove VLLM_TEST_FORCE_FP8_MARLIN to replace with linear_backend/moe_backend (#52182)

2026-08-18 12:58:04 -04:00

fusion

Add the QuantizedActivation linear-kernel contract (#44260)

2026-06-12 13:48:15 -07:00

ir

[Perf] Set IR Op Priority Once at Worker Init (#42631)

2026-05-15 15:56:13 +00:00

jit_monitor

[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)

2026-08-13 13:12:40 -05:00

kernels

[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)

2026-08-20 16:26:24 -04:00

lora

[LoRA] Avoid false target matches for unsupported module types (#52313)

2026-08-19 16:48:11 +00:00

model_executor

Fix weight tying (#51665)

2026-08-20 10:31:55 +00:00

models

[DSV4][Kernel] Fuse shared experts into MegaMoE (#53040)

2026-08-20 12:07:02 -07:00

multimodal

[Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)

2026-08-20 15:04:29 +00:00

parser

[Bugfix][Gemma4] Align parser enable_thinking default with template (#52430)

2026-08-18 12:41:26 +00:00

plugins

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

plugins_tests

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

prompts

…

quantization

Reduce AutoWeightsLoader kwargs (#53106)

2026-08-20 15:40:11 +00:00

reasoning

[Bugfix][Gemma4] Align parser enable_thinking default with template (#52430)

2026-08-18 12:41:26 +00:00

renderers

[Refactor] Remove InputPreprocessor (#53064)

2026-08-20 08:39:48 +00:00

samplers

[ROCm] Remove stale SDPA and skinny GEMM workarounds (#50907)

2026-08-11 14:19:16 -04:00

spec_decode

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

standalone_tests

[ROCm][CI] Use the same-build wheel in Python-only CI (#49514)

2026-08-16 22:52:24 -05:00

system_messages

…

tokenizers_

[Bugfix] Return HTTP 400 instead of 501 for unknown chat roles in DeepSeek encoders (#53071)

2026-08-20 09:23:41 +00:00

tool_parsers

chore: Upstream Cohere parser fixes + tests (#51998)

2026-08-13 05:05:36 -07:00

tool_use

Add Muse Glimmer model support (#51655)

2026-08-14 12:28:56 +08:00

tools

[CI][ROCm] Prevent Git maintenance races during shallow fetches (#52810)

2026-08-18 15:34:50 -07:00

tracing

…

transformers_utils

Fix weight tying (#51665)

2026-08-20 10:31:55 +00:00

utils_

[Bugfix] Skip MM processor cache inserts larger than capacity (#53016)

2026-08-20 13:42:50 +00:00

v1

[Bugfix] Support MistralCommonBackend tokenizers in structured output (#52720)

2026-08-20 19:08:50 +01:00

vllm_test_utils

…

weight_loading

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

__init__.py

…

ci_envs.py

…

conftest.py

[XPU][Tests] Make tests device-agnostic (#51968)

2026-08-20 02:25:41 -07:00

test_access_log_filter.py

…

test_attention_backend_registry.py

…

test_cmake_utils.py

[CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901)

2026-08-15 07:01:52 -07:00

test_config.py

[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)

2026-08-20 11:13:43 -04:00

test_embedded_commit.py

…

test_envs.py

[Bugfix] Redact api_key in non-default args log (#52523)

2026-08-19 15:52:53 +08:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

test_logprobs.py

…

test_outputs.py

…

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_request_input_bounds.py

[Bugfix] Return HTTP 400 instead of 501 for unknown chat roles in DeepSeek encoders (#53071)

2026-08-20 09:23:41 +00:00

test_sampling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[ROCm][CI] Select CPU platform for native no-GPU jobs (#49515)

2026-08-14 23:30:56 -07:00

utils.py

[CI] Harden RemoteVLLMServer GPU cleanup checks (#52282)

2026-08-19 14:17:17 -05:00