8 people 47228db84c [Bugfix][KV-transfer] MoRIIO: per-layer READ-completion barrier in wait_for_layer_load (#48534) ...

Signed-off-by: Edwin Lim <edwin.lim@mangoboost.io>
Signed-off-by: Redwan Khan <redwan.khan@mangoboost.io>
Signed-off-by: harishk-mangoboost <harish.kambhampaty@mangoboost.io>
Signed-off-by: limeward <32970461+edwinlim0919@users.noreply.github.com>
Signed-off-by: QinPR <1905873179@qq.com>
Co-authored-by: Jaeyoun Kim <jaeyoun.kim@mangoboost.io>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Redwan Khan <redwan.khan@mangoboost.io>
Co-authored-by: harishk-mangoboost <harish.kambhampaty@mangoboost.io>
Co-authored-by: rkhan055 <redwankhan055@gmail.com>
Co-authored-by: Peiran Qin <66068739+QinPR@users.noreply.github.com>
Co-authored-by: QinPR <1905873179@qq.com>

2026-08-07 14:23:33 +00:00

..

basic_correctness

[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)

2026-08-06 09:13:10 +08:00

benchmarks

[MISC][Bench] refactor throughput and reuse serve's get samples (#50981)

2026-08-06 10:31:23 +00:00

compile

[ROCm][CI] Update AITER AR+RMS e2e fusion counts for final-norm coverage (#51273)

2026-08-06 13:05:16 -05:00

config

[EPD] Remove duplicate image preprocessing in EPD and enable preprocess on GPU (#50390)

2026-08-05 15:59:54 -07:00

cuda

[Bugfix][Platform] Stop re-initializing NVML on every device-capability check (fixes #50381) (#50393)

2026-08-07 08:30:00 +00:00

detokenizer

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391)

2026-07-23 18:14:06 +08:00

distributed

feat: extended EPLB support for Mistral Large 3 and additional MoE backends (#48355)

2026-08-07 05:32:52 -07:00

engine

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

entrypoints

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

evals

Support DeepSeek-V4 AMD Quark NVFP4 with emulation kernel (#47972)

2026-08-07 01:19:31 -07:00

fusion

Add the QuantizedActivation linear-kernel contract (#44260)

2026-06-12 13:48:15 -07:00

ir

[Perf] Set IR Op Priority Once at Worker Init (#42631)

2026-05-15 15:56:13 +00:00

jit_monitor

[Kernel][CI] --jit-monitor-mode error e2e tests for kernel warmup infra (#50109)

2026-07-31 08:53:16 -04:00

kernels

feat: extended EPLB support for Mistral Large 3 and additional MoE backends (#48355)

2026-08-07 05:32:52 -07:00

lora

[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)

2026-08-06 09:13:10 +08:00

model_executor

[ModelRunner v2] Enable decoder token-wise pooling (#50931)

2026-08-06 22:21:52 +00:00

models

[ROCm][Perf] Kimi-K3 Shard Latent MoE up-projection for ROCm path (#51253)

2026-08-07 06:11:18 +00:00

multimodal

[Bugfix] Emit a valid media type from encode_{audio,image,video}_url (#49056)

2026-08-03 19:02:23 +00:00

parser

[Model][Frontend] Add Ling 3.0 Flash BF16, MTP, and parser support (#51045)

2026-08-06 00:38:28 +08:00

plugins

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

plugins_tests

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

prompts

…

quantization

feat: extended EPLB support for Mistral Large 3 and additional MoE backends (#48355)

2026-08-07 05:32:52 -07:00

reasoning

[Bugfix][Reasoning] kimi_k3: O(delta) reasoning-end check on the decode path (#50886)

2026-08-04 10:37:03 +08:00

renderers

[Frontend] Cohere chat v2 api support (#47189)

2026-07-31 22:53:54 -07:00

rocm/aiter

[ROCm][CI] Add aiter per-token FP8 quant roundtrip and RMSNorm determinism tests (#50905)

2026-08-04 21:32:08 -05:00

samplers

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

spec_decode

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

standalone_tests

[CI][AMD] Configure MI300 tests for native execution without DinD (#48387)

2026-07-15 02:14:16 +00:00

system_messages

…

tokenizers_

[Frontend] DeepSeek V4 0731 reasoning effort prompts & mappings (#50580)

2026-08-04 08:51:32 -07:00

tool_parsers

[GPT-OSS] Strict tool call and constrained decoding for Harmony (#45560)

2026-08-01 12:10:26 -04:00

tool_use

[Frontend][Bugfix] Use default tool call IDs for Kimi K3 for conversation-level uniqueness (#50420)

2026-07-31 10:02:17 +08:00

tools

[ROCm][CI] Adding metadata (#47477)

2026-07-02 17:45:23 -07:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

utils_

[Core] Explicitly manage torch CPU threads in workers (#49919)

2026-08-04 10:06:38 -07:00

v1

[Bugfix][KV-transfer] MoRIIO: per-layer READ-completion barrier in wait_for_layer_load (#48534)

2026-08-07 14:23:33 +00:00

vllm_test_utils

…

weight_loading

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

__init__.py

…

ci_envs.py

…

conftest.py

[CI] Retry Hugging Face processor loading (#49908)

2026-07-31 08:48:08 +08:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

…

test_cmake_utils.py

[Build] Fix CUDA arch detection producing kernel-less builds on SM121 (#49904)

2026-07-27 22:01:56 -07:00

test_config.py

[Bugfix] Skip fetching revision for model when model and weights_model are different (#51260)

2026-08-07 12:55:50 +00:00

test_embedded_commit.py

…

test_envs.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

test_logprobs.py

…

test_outputs.py

…

test_pooling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_sampling_params.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_scalartype.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

utils.py

[CI] Organize speculative decoding E2E tests by coverage (#50330)

2026-07-31 18:05:42 -07:00