Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• e1dd706cd1 [Frontend] Respect Chat Completion parallel_tool_calls param (#26233) Ben BrowningandChauncey 2025-11-25 04:56:15 -05:00
• a685b47c57 [responsesAPI] refactor construct_input_messages (#29359) Andrew XiaandAndrew Xia 2025-11-25 01:47:10 -08:00
• 32c40b95e0 [BugFix] bad_words filtering ineffective when n > 1 (#29313) Avishek Goswami 2025-11-25 15:06:34 +05:30
• db2906108a [Misc] Streamline unique id generation (#29375) Nick Hill 2025-11-25 00:30:11 -08:00
• 67fc16cd8c [Bugfix] If chunked_prefill is disabled, end the scheduling early. (#28911) wang.yuqi 2025-11-25 16:06:09 +08:00
• 6330f9477d [Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) elvischenv 2025-11-25 15:59:40 +08:00
• ef1f7030f0 [ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367) Micah Williamson 2025-11-25 01:55:09 -06:00
• 12c007e288 EAGLE Support DP>1 (#26086) Rémi Delacourt 2025-11-25 08:32:21 +01:00
• f242cfcdd5 [Perf] use cpu all reduce to avoid sync when async_scheduling & dp > 1 (#29311) zhrrr 2025-11-25 15:31:07 +08:00
• 888152bf87 Allow oot custom compiler extension via CompilerInterface (#28623) IceyandMengqing Cao 2025-11-25 15:25:15 +08:00
• fe3a4f5b34 [CI/Build] Pin torchgeo dependency for AMD (#29353) Ryan Rock 2025-11-25 01:14:59 -06:00
• 98caeadd54 [fix][cpu] Use a SwigluOAI impl which supports interleaved gate-up wei (#29273) Fadi Arafeh 2025-11-25 07:11:11 +00:00
• 64deead719 [Bugfix] [ROCm] [UX]: revert Flex attention backend (#29371) vllmellm 2025-11-25 14:56:06 +08:00
• 7992324f23 [BugFix] Use unique ids for different transcription prompts (#29372) Nick Hill 2025-11-24 22:55:16 -08:00
• 40a6f53f6c Display warning only when ROCm version is less than Pytorch required version (#29200) Inoki 2025-11-25 07:40:06 +01:00
• ce58fdc1c3 Fix PoolingParams.skip_reading_prefix_cache type (#29364) kflu 2025-11-24 22:39:29 -08:00
• a21256c463 Add TP CLI argument to multimodal inference examples (#29301) Fanli Lin 2025-11-25 14:03:20 +08:00
• 316c8492bf Scheduled removal of guided_* config fields (#29326) Harry Mellor 2025-11-25 05:24:05 +00:00
• 2d9ee28cab [CI/Test Fix] Fix CP tests on Blackwell (#29338) Lucas Wilkinson 2025-11-24 23:55:57 -05:00
• 81db702ed2 [Attention] add _cudagraph_support for linear attention (#28934) Jiangyun Zhu 2025-11-25 12:25:20 +08:00
• 92effb07a4 [Model] Add HunyuanOCR support (#29327) 5 people 2025-11-25 11:28:51 +08:00
• 87185c88d5 [Bugfix] Make deprecated --task embedding consistent with `--runner… (#29312) Maryam Tahhan 2025-11-25 03:19:52 +00:00
• 9cf4edae6e [Metrics] Scheduled removal of deprecated metrics (#29330) Mark McLoughlin 2025-11-25 03:15:13 +00:00
• 7012d8b45e [Docker] Optimize Dockerfile: consolidate apt-get and reduce image size by ~200MB (#29060) 汪志鹏 2025-11-25 10:54:00 +08:00
• 22b42b5402 [CI][ROCm] Install arctic-inference on ROCm tests (#29344) Divakar Verma 2025-11-24 20:15:39 -06:00
• cb7214d8ea [ROCm][MLA] enable fp8 MLA decode on ROCm (#28032) gbyu-amdandguanbao 2025-11-25 10:15:02 +08:00
• 77e10c9cab [Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029) Pleaplusone 2025-11-25 10:05:46 +08:00
• 6f1355a1b7 [Perf] Disable DeepGEMM MoE by default when TP=8 is used (#29346) Michael Goin 2025-11-24 21:01:40 -05:00
• a4ad43ad5a Scheduled removal of ParallelConfig's direct child EPLB fields (#29324) Harry Mellor 2025-11-25 01:58:58 +00:00
• a178a0b40b [BugFix] Fix duplicate id tool-call race condition (#29355) Nick Hill 2025-11-24 17:54:26 -08:00
• b8328b49fb [XPU] upgrade torch & ipex 2.9 on XPU platform (#29307) Kunshang Ji 2025-11-25 09:34:47 +08:00
• 5f9679a43b [Spec Decode] Add support for EAGLE3 heads that do not use_aux_hidden_states (#27688) Hanjie QiuandBenjamin Chislett 2025-11-24 20:13:12 -05:00
• 699bca76c0 [UX] Raise error for attn backend of batch invariant (#29348) Wentao Ye 2025-11-24 19:49:01 -05:00
• c17610e2ba [Bugfix] Only use triton_kernels for MXFP4 on SM90 and SM100 (#29339) Michael Goin 2025-11-24 18:22:46 -05:00
• 71df2a57ef [Hybrid Allocator] Better layer padding strategy for gpt-oss eagle (#29303) Chen Zhang 2025-11-24 14:28:32 -08:00
• 4dd42db566 Remove VLLM_SKIP_WARMUP tip (#29331) Tyler Michael Smith 2025-11-24 17:16:05 -05:00
• 84371daf75 [Tests] Verify gpt_oss package is installed in harmony tests (#29336) Nick Hill 2025-11-24 14:04:31 -08:00
• f32c7d6f54 [Model Runner V2] Simplify Eagle bookkeeping with num_rejected (#29347) Woosuk Kwon 2025-11-24 13:54:59 -08:00
• 3cfa63ad99 [XPU]fix Kimi-VL-A3B-thinking on xpu (#29309) Yan Ma 2025-11-25 05:02:21 +08:00
• 4d6afcaddc [CI/Build] Moves to cuda-base runtime image while retaining minimal JIT dependencies (#29270) Benjamin Bartels 2025-11-24 19:40:54 +00:00
• 97588c4d12 [Model Runner V2] Add minor clarification comments for Eagle (#29332) Woosuk Kwon 2025-11-24 11:28:56 -08:00
• 839c6b7b72 [Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721) Chenheli HuaandRoger Wang 2025-11-24 11:24:37 -08:00
• 8f066146c3 [MoE][Refactor] Make select_experts a non-static method (#29067) bnellnm 2025-11-24 13:38:04 -05:00
• cec418b5df [Model Runner V2] Change Numba AoT to JIT (#29328) Woosuk Kwon 2025-11-24 09:34:37 -08:00
• cc313cb73d [Model Runner V2] Implement Single-step Eagle 1 (#29300) Woosuk Kwon 2025-11-24 09:32:27 -08:00
• 26a465584a [NIXL] Use config to enable telemetry + NIXL version bump (#29305) Nicolò Lucchesi 2025-11-24 18:18:04 +01:00
• e924bbb4f4 [Build/CI][DP/EP] Add QWen/Qwen3-30B-A3B-FP8 + EPLB tests to Nightly H100 and B200 (#29195) Varun Sundar RabindranathandVarun Sundar Rabindranath 2025-11-24 11:06:17 -05:00
• 656516c315 [Bugfix] properly handle nested json with llama3 tool parser (#27701) 4 people 2025-11-24 07:28:51 -08:00
• e48b2e6848 [Bugfix] [ROCm] [UX] Reorganize ROCm Backend Selection Logic (#26980) vllmellm 2025-11-24 22:24:49 +07:00
• 7a228b5305 Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199) Laith Sakka 2025-11-24 07:12:41 -08:00
• f716a15372 Update KServe guide link in documentation (#29258) Yuan Tang 2025-11-24 09:40:05 -05:00
• 2601f18a82 [EPLB] Optimize EPLB for Async Rearrange Experts (#22179) WeiQing ChenandSunChenxiang123 2025-11-24 22:08:29 +08:00
• 4de87866a8 [CPU][IBM Z] Fix BF16 support and vectorize math operations for s390x (#28926) R3hankhan 2025-11-24 17:38:09 +05:30
• eca7a8fb59 [Doc]: fix typos in various files (#29230) Didier DurandandHarry Mellor 2025-11-24 12:10:48 +01:00
• 8005e606bf [Bugfix][Rocm] Fix shared expert weight loading failure in DeepSeek-MTP (#27563) 杰兮andzhyajie 2025-11-24 18:16:52 +08:00
• 68dfe28eae [Feature][Benchmark] add --link-vars can filter when serve_param equal bench_param (#28909) rongfu.leng 2025-11-24 18:02:28 +08:00
• ed40d85929 [BugFix] Fix R-VL model loading error (#29299) Fanli Lin 2025-11-24 14:48:45 +08:00
• 0ff70821c9 [Core] Deprecate xformers (#29262) Roger Wang 2025-11-23 20:18:55 -08:00
• 5253f4276f [ROCm] Support for Whisper v1 with Aiter Unified Attention and Aiter Flash Attention (#28376) tongqiu 2025-11-24 11:26:00 +08:00
• 30854783ad [Model] Add OpenCUA-7B support (#29068) 3 people 2025-11-24 11:27:55 +09:00
• 1073ba68b0 [LoRA] Optimize 3D MoE logic (#29222) Jee Jee Li 2025-11-24 10:27:23 +08:00
• c309bb5245 [Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message history format (#29249) Josh Moore 2025-11-23 19:47:54 -05:00
• 3e1ad40655 [Model Runner V2] Add apply_temperature option to gumbel_sample (#29276) Woosuk Kwon 2025-11-23 14:13:00 -08:00
• 62d54ba46d [Model Runner V2] Optimize CUDA graph capture time (#29275) Woosuk Kwon 2025-11-23 11:15:32 -08:00
• b004c00418 [Model Runner V2] Support spec decoding [1/N] (#29274) Woosuk Kwon 2025-11-23 10:09:06 -08:00
• 7f12c82fa6 [Model Runner V2] Change bookkeeping logic in preparation for spec decoding (#29194) Woosuk Kwon 2025-11-23 09:42:52 -08:00
• 6fb0215eee [Bugfix] Use lazy string reference for DeepseekV3Config in config registry (#28958) LukeandIsotr0py 2025-11-23 06:43:21 -05:00
• 55c21c8836 [ROCm][CI] Fix "Cannot re-initialize CUDA in forked subprocess" in test_pynccl.py (#29119) Micah Williamson 2025-11-22 23:05:00 -06:00
• 3999442f1c [CI/Build][AMD] Add check for flash_att_varlen_func to test_tree_attention.py (#29252) rasmithandRandall Smith 2025-11-22 22:45:08 -06:00
• 71362ffab4 [CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency in test_multi_connector.py due to hipErrorLaunchFailure when calling .cpu() (#29253) rasmithandRandall Smith 2025-11-22 22:42:49 -06:00
• 20ee418adc [Model Runner V2] Minor fix for cudagraph_utils (#29256) Woosuk Kwon 2025-11-22 20:12:50 -08:00
• 389aa1b2eb [Doc] Update more docs with respect to V1 (#29188) Cyrus Leung 2025-11-23 10:58:48 +08:00
• 3ed767ec06 docs: fixes distributed executor backend config for multi-node vllm (#29173) Michael ActandMichael Goin 2025-11-23 09:58:28 +07:00
• 5f96c00c55 [Fix] Add SM check to flashinfer MOE backend (#29144) jiahancandmgoin 2025-11-22 16:39:30 -08:00
• 4587063267 Patch DeepEP when building docker image with CUDA 13 (#29154) Qidong Su 2025-11-22 18:25:13 -05:00
• 472fdee974 [Chore] Update batch invariant code owner (#29246) Wentao Ye 2025-11-22 16:50:02 -05:00
• df78aeef08 Refactor: Move CUDA graph dispatch logic earlier (#27382) Yizhou 2025-11-23 05:10:31 +08:00
• 7df331c66b [BugFix] Fix chunked prompt logprobs + preemption (#29071) Nick Hill 2025-11-22 13:07:18 -08:00
• eb5352a770 [CI/build] Removes source compilation from runtime image (#26966) Benjamin Bartels 2025-11-22 18:23:09 +00:00
• d1cf8214e5 [Bugfix] Use HF config fields as fallback when loading Mistral config (#29239) Cyrus Leung 2025-11-23 02:22:48 +08:00
• 730bd35378 [perf][cpu] Accelerate paged attention GEMMs (QK, PV) on Arm CPUs with NEON (#29193) Fadi Arafeh 2025-11-22 17:04:36 +00:00
• f55c76c2b3 chore: add RTX_PRO_6000 GLM4.6-FP8 kernel tuning (#29240) Federico 2025-11-22 17:42:48 +01:00
• d84d8f4429 Fix EVS crash when using video_embeds inputs in Qwen2.5-VL (#29232) ZiTian ZhaoandCyrus Leung 2025-11-22 22:48:59 +08:00
• ae66818379 [Misc] Fix pre-commit (#29238) Cyrus Leung 2025-11-22 22:48:01 +08:00
• d44a63c6d6 [BugFix] Fix returned logprobs with spec decode + prefill chunking (#29216) Nick Hill 2025-11-22 06:41:25 -08:00
• 066209a045 [Attention] Refactor FA block_size limitations to hybrid models only (#29084) Nicolò Lucchesi 2025-11-22 15:38:44 +01:00
• 5f7209a793 [tiny] Remove unsupported TRITON_MLA backend from batch invariance (#28832) Bram WastiandWentao Ye 2025-11-22 08:00:50 -05:00
• 2d4978a57e fix: clean up function never use in setup.py (#29061) yihong 2025-11-22 21:00:04 +08:00
• 6965a392a4 Fix: Resolve circular import in model_loader/utils.py (#29189) 3 people 2025-11-22 18:28:22 +05:30
• 5a4802588e [Misc] Further clean up chunked prefill and prefix caching init (#29186) Cyrus Leung 2025-11-22 19:34:15 +08:00
• 8e22da1d7f [CI/Build Don't add FLASHINFER backend in test_cpu_offloading.py (#29229) rasmithandRandall Smith 2025-11-22 05:00:54 -06:00
• a4fdf2405c [CI/Build] Skip tests that require libcudart in test_lmcache_integration.py (#29228) rasmithandRandall Smith 2025-11-22 04:59:39 -06:00
• e6309acdba Simplify from_blob usage in get_cuda_view_from_cpu_tensor (#29027) Jane (Yuan) Xu 2025-11-22 05:35:32 -05:00
• 988ee66b0d Handle triton kernel import exception (#29062) jinghanhu 2025-11-22 18:07:50 +08:00
• ea38474ac5 [Frontend][Responses API] Multi-turn (with type: "output_text") support for non-harmony requests (#29175) Mads Kildegård 2025-11-22 10:58:22 +01:00
• 742e9ff6b3 [responsesAPI] parse reasoning item input (#28248) 3 people 2025-11-21 23:42:11 -08:00
• e9056056fb [Model Runner V2] Limit cudagraph size to max decode batch size (#29221) Woosuk Kwon 2025-11-21 20:21:35 -08:00
• 1489902b53 [LoRA] Cleanup FusedMoEWithLoRA (#29187) Jee Jee Li 2025-11-22 12:01:30 +08:00
• 933f67ecd8 [Bugfix]Fix a conditional to not check zero value (#28754) Yanan Cao 2025-11-21 19:59:07 -08:00
• fd65015a14 [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) rasmithandRandall Smith 2025-11-21 21:34:33 -06:00