Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• a736e5ff77 [CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all tests in nightly (#28074) Copilot 2025-11-07 15:58:16 +08:00
• 9da9208b20 [Bug] Fix missing token_ids for reasoning parser models in chat completions #28246 (#28256) baonudesifeizhai 2025-11-07 02:31:58 -05:00
• 11fd69dd54 [amd][gptoss] Perf gain because of block alignment (#28024) smit kadvaniandSmit Shaileshbhai Kadvani 2025-11-06 21:27:42 -08:00
• c0a4b95d64 Fix issues from #28242 (#28257) Harry Mellor 2025-11-06 20:23:17 -08:00
• a47d94f18c Add runai model streamer e2e test for GCS (#28079) Alexis MacAskill 2025-11-06 19:07:54 -08:00
• e70fbc599b [CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (#28247) Alex BrooksandCyrus Leung 2025-11-06 19:51:27 -07:00
• 4bf56c79cc [Multimodal][torch.compile] Add compilation config field for turning off ViT/MM compile (#28242) Lucas Kabela 2025-11-06 16:16:03 -08:00
• 59b453eaa2 Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483) Junhong LiuandJunhong 2025-11-07 07:51:28 +08:00
• 827e4237bc Fix failing test for CRadio (#27738) 5 people 2025-11-07 01:32:25 +02:00
• ca6f755d24 [BugFix] Fix FusedMoELoRA + ModularKernel Integration (#28237) Varun Sundar RabindranathandVarun Sundar Rabindranath 2025-11-06 17:53:30 -05:00
• ca90f50304 [Test] Add non-MoE DP test coverage (#28235) Matthew Bonanni 2025-11-06 15:59:57 -05:00
• da855b42d2 [Doc]: Make extraInit containers fully configurable in helm chart (#27497) Fang Han 2025-11-06 12:27:16 -08:00
• 449de9001a [ROCm] triton fp8 kernel (#27058) 3 people 2025-11-06 11:46:44 -08:00
• d4aa65c998 [Chore] eliminate duplicated and unconditional object serialization in anthropic messages api (#27792) Vico Chu 2025-11-07 03:09:19 +08:00
• 7a8375f8a0 Add llama 4 scaling support (#28145) Julien Denize 2025-11-06 19:55:17 +01:00
• 5e0c1fe69c [Structured outputs] Upgrade llguidance to 1.3.0 (#28039) Andy LoandRussell Bryant 2025-11-06 18:24:47 +00:00
• 4507a6dae4 CODEOWNERS: Add myself as reviewer on security docs (#28216) Russell Bryant 2025-11-06 12:39:42 -05:00
• d1dd5f53e4 [Frontend] Fix logging format when enable response logging (#28049) Roy Wang 2025-11-07 00:25:39 +08:00
• e52e4da971 [HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953) StanHatkoandLi, Jiang <jiang1.li@intel.com> 2025-11-06 10:47:11 -05:00
• 2176778cd3 [Doc] Add Arm CPUs are on the list of supported targets in vLLM (#26018) Milos Puzovic 2025-11-06 15:30:26 +00:00
• 0370679ce9 [Kernel][Model] Tune fused_moe Triton configs for MiniMax-M2 on H100 (#28200) Eric Yue 2025-11-06 23:29:46 +08:00
• 8816e375d3 [Docs] Switch to directory style URLs (#28058) Harry Mellor 2025-11-06 07:06:33 -08:00
• f32229293e Disable nm-testing models with issues in CI (#28206) Michael Goin 2025-11-06 22:19:07 +08:00
• c757a15f0f [CPU]Improve cpu fused moe perf (#27244) xiangze-arm 2025-11-06 19:04:18 +08:00
• 59a50afa08 [Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) Chauncey 2025-11-06 18:40:03 +08:00
• 981cadb35c [Bugfix][Kernel] fix merge attn states when both prefix and suffix are empty (#28181) courage17340 2025-11-06 17:52:13 +08:00
• c3ee80a01a [V0 deprecation]clean up is_v1_supported_oracle (#28116) wangxiyuan 2025-11-06 16:05:32 +08:00
• 3755c14532 [CPU] Enable torch profiling (#28130) Aditya Tewari 2025-11-06 07:32:05 +00:00
• 201dc98acc Fix hard-coded parameter name in gemma3n.py (#27946) 4 people 2025-11-06 16:07:36 +09:00
• a404e2c0f1 Patch Mistral Tokenizer (#28146) Julien Denize 2025-11-06 07:43:16 +01:00
• e31946f86e [flashinfer] fix FI all2all with FI cutlass moe (#28166) Xiaozhu Meng 2025-11-05 21:52:16 -08:00
• bde5039325 [CI] Add compile/test_multimodal_compile.py to CI (#28151) gmagogsfmandIsotr0py 2025-11-05 21:41:47 -08:00
• d72299d47b Make the cv2 dependency optional (#27780) Jacob Zhong 2025-11-06 13:08:55 +08:00
• 80679f108f [Core][MM] Use non-blocking CPU-GPU copy of multimodal data (#28141) Lukas Geiger 2025-11-06 04:05:12 +00:00
• 43ecd0a900 [Chore] Clean up deepseek v2/v3 config copy (#28055) Isotr0py 2025-11-06 11:46:30 +08:00
• 07d614511f [Misc] Remove the duplicate code (#28111) Chauncey 2025-11-06 10:07:47 +08:00
• f948ab6945 [CI Failure] nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV was removed from HF. Skip it in tests (#28170) Vadim Gimpelson 2025-11-06 05:22:13 +04:00
• d71af5f502 [Feature] Enable TP + EP shared_experts overlap with router, 3.7% E2E performance improvement (#28164) Wentao Ye 2025-11-05 20:21:08 -05:00
• 90189c71a9 [Bug] Fix env string "0" same to True (#28159) Wentao Ye 2025-11-05 20:04:20 -05:00
• d79d9f0780 [Bug] Fix cpu disable shared_experts VLLM_DISABLE_SHARED_EXPERTS_STREAM (#28157) Wentao Ye 2025-11-05 20:03:09 -05:00
• b6a248bdd7 [PERF] Decouple projections from GDN custom op. Attempt 2 (#28083) Vadim Gimpelson 2025-11-06 05:01:12 +04:00
• 1767658559 [Debugging] Add annotation for easier trace analysis (#22496) Dayeol Lee 2025-11-05 16:52:52 -08:00
• efe73e9b57 [Core][Hybrid allocator + connector 2/n] Unify remove_skipped_blocks by get_last_useful_token (#25431) Kuntai Du 2025-11-05 16:12:00 -08:00
• 0b8e871e5e [CI/Build] Fix test_defaults_with_usage_context in AMD CI (#27926) Zhewen Li 2025-11-05 15:40:24 -08:00
• 5ee93a5956 [CI/Build] Update checking logic in cutlass_group_gemm_supported (#27948) Zhewen Li 2025-11-05 15:40:10 -08:00
• e15601789b [Feature]: Add corrupted request metric to V1 metrics system. (#27306) Snehlata 2025-11-06 03:15:29 +05:30
• 65ac8d8dc4 [Docs] Add guide to debugging vLLM-torch.compile integration (#28094) Richard Zou 2025-11-05 16:31:46 -05:00
• ffb08379d8 [Chore] Remove Nemotron-Nano-VL config copy (#28126) Isotr0py 2025-11-06 04:06:45 +08:00
• e04492449e [Hardware][IBM Z] Optimize s390x Dockerfile (#28023) R3hankhan 2025-11-06 00:55:44 +05:30
• 518ec6b722 [Docs] Clean up README_TUNING.md (#28088) Michael Yao 2025-11-06 03:01:34 +08:00
• 802748bddb [Bugfix] Fix Qwen3-Reranker-8B load (#28117) wang.yuqi 2025-11-06 02:33:50 +08:00
• faedbb4d4f [Feature] Extend batch invariant torch.compile to B200 (#27856) Paul Zhang 2025-11-05 13:04:49 -05:00
• 40db194446 [CI]: Add LMCacheConnector Unit Tests (#27852) 3 people 2025-11-05 09:45:57 -08:00
• c765f0b443 [FlashInfer] Avoid FlashInfer block_size 16 + head_size 256 on blackwell (#27994) Chen Zhang 2025-11-05 09:25:32 -08:00
• 002b07c4b2 [Bugfix] vLLM should check Inductor config for compile cache enablement status (#27637) gmagogsfm 2025-11-05 09:22:44 -08:00
• 752ddeacaa [Core] add support for reasoning parser plugins (#28075) Walter Beller-Morales 2025-11-05 12:15:06 -05:00
• c18f88c6ca [Kernel] Fuse computation of g and beta for Gated Delta Net (#28095) Jiangyun Zhu 2025-11-06 01:14:55 +08:00
• 6fd0df8132 [misc] add vLLM Beijing Meetup (#28127) Jiaju Zhang 2025-11-06 01:12:59 +08:00
• 3f5a4b6473 [Bugfix] Validate custom logits processor xargs for online serving (#27560) Isotr0py 2025-11-06 00:53:33 +08:00
• 6cae1e5332 [ROCm][MLA] Support block-size > 1 for AITER MLA backend (#27224) Pleaplusoneandwuhuikx 2025-11-05 23:43:02 +08:00
• 80c9275348 Enabling cooperative multi-gpu tests on multi-gpu nodes (#27986) Alexei-V-Ivanov-AMD 2025-11-05 09:35:49 -06:00
• e50c454672 [BugFix] Support EP/DP + EPLB with MTP (#25311) 4 people 2025-11-05 16:22:17 +01:00
• 5d16d0fa62 [DCP] check return_lse for all layers in dcp (#27929) Chen Zhang 2025-11-05 06:27:25 -08:00
• 0606bea2b6 add kimi reasoning parser (#28128) bigmoyanandwangzhengtao 2025-11-05 21:48:33 +08:00
• 6e97eccf5d [XPU] Enable custom routing functions in IPEX for Llama4 (#28004) Frost Mitchell 2025-11-05 08:39:57 -05:00
• 6ab183813c [Graph Partition][Cache] Use inductor partition ops config (#27702) Boyuan Feng 2025-11-05 05:04:48 -08:00
• 6b7a81185d Bugfix: Cutlass FP8 FusedMoE bad scaling factors (#27255) 3 people 2025-11-05 13:06:06 +02:00
• b57789b62b Fix excessive logging noise by reducing the log level of the MinimaxM2ToolParser import success message (#27635) Eric Yue 2025-11-05 19:03:51 +08:00
• 377061d481 [Misc] fix import error for DeepSeekR1ReasoningParser (#28114) Chauncey 2025-11-05 19:02:32 +08:00
• 86dca07d9b [Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011) Kuntai Du 2025-11-05 02:36:31 -08:00
• 16b37f3119 [bugfix] fix wrong dcp_local_seq_lens calc (#27518) Qiu 2025-11-05 17:58:13 +08:00
• 0976711f3b [Refactor] to simplify and extract the shared logic between chat completion and responses (#27961) Chauncey 2025-11-05 15:46:39 +08:00
• e261d37c9a [Refactor] Lazy-loaded reasoning_parser (#28092) Chauncey 2025-11-05 15:37:02 +08:00
• b7cbc25416 [Model, Core] Support Granite Speech & LoRA for STT (#24455) Alex Brooks 2025-11-05 00:33:48 -07:00
• d43ad5a757 [BugFix] Fix DCP Assert (AssertionError: DCP not support reorder_batch_threshold > 1 now.) (#28100) Lucas Wilkinson 2025-11-05 01:54:43 -05:00
• 0ff05e3770 [Bugfix] Fix encoder-only model support for transformers backend (#28021) Isotr0pyandHarry Mellor 2025-11-05 14:24:41 +08:00
• 428bc7bf1c [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) wangxiyuan 2025-11-05 12:51:16 +08:00
• 878fd5a16f [CI/Build] Enable some fixed tests in AMD CI (#28078) Zhewen Li 2025-11-04 19:15:59 -08:00
• 18b39828d9 [XPU] Add gpt-oss model support for Intel GPU (#27786) Kunshang Ji 2025-11-05 10:17:23 +08:00
• 4ea62b77f5 [Qwen3-Next] MOE configs for A100-SXM4-80GB TP4 TP8 (#27740) tou 2025-11-05 09:25:09 +08:00
• d4e547bb7e Revert "[PERF] Decouple projections from GDN custom op" (#28080) Vadim Gimpelson 2025-11-05 03:58:23 +04:00
• 2d977a7a9e [ROCm] gemm_a16w16 upstreaming (#26969) Aleksandr MalyshevandAleksandr Malyshev 2025-11-04 13:01:00 -08:00
• 1fb4217a05 [Multimodal] Make MediaConnector extensible. (#27759) Chenheli Hua 2025-11-04 10:28:01 -08:00
• 611c86ea3c Added disable rule to track files under benchmarks/lib (#28048) nadavkluger 2025-11-04 20:18:43 +02:00
• dc937175d4 [ROCm][Perf] New design on ROCm AITER MHA backend Implementation (#25763) Pleaplusone 2025-11-05 02:05:33 +08:00
• 2f1cc8cef1 Remove deprecated --rope-scaling and --rope-theta (#28006) Harry Mellor 2025-11-04 10:01:56 -08:00
• 938a81692e [AsyncScheduling] Don't schedule past request max_tokens (#27922) Nick Hill 2025-11-04 09:06:28 -08:00
• c9f66da8fd [PerfFix] Avoid separate thread for MP executor shm spin (#28012) Nick Hill 2025-11-04 08:33:55 -08:00
• 05cae69f0f [model] Add support for openPangu_Ultra_MoE (#27521) yt0428andJee Jee Li 2025-11-05 00:17:20 +08:00
• 5fd8f02ea9 [PERF] Decouple projections from GDN custom op (#27512) Vadim Gimpelson 2025-11-04 20:11:41 +04:00
• 97e3dda84b [Perf] SM100 - add swap AB optimization to CUTLASS FP8 GEMM (#27284) 3 people 2025-11-04 07:49:25 -08:00
• 5a0a6dfd55 [BugFix] Fix incorrect preallocated sampled_token_ids tensor size (#28025) Nick Hill 2025-11-04 07:38:16 -08:00
• 938772af03 [Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123) bnellnm 2025-11-04 08:59:45 -05:00
• e4ee658672 [Model] add optimal triton fused moe configs for NemotronH MoE (#27967) tomeras91 2025-11-04 14:59:43 +02:00
• 77f8001f53 [Model][Bugfix] fix pipeline parallelism support for NemotronH (#27968) tomeras91 2025-11-04 14:28:36 +02:00
• 300a265978 [Core] Enable StatLogger in LLMEngine (#28020) Zhuohan Li 2025-11-04 04:13:35 -08:00
• 03c4c4aa9d Support using Int4PreshuffledTensor after loading (#26066) Jerry Zhang 2025-11-04 03:00:57 -08:00
• 2ec401bc39 Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) yugong333andJee Jee Li 2025-11-04 02:27:35 -08:00
• 4022a9d279 [BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904) Varun Sundar Rabindranath 2025-11-04 02:56:21 -05:00
• 53f6e81dfd [CI/Build] Fix OpenAI API correctness on AMD CI (#28022) Zhewen Li 2025-11-03 23:20:50 -08:00