Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 97a042f3bc Make the httpx logger less annoying when Transformers v5 is installed (#30480) Harry Mellor 2025-12-11 15:44:56 +00:00
• 3a3b06ee70 [Misc] Improve error message for is_multimodal (#30483) Cyrus Leung 2025-12-11 22:39:51 +08:00
• f4417f8449 [KVConnector] Add KV events to KV Connectors (#28309) Martin Hickey 2025-12-11 14:30:29 +00:00
• a11f4a81e0 [Misc][PCP&DCP] relocate PCP feature check (#30050) QiuandCyrus Leung 2025-12-11 19:36:18 +08:00
• 853611bb18 Fix typo of endpoint name in CLI args docs (#30473) Kenichi Maehashi 2025-12-11 20:07:56 +09:00
• d917747c95 [Bugfix] Fix task still being passed in tests/benchmarks (#30476) Cyrus Leung 2025-12-11 18:33:55 +08:00
• a5f9fb5960 [Deprecation] Deprecation --convert reward, use --convert embed instead. (#30463) wang.yuqi 2025-12-11 18:18:25 +08:00
• 4515eb1a0b [Fix] Update lazing loading of video loader backend (#30444) jeremyteboulandJeremy Teboul 2025-12-11 02:14:57 -08:00
• 13d63b65e0 [Deprecation] Remove missed fallback for embed_input_ids (#30469) Cyrus Leung 2025-12-11 18:06:36 +08:00
• b4e8b91278 [Fix]fix import error from lmcache (#30376) wz1qqxandwz1qqx 2025-12-11 17:23:52 +08:00
• 6299628d32 [bugfix] fix MiniMaxM2ReasoningParser streaming output not separating reasoning_content. (#29882) Rei. 2025-12-11 17:05:08 +08:00
• fba8906930 [perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill (#29710) Ming Yang 2025-12-11 00:20:45 -08:00
• d02d1043de fix: enhance human_readable_int function (#30337) Ning Xie 2025-12-11 15:30:33 +08:00
• 979f50efd0 [Deprecation] Remove fallbacks for embed_input_ids and embed_multimodal (#30458) Cyrus Leung 2025-12-11 14:58:23 +08:00
• 36c9ce2554 Ensure minimum frames for GLM 4.6V compatibility (#30285) gh-wf 2025-12-11 00:26:49 -05:00
• 1a516557e1 [Doc] Add Baidu Kunlun XPU support (#30455) xyDong0223 2025-12-11 12:52:17 +08:00
• d6464f2679 [Chore] Fix torch precision warning (#30428) Wentao Ye 2025-12-10 23:05:56 -05:00
• 7e24e5d4d6 [Deprecation] Remove deprecated task, seed and MM settings (#30397) Cyrus Leung 2025-12-11 11:59:39 +08:00
• 5a87d8b9b1 [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) Cyrus Leung 2025-12-11 11:59:35 +08:00
• d1e1fb4363 [Bugfix] Fix grouped_topk pytorch impl when num_experts can't be grouped properly (#29439) 3 people 2025-12-10 21:47:18 -06:00
• b51255f369 [ROCm] Fix broken import in platform attention backend dispatching (#30432) Andreas Karatzas 2025-12-10 19:12:58 -06:00
• b4054c8ab4 Revert "[CI] Add Async Eplb nightly CI tests (#29385)" (#30431) Sage Moore 2025-12-10 16:48:35 -08:00
• 25221b44bb Add more docs for regex (#30106) Xu Songandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-11 08:12:21 +08:00
• 8580919ac3 [Bugfix] fix confusing OOM errors during v1 init (#28051) shivamprandChen Zhang 2025-12-10 15:17:41 -08:00
• 166ac3c94d fix(shm): Add memory barriers for cross-process shared memory visibility (#30407) Christina Norman 2025-12-10 17:01:19 -06:00
• b9e0951f96 [docs] Improve wide-EP performance + benchmarking documentation (#27933) Seiji Eicher 2025-12-10 17:15:54 -05:00
• fcb894222f [Docs] Update EPLB docs (#30426) Michael Goin 2025-12-10 15:56:51 -05:00
• 6ccb7baeb1 [LMCache] Fix breakage due to new LMCache version (#30216) Nick Hill 2025-12-10 11:52:01 -08:00
• eea41804a4 [bug] Fix "Current vLLM config is not set." warnings when FlashInfer attention is used (#30241) Po-Han Huang (NVIDIA) 2025-12-11 03:18:51 +08:00
• 9f042ba26b [Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289) Jialin Ouyang 2025-12-10 11:13:01 -08:00
• e72d65b959 {Deprecation] Remove tokenizer setter (#30400) Cyrus Leung 2025-12-11 03:10:58 +08:00
• a9e4106f28 [P/D] KV Load Failure Recovery/Abort Configuration (#26813) 4 people 2025-12-10 14:00:52 -05:00
• e8e8cd73e5 [Bugfix] Fix HunyuanOCR cross-image contamination in batch processing (#30344) Anker 2025-12-10 19:09:31 +01:00
• 253305d5b2 [Chore] Delay recent deprecations (#30398) Cyrus Leung 2025-12-11 01:48:38 +08:00
• 794a7875ee [Misc] Consistent case for vllm bench serve results (#30403) Matthew Bonanni 2025-12-10 12:44:02 -05:00
• 2dcbac9077 [Docs] Generate full list of metrics in user docs (#30388) 3 people 2025-12-10 16:09:34 +00:00
• aacf0abf8b [BugFix] Fix AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight_scale' (#30399) Lucas Wilkinson 2025-12-10 10:59:23 -05:00
• c756fb6781 [Core] Whisper enable FULL_DECODE_ONLY CudaGraph (#30072) Nicolò Lucchesi 2025-12-10 15:14:24 +01:00
• d017bceb08 [BugFix] Fix minimax m2 model rotary_dim (#30384) Roger Youngandxuebi 2025-12-10 20:58:50 +08:00
• cebda2a4af [CPU] Support for Whisper (#30062) Aditya Tewari 2025-12-10 12:58:42 +00:00
• 53d2420b44 [Bugfix] tpu_model_runner: set vllm config context when calling reset_dynamo_cache() (#30331) Daniele 2025-12-10 13:58:35 +01:00
• 9db78f34dc [Bugfix] Fix the issue where DeepSeek v3.2 cannot use structured_output (#30371) Chauncey 2025-12-10 16:30:16 +08:00
• 434ac76a7c [cpu][ci] Add CPU Attention Tests for Neon Backend (#30347) Fadi Arafeh 2025-12-10 05:37:35 +00:00
• ed7af3178a [ROCm][CI] Attempt to fix the failures under a subgroup of the e2e the test group (#29358) Andreas KaratzasandMicah Williamson 2025-12-09 23:33:13 -06:00
• 180345807f [CMake][Build]: Remove unused ACL CMake env variables (#30339) Radu Salavat 2025-12-09 20:27:19 -08:00
• d007387aa7 [Bugfix] Cache added_vocab to avoid per-token overhead (#30351) Mingliang Liandlimingliang 2025-12-10 12:05:51 +08:00
• 3bdd426636 Fix typos in comments across multiple files (#30345) Wilson WuandWentao Ye 2025-12-10 12:05:28 +08:00
• 06462392e4 [bugfix][quantization] fix quark qwen3 kv_cache quantization (#30308) haoyangli-amd 2025-12-10 11:24:12 +08:00
• 7d80c73d42 [CI] Reduce Flakiness For test_spec_decode.py::test_suffix_decoding_acceptance (#30367) Micah Williamson 2025-12-09 20:35:49 -06:00
• b75f826fca [CI/Build][AMD] Skip quantization kernels tests that require CUTLASS or e4m3fn when not supported by platform (#30020) rasmithandRandall Smith 2025-12-09 20:28:37 -06:00
• c3487aca34 [responsesAPI][6] Fix multi turn MCP tokenization (#30230) Andrew XiaandAndrew Xia 2025-12-09 18:13:13 -08:00
• abe93bce59 [Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624) Lucas WilkinsonandBenjamin Chislett 2025-12-09 20:18:10 -05:00
• 2e7035dd8c [Bugfix] Fix fp8 DeepGemm compilation issues (#30336) ElizaWszola 2025-12-10 02:17:25 +01:00
• 4c2e10ea19 [Bugfix] Fix cuda graph sizes when running with speculative decoding (#30330) PatrykSafferandPatryk Saffer 2025-12-10 01:47:07 +01:00
• 03b5f940fd [V1][Spec Decode] Optimize Medusa proposer to avoid GPU-CPU sync (#29723) dongbo910220 2025-12-10 08:15:01 +08:00
• 2e7054da06 Improve wvsplitK tile and balance heristics. (#29937) Hashem Hashemi 2025-12-09 15:51:32 -08:00
• 3c680f4a17 [Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693) 5 people 2025-12-09 16:39:26 -06:00
• fccd532587 [Quantization] FP8 Weight Reloading for Quantized RL Rollout (#28480) Kyle Sayers 2025-12-09 16:54:32 -05:00
• 00e5cbb967 [MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066) 4 people 2025-12-09 16:48:25 -05:00
• 7618dc973d [CI/Build] Make test_mha_attn.py run on correct platform only and check for flash_attn_varlen_func in layer.py (#29145) rasmith 2025-12-09 14:18:17 -06:00
• f8dacc66b6 Bump actions/stale from 10.1.0 to 10.1.1 (#30234) dependabot[bot]anddependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> 2025-12-09 20:12:14 +00:00
• 7cab92fd45 Bump actions/checkout from 6.0.0 to 6.0.1 (#30233) dependabot[bot]anddependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> 2025-12-09 20:03:16 +00:00
• 73a484caa1 [Model][Quantization] Fix / Add GGUF support for Qwen2 MoE models (#30307) Tsukasa OI 2025-12-10 04:13:10 +09:00
• b37bf51e75 [CI/Test] Fix FP8 per-tensor quant test reference scale shape (#30352) Lucas Wilkinson 2025-12-09 13:52:20 -05:00
• 95501a70ec [BugFix] Fix DeepSeek-R1 hang with DP and MTP (#30119) 3 people 2025-12-09 13:51:19 -05:00
• e858bfe051 [Cleanup] Refactor profiling env vars into a CLI config (#29912) 3 people 2025-12-09 13:29:33 -05:00
• d471b2aff0 [Model Runner V2] Support num NaNs in logits (#30187) Woosuk Kwon 2025-12-09 10:00:49 -08:00
• 9e6562a3f6 [Model Runner V2] Fix Triton warning on tl.where (#30355) Woosuk Kwon 2025-12-09 09:59:54 -08:00
• 0b6a8a304c [BugFix] Fix non detected failing tests (#30277) Ilya Markov 2025-12-09 18:57:55 +01:00
• 804e3468c0 Update AMD test definitions (2025-12-08) (#30298) Alexei-V-Ivanov-AMD 2025-12-09 11:31:30 -06:00
• 83319b44c2 [Compile] Fix torch warning TensorFloat32 tensor cores for float32 matrix multiplication available but not enabled (#29897) Wentao Ye 2025-12-09 10:40:37 -05:00
• 56037dfa2f [BugFix] Fix assert batch_descriptor.num_tokens == num_tokens_padded (#30173) Lucas Wilkinson 2025-12-09 10:36:12 -05:00
• 5dcd593baf [Feature] Batch-Invariant Support for FA2 and LoRA (#30018) quanliuandWentao Ye 2025-12-09 23:01:38 +08:00
• 5c213d2899 [BUGFIX] Mistral tool call parser v11+ (#30332) Julien Denize 2025-12-09 15:55:38 +01:00
• ee14644ba9 [ROCm] Aiter Quant Kernels (#25552) vllmellm 2025-12-09 22:27:37 +08:00
• 1166c31cc7 [Bugfix]: Fix glm46 awq marlin moe wna16 compatibility (#30210) Dongjie Zou 2025-12-09 07:20:21 -05:00
• 03416eada6 [bugfix][quantization] Fix fp8 per_tensor scale shape (#30257) haoyangli-amd 2025-12-09 19:28:50 +08:00
• c72ea10723 [Structured Output][Reasoning] Improves decoding throughput for models using single-token reasoning endings. (#30056) Hubert de La Jonquiere 2025-12-09 11:54:08 +01:00
• 67475a6e81 [DCP][Bugfix][CI] Fix accuracy issue of DCP when using FLASH_ATTN_MLA (#30309) Jaya Yuan 2025-12-09 16:22:14 +08:00
• 9c32df6101 [Bugfix] Qwen 3 VL Embedding loading (#30303) wang.yuqiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-09 16:04:02 +08:00
• aeb82b1930 [CI] Fix Flaky test_eagle_max_len Test (#30306) Micah Williamson 2025-12-09 01:33:34 -06:00
• aed846917f [Attention] Make split_decodes_and_prefills(..., require_uniform=True) support padding (#29644) Lucas WilkinsonandBenjamin Chislett 2025-12-09 02:24:01 -05:00
• e4605d225e [Misc] Fix safetensors import for safe_open (#30300) Yongtao Huang 2025-12-09 14:50:06 +08:00
• 58d5b3f514 [Model][Quantization] Restore MoE + GGUF models support (incl. Qwen3 MoE) by allowing Sideload Parameters (#30116) Tsukasa OIandIsotr0py 2025-12-09 14:30:05 +09:00
• c2e1987a6e [Doc] update Intel GPU MM status in Feature x Hardware matrix (#30294) Fanli Lin 2025-12-09 13:16:44 +08:00
• e130845984 [CPU][CI] Enable fused MoE tests in Arm CI (#30132) Fadi Arafeh 2025-12-09 04:55:39 +00:00
• 4b03b50211 update torchao safetensors impl (#30155) liangel-02 2025-12-08 23:46:35 -05:00
• 4c6fd25880 kv_transfer: Rename the shared storage connectors (#30201) Or Ozeri 2025-12-09 06:46:09 +02:00
• 03b91f7262 [Bugfix] Fix compressed-tensors models failing to load with transformers backend (#30287) Michael Goinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-08 23:44:28 -05:00
• f6227c22ab [Kernel]Support W4A8 Grouped GEMM on Hopper (#29691) czhu-cohere 2025-12-08 22:29:06 -05:00
• ea657f2078 Lora MoE Align Improvements (#29257) gnovack 2025-12-08 18:35:16 -08:00
• db14f61f2d [ci] Refactor CI file structure (#29343) Kevin H. Luu 2025-12-08 18:25:43 -08:00
• 78c7503364 [ROCm][CI] Skip NVIDIA-Only Prime-RL Test in AMD CI (#29420) Micah Williamson 2025-12-08 20:14:02 -06:00
• e41312a2f5 [Bugfix] Skip generation config fallback for GGUF to prevent multi-process hang (#30209) Christina NormanandClaude Opus 4.5 2025-12-08 19:52:43 -06:00
• 7b35011ad1 Mark qwen2_5_vl as xfail (#30283) Yanan Cao 2025-12-08 17:14:10 -08:00
• ae339b1a67 [Bugfix] Fix DeepGEMM after #29546 (#30267) Zhewen Li 2025-12-08 17:05:27 -08:00
• 0ee6416f67 [Perf] Optimize group_topk kernel, 1.9% Throughput improvement, 2.1% TPOT improvemnt (#30159) Wentao Ye 2025-12-08 19:44:01 -05:00
• d9417096d1 [Feature] Batch invariant: Enable TRITON_MLA without prefix-caching (#29125) Wentao Ye 2025-12-08 19:31:57 -05:00
• 9d6235ca9a [moe] Allow disabling DP chunking (#29936) Ming Yang 2025-12-08 16:29:36 -08:00
• f1599ca55d feat(metrics): Add prefill KV compute metric excluding cached tokens (#30189) Victor Ziliang Peng 2025-12-08 16:08:48 -08:00