Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 3778673ea8 [Feat] Refactor for parallel_config in FusedMoEModularKernel (#30282) 3 people 2025-12-14 23:21:36 -05:00
• b337647aa0 [Bugfix] Drop empty tool_calls lists to keep assistant replies in chat template (#30648) Seokhyun An 2025-12-15 13:21:12 +09:00
• a524d1ba0a [Bugfix] Fix deepseek_v32 tokenizer_mode (#30658) Jee Jee Li 2025-12-15 12:20:31 +08:00
• 87b4d1557d [CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125) 3 people 2025-12-15 11:13:32 +08:00
• 84e23d103d additional protection for CVE-2025-62164 (#30649) Wenqi Glantz 2025-12-14 22:07:10 -05:00
• 738648fb81 [CustomOp] Support object-level enable for CustomOp (#30547) Shanshan Shen 2025-12-15 11:02:09 +08:00
• 917fdae5b2 [Log] Skip piecewise cudagraph warn when using full cudagraph (#30657) Boyuan Feng 2025-12-14 18:49:45 -08:00
• e2ed238885 Revert "[Fix]Load kv-cache dtype from hf_quant_config.json automatically" (#30653) Robert Shaw 2025-12-14 19:33:41 -05:00
• 174e39ead7 CPU KV Offloading: Use more CUDA streams (#29013) Or Ozeri 2025-12-15 01:50:45 +02:00
• 9ccbf6b692 [responsesAPI]add extra body parameters (#30532) RioS 2025-12-15 04:25:45 +09:00
• ae2e503dda [NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) Chendi.XueandMark McLoughlin 2025-12-14 09:38:28 -06:00
• 9e33a1a75b [Model][Quantization] Override HF defaults to GGUF ones (incl. Qwen3 MoE) (#30118) Tsukasa OI 2025-12-15 00:01:42 +09:00
• add4b0ca44 [Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596) Vensen 2025-12-14 22:57:15 +08:00
• ae88aada38 [Feature]Add EVS (Efficient Video Sampling) Support for Qwen3-VL (#29752) ZiTian Zhaoanddeitxfge 2025-12-14 21:24:56 +08:00
• 5ccf0efa84 [Bugfix] Improve error messages in ModelConfig validation (#30213) yifant-codeandytian218 2025-12-14 08:23:37 -05:00
• 994acec0cc [Bugfix] Fix fusion for VL models (#30244) ElizaWszola 2025-12-14 14:22:37 +01:00
• 48b8456ff9 [Bugfix] Revert Qwen2-VL part of change in #28271 (#30542) zifeitong 2025-12-14 05:20:08 -08:00
• 5b64ac21f9 [Bugfix] Update get_processor_data to use get_all method (#30583) Drew Botwinick 2025-12-14 07:19:20 -06:00
• a8ec486592 [Misc] Add a script to benchmark compilation time (#29919) Bin Bao 2025-12-14 08:02:39 -05:00
• 6ecc1e411b [Bugfix] fix _get_quant_method of FusedMoE for deepseekV3.2 on non-NV… (#30057) tjp_zju 2025-12-14 18:20:51 +08:00
• 0bb0bae436 Nvidia ModelOpt workaround for issue 28072 (#30164) Shengliang XuandPavani Majety 2025-12-14 02:18:31 -08:00
• 060893654d fix: Update json features supported by xGrammar (#30390) 3 people 2025-12-14 11:16:06 +01:00
• e9add129ad [Bugfix] awq_gemm: fix argument order swap (#30364) Matthias GehreandWentao Ye 2025-12-14 11:15:37 +01:00
• 3224ea9915 [torch.compile] Add encoder tag for compilation (#30489) Ilya Markov 2025-12-14 11:15:11 +01:00
• 3a20450d31 Add AudioFlamingo3 model support (#30539) 4 people 2025-12-14 05:14:55 -05:00
• 1a55cfafcb [Doc]: fixing typos in various files (#30540) Didier DurandandWentao Ye 2025-12-14 11:14:37 +01:00
• add1b9d3de [main][BugFix] Fixed an accuracy bug of Qwen3-next-MTP when batched inferring (#30632) drslark 2025-12-14 17:32:16 +08:00
• dcb31196da [Chore] Remove redundant RequestPrompt (#30612) Cyrus Leung 2025-12-14 17:22:37 +08:00
• f569c654e1 enable unbacked with aot_compile (#30462) Laith Sakka 2025-12-14 11:14:06 +03:00
• 97f2f160fd [ROCm][CI] Add "Qwen3-Next-80B-A3B-Instruct MTP Async EPLB Accuracy Test" Back Into AMD CI (#30590) 3 people 2025-12-14 00:56:26 -06:00
• 29f7d97715 Improve parse_raw_prompt test cases for invalid input .v2 (#30512) Kayvan Mivehnejad 2025-12-13 22:18:41 -05:00
• dc7fb5bebe [Bug][KVConnector][Metrics] Remove a vacuous assertion breaking external-launcher (#30577) Qier LiandQier Li 2025-12-13 20:23:08 -05:00
• 24429d5924 [Doc] Add instructions for building docker image on GB300 with CUDA13 (#30414) Qidong Su 2025-12-13 16:56:53 -05:00
• 6e78ed6ba7 [Logs] Optimize startup logs 4 (#29903) Wentao Yeandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-13 16:12:53 -05:00
• 7c16f3fbcc [Doc] Add documents for multi-node distributed serving with MP backend (#30509) Isotr0py 2025-12-14 02:02:29 +08:00
• ddbfbe5278 [Docs] Clarify Expert Parallel behavior for attention and MoE layers (#30615) lif 2025-12-14 01:37:59 +08:00
• 763963aa73 set assume_32bit_indexing and pass unbacked hints (#30459) Laith Sakka 2025-12-13 18:36:53 +03:00
• 39cefbdf17 [Refactor] TokenizerRegistry only uses lazy imports (#30609) Cyrus Leung 2025-12-13 23:16:22 +08:00
• ace34e3783 [Bugfix] Qwen3-next with --hf-overrides \{\"num_hidden_layers\":8\} (#30433) Chen Zhang 2025-12-13 06:12:45 -08:00
• e5db3e2774 [CI/Build] Fix broken mm processor test Mistral-3-large (#30597) Isotr0py 2025-12-13 20:43:01 +08:00
• 64251f48df [Chore] Adjust tokenizer import to avoid circular imports (#30601) Cyrus Leung 2025-12-13 20:42:39 +08:00
• 1cec5b7ea9 [Scheduer] Simplify stop checking for pooling models (#30591) Nick Hill 2025-12-13 01:45:26 -08:00
• b09806e28f [Bugfix] Dictionary MM embeddings for online chat (#30507) Cyrus Leung 2025-12-13 15:48:56 +08:00
• fdc135d768 [Misc][Quantization] Clarify the intent of GGUF FusedMoE weight materialization (#30310) Tsukasa OI 2025-12-13 14:55:14 +09:00
• 4fa7ce46f3 [Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) Roberto L. Castroandyoukaichao 2025-12-13 04:34:23 +01:00
• 57e9bf1864 [CI] Whisper logprobs tests (#30504) Nicolò Lucchesi 2025-12-13 03:49:11 +01:00
• 2f32a68d75 [CI] Update several models in registry that are available online now (#30514) Michael GoinandIsotr0py 2025-12-12 21:28:13 -05:00
• f5dfbbd8e9 [Docs] Remove references to VLLM_ATTENTION_BACKEND (#30564) Matthew Bonanni 2025-12-12 21:20:15 -05:00
• fc0119425c Add IBM and Red Hat to compute resources sponsors (#30581) Michael Goin 2025-12-12 20:34:23 -05:00
• 86a3261525 [Bugfix] Pass FA version in MultiHeadAttention (#30575) Matthew Bonanni 2025-12-12 19:02:11 -05:00
• 08f8a5627e [CI/Build][Kernel][BugFix][AMD] Fix per_token_group_quant_fp8 to use correct fp8 min/max values and update atol/rtol in test_quantfp8_group_functionality (#30292) rasmithandRandall Smith 2025-12-12 17:41:56 -06:00
• b4039c08b5 [ci] Mark PrimeRL integration test as soft fail (#30578) Kevin H. Luu 2025-12-12 14:13:09 -08:00
• 1e6b115300 [Refactor] Reduce duplicate code in per_token_group_quant cuda kernels (#30496) Wentao Ye 2025-12-12 16:45:23 -05:00
• 13618626df [MoE-FP8-modelopt] Add FlashInfer alignment padding for intermediate dimensions (#29748) 3 people 2025-12-12 22:42:32 +02:00
• 6ec0d8dbe4 [Fix]Load kv-cache dtype from hf_quant_config.json automatically (#29980) danielafrimi 2025-12-12 21:27:47 +02:00
• 9693dd0fe3 [CI/Build] Add x86 CPU wheel release pipeline (#28848) Li, Jiang 2025-12-13 03:21:35 +08:00
• 1f19d8f899 [Perf] Set split_k to 1 for triton_kernels (#30528) Xin Yang 2025-12-12 11:07:57 -08:00
• cd7740ac5c [ROCm] Enable Triton ScaledMM fallback + kernel selection fix (#26668) shivampr 2025-12-12 10:28:20 -08:00
• 02a5880394 [CI] Fix mypy for vllm/v1/executor (#30517) Wentao Ye 2025-12-12 13:05:34 -05:00
• d2c919dcc2 [bugfix] fix bug when top_logprobs=0 with spec decoding (#30059) realliujiaxu 2025-12-13 01:03:35 +08:00
• f3237f3f6b [Frontend] Fixes anthropic streaming message_start usage nesting (#30266) Benjamin Bartels 2025-12-12 16:28:54 +00:00
• 9c0ee995a8 [Kernel] Support CUDA Graphs in 3D Triton Attention Kernel (#28306) 3 people 2025-12-12 16:55:40 +01:00
• 09ad3b76b3 [Bug] Fix attention_backend arg string parsing (#30534) Michael Goin 2025-12-12 10:40:50 -05:00
• dc13c99eed fix(gguf): Disable bfloat16 for GGUF on blackwell device (#30408) 4 people 2025-12-12 09:10:12 -06:00
• 3e34adcdfb [DeepSeek V3.2] Proper drop_thinking logic (#30490) Vladislav Nosivskoy 2025-12-12 18:01:06 +03:00
• 3e41992fec [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) Lucas Wilkinson 2025-12-12 08:57:47 -05:00
• 91401c7a26 [Bugfix] Fix CMakeLists Environment Variable (#21804) 吴坎 2025-12-12 18:54:52 +08:00
• f90319d5d1 [Bugfix] Schedule failure due to wrong get_image_size_with_most_features (#29692) Jaehwang Jung 2025-12-12 19:27:20 +09:00
• 302b2c1eb9 [CI/Build][AMD] Fix ref_dynamic_per_token_quant reference implementation on ROCm. (#30291) rasmithandRandall Smith 2025-12-12 03:30:23 -06:00
• 8f8fda261a [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) Ben BrowningandChauncey 2025-12-11 23:59:53 -05:00
• fe1787107e [compile] Parse compile range cache keys as Range during cache loading. (#30516) Zhengxu Chen 2025-12-11 23:30:51 -05:00
• 783644e4ac [ROCm][CI] Skip multi-GPU speculative decoding tests when insufficient GPUs available (#30527) Andreas Karatzas 2025-12-11 21:54:56 -06:00
• 197473c4e7 [CI/Build] Use spawn subprocess for ROCm (#30272) Ryan Rock 2025-12-11 21:33:17 -06:00
• 947dfda9c2 [LMCache] Relax lmcache version requirement (#30425) Nick Hill 2025-12-11 19:18:47 -08:00
• 9f2fc16a69 [Bugfix][Model] Fix Afmoe rope_parameters issue (#30505) Michael GoinandHarry Mellor 2025-12-11 21:53:57 -05:00
• 6a6fc41c79 gptq marlin quantization support for fused moe with lora (#30254) Bhanu Prakash Voutharoja 2025-12-12 13:27:22 +11:00
• f355ad5412 [CPU][FIX] Fix build failures on Arm CPUs with torch nightly (#30481) Fadi Arafeh 2025-12-12 02:09:25 +00:00
• 042da73244 [Core] Refactor _build_attention_metadata (#29628) Lucas Wilkinson 2025-12-11 20:54:12 -05:00
• b5945d49c0 [ROCm][CI] Use mi325_4 agent pool for V1 e2e tests (#30526) Andreas Karatzas 2025-12-11 19:37:24 -06:00
• ba80926681 [CI/Build][AMD] Skip test_cutlass_w4a8_moe tests on ROCm sine they require cutlass_pack_scale_fp8 (#30508) 4 people 2025-12-11 19:02:19 -06:00
• 0ab23c2b2b [fix] fix SM check for Flashinfer TRTLLM MOE (#30314) jiahanc 2025-12-11 17:00:58 -08:00
• 48661d275f [CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm (#30417) rasmithandRandall Smith 2025-12-11 18:24:20 -06:00
• d527cf0b3d [FIX]Patch run-cluster.sh (fix for #28328) (#30002) Ev Lacey 2025-12-11 15:36:31 -08:00
• 2cc5affc38 [ROCM][CI] Fix AMD Examples Test Group (#30276) Concurrensee 2025-12-11 17:03:54 -06:00
• a00d88973d [EPLB] Support EPLB w/ NVFP4 (#29804) Andrew BriandandAndrew Briand 2025-12-11 16:59:40 -06:00
• 61249b177d [Refactor] Remove useless syncwarp (#30510) Wentao Ye 2025-12-11 17:43:41 -05:00
• c817b14151 [Perf] Optimize deepgemm experts initialization, 3.9% TTFT improvement (#30494) 3 people 2025-12-11 17:28:34 -05:00
• 3efdc3feae [Docs][CPU backend] Add pre-built Arm CPU Docker images (#30491) ioana ghiban 2025-12-11 23:03:29 +01:00
• 0efd9f867c [Core] Whisper Enable Encoder Batching (#29421) Nicolò Lucchesi 2025-12-11 22:06:51 +01:00
• 90d6cf921f [BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472) Xingyu LiuandCyrus Leung 2025-12-11 13:00:15 -08:00
• cf3eacfe58 Standardise get_rope to use rope_parameters["partial_rotary_factor"], not rotary_dim (#30389) Harry Mellor 2025-12-11 20:45:23 +00:00
• 92fea56fd1 [compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) Zhengxu Chen 2025-12-11 15:28:03 -05:00
• e458270a95 [Misc] Add mcp to requirements (#30474) Ye (Charlotte) Qi 2025-12-11 12:06:09 -08:00
• 72aaac5b66 [ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430) Andreas Karatzas 2025-12-11 13:25:01 -06:00
• 0e71eaa644 [Feature] AWQ marlin quantization support for fused moe with lora (#30442) 汪志鹏 2025-12-12 02:03:32 +08:00
• 8781cd6b88 Add Eagle and Eagle3 support to Transformers modeling backend (#30340) Harry Mellor 2025-12-11 17:02:10 +00:00
• aa3c250c48 [IMPROVEMENT] Change MistralReasoningParser behavior (#30391) Julien DenizeandPatrick von Platen 2025-12-11 17:53:26 +01:00
• 305b168a9f [CI] refine more logic when generating and using nightly wheels & indices, add cuda130 build for aarch64, specify correct manylinux version (#30341) Shengqi Chen 2025-12-12 00:42:30 +08:00
• 93db3256a4 Give pooling examples better names (#30488) Harry Mellor 2025-12-11 16:22:58 +00:00
• 17cb540248 [Docs][CPU Backend] Add nightly and per revision pre-built Arm CPU wheels (#30402) ioana ghibanandHarry Mellor 2025-12-11 16:57:10 +01:00