Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 5a3adf581e fused_moe_lora PDL improvements (#30716) 3 people 2025-12-17 19:55:00 -08:00
• 6fe5887652 [Chore] Remove v0 dead code for Qwen2.5-omni (#30883) Isotr0py 2025-12-18 11:54:39 +08:00
• bc3700e0cd [NIXL] Support P tensor-parallel-size > D tensor-parallel-size (#27274) Nicolò Lucchesi 2025-12-18 04:53:30 +01:00
• fd8afdf38d [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) Micah Williamson 2025-12-17 20:27:37 -06:00
• a0b782f9cc [Metrics] Model FLOPs Utilization estimation (#30738) SungMinChoandMark McLoughlin 2025-12-17 17:40:51 -08:00
• ed2897f336 [CI][Feature] Adds auto-rebase PR rule (#30875) Rafael VasquezandKevin H. Luu 2025-12-17 19:46:44 -05:00
• 74a1ac38b0 [v1] Add PrefixLM support to TritonAttention backend (#30386) Isotr0py 2025-12-18 08:05:24 +08:00
• 05a83dc6ee feat(api): Eager chat template warmup to eliminate first-request latency (#30700) Nathan Price 2025-12-17 18:01:29 -06:00
• e3fc374a9a [BugFix] Workspace allocation during profile run : DeepEPHighThroughput + DeepGEMM (#30899) Varun Sundar Rabindranath 2025-12-17 18:00:59 -05:00
• e06d0bf0aa 2.9.1 PyTorch release update (#28495) Andrey Talman 2025-12-17 15:20:22 -05:00
• e3a0f21e6c [docs]: add ecosystem projects sr in docs/governance (#30844) Xunzhuo 2025-12-18 02:45:56 +08:00
• 7eb6cb6c18 [Attention] Update tests to remove deprecated env vars (#30563) Matthew Bonanni 2025-12-17 12:49:59 -05:00
• 9ca8cb38fd [CI][Bugfix] Fix flaky tests/entrypoints/openai/test_audio.py::test_chat_streaming_audio (#30878) Nicolò Lucchesi 2025-12-17 18:49:56 +01:00
• 2497228ad4 [Chore] Factor out logic for requesting initial memory (#30868) Cyrus Leung 2025-12-17 23:32:17 +08:00
• 196cdc3224 [Model] Gemma3: Support untied word embeddings (#30827) KimHyemin 2025-12-18 00:11:18 +09:00
• b7b6a60aca Adapt the old parameter enable_thinking in chat_template_kwargs (#30852) 高鑫崧andChauncey 2025-12-17 23:10:59 +08:00
• 9e67c4ce98 [Docs] fix function name (#30748) rongfu.leng 2025-12-17 20:14:45 +08:00
• 6e9dbcc50e [Fix] uniform decode batch check (#30747) Jialin Ouyang 2025-12-17 03:58:43 -08:00
• 6482e3895b chores: adjust the attn register param order (#30688) Hank_ 2025-12-17 19:58:16 +08:00
• fb980eb2fd Fix lazy import (#30858) Harry Mellor 2025-12-17 11:33:50 +00:00
• 84896fda22 [Bugfix] deepseek-V3.2 self.weights_proj has no bias (#30841) baoqian426 2025-12-17 19:32:34 +08:00
• 4bf6c23668 [ci] Sync test areas yaml file with test-pipeline (#30862) Kevin H. Luu 2025-12-17 02:30:56 -08:00
• 9ad5b21710 [Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749) Chauncey 2025-12-17 18:27:30 +08:00
• f284d7bd0c [Bug] Fix AttributeError: 'ColumnParallelLinear' object has no attribute weight_scale_inv (#30823) Wentao Ye 2025-12-17 05:00:35 -05:00
• 53cd7f868b [compile] Recompile graph module during Dynamo cache loading. (#30743) Zhengxu Chen 2025-12-17 05:00:12 -05:00
• 7b966ae2ba [Fix]Load kv-cache dtype from hf_quant_config.json automatically (fix for reverted PR) (#30785) danielafrimiandroot 2025-12-17 11:56:38 +02:00
• 9db1db5949 [compile] Ignore VLLM_FORCE_AOT_LOAD from cache factors (#30809) Zhengxu Chen 2025-12-17 04:56:24 -05:00
• 177c391db2 [compile] Disable aot when eager backend is used. (#30810) Zhengxu Chen 2025-12-17 04:55:56 -05:00
• 519ef9a911 [UX] Make vllm bench serve discover model by default and use --input-len (#30816) Michael Goin 2025-12-17 04:55:30 -05:00
• a100152288 [Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842) Ye (Charlotte) Qi 2025-12-17 01:54:21 -08:00
• 4c054d89aa [Doc][ResponsesAPI] add documentation (#30840) Andrew XiaandAndrew Xia 2025-12-17 17:53:02 +08:00
• f4e884f222 [NIXL][Bugfix] Fix NIXL/RDMA registration failure over CuMemAllocator (#29569) Sheng LinandNicolò Lucchesi 2025-12-17 17:52:58 +08:00
• 3b1d440ede CustomOp: grouped topk (#29575) Xinyu Chen 2025-12-17 17:43:00 +08:00
• a9e15c21ef [Mamba] Removed disable cascade attn in MambaModelConfig (#30712) Asaf Joseph Gardin 2025-12-17 10:48:53 +02:00
• 20fda43151 [Bugfix][Frontend] Prevent IndexError in MiniMax M2 tool parser during streaming extraction (#30555) Robin 2025-12-17 16:37:57 +08:00
• 4f735babb7 [XPU] fix broken fp8 online quantization for XPU platform (#30831) Yan Ma 2025-12-17 16:28:13 +08:00
• 0cd5353644 [Bugfix][CPU] Fix CPU backend ROPE dispatch for VL models (#30829) Li, Jiangandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-17 15:25:12 +08:00
• d4d2751732 Update note comment for flashinfer attention warmup (#30711) Michael Goin 2025-12-17 00:29:03 -05:00
• 009a773828 bump up compressed tensors version to 0.13.0 (#30799) shanjiazandDipika Sikka 2025-12-17 00:01:04 -05:00
• 44d3b1df3d [CI/Build] Fix compatibility between #30244 and #30396 (#30787) Cyrus Leung 2025-12-17 12:21:19 +08:00
• bb5ac1fe38 [CPU] Add action to automatically label CPU related PRs (#30678) Fadi Arafeh 2025-12-17 04:21:07 +00:00
• 811cdf5197 Update model-hosting-container-standards to 0.1.10 (#30815) Michael Goin 2025-12-16 20:52:14 -05:00
• f5db6385a1 Fix nemotron_nas intermediate_size computation (#30795) Grzegorz K. Karch 2025-12-17 02:06:28 +01:00
• c0a88df7f7 [docker] Allow kv_connectors install to fail on arm64 (#30806) Amr Mahdi 2025-12-17 02:41:57 +02:00
• e087fbc393 [MM] Pass FA version in ViT Attn (#30756) Nicolò LucchesiandCyrus Leung 2025-12-17 00:54:45 +01:00
• e80455ca8b Replace deprecated enable_fusion with fuse_norm_quant in test_rms_group_quant (#30817) Michael Goin 2025-12-16 18:40:47 -05:00
• 2410132bb1 [ROCm] [Bugfix] Fix torch sdpa hallucination (#30789) TJian 2025-12-17 07:32:43 +08:00
• 0a1ab1e565 [Perf][Kernels] Vectorize csrc/activations_kernels.cu (#29512) Michael Goin 2025-12-16 17:56:02 -05:00
• b6ec077e05 [CI] Skip ci failure test (#30804) Wentao Ye 2025-12-16 17:47:53 -05:00
• ce96857fdd [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) Jinzhen LinandMichael Goin 2025-12-17 06:35:28 +08:00
• eaa82a709a [Bugfix][DSV32] Fix overflow in topk. (#30754) Daniel Cámporaandmgoin 2025-12-16 23:21:17 +01:00
• f5f51e5931 [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) Roger WangandSun Kim 2025-12-16 14:18:17 -08:00
• 9fec0e13d5 [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) Lucas WilkinsonandStanislaw Wozniak 2025-12-16 17:10:16 -05:00
• 254a7f8fd6 [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) jiahanc 2025-12-16 13:01:48 -08:00
• f21f5ea38c [Refactor] Small refactor for group topk (#30562) Wentao YeandRobert Shaw 2025-12-16 14:50:59 -05:00
• ca702a14dc [Frontend] Add max-completion-token option to transcription/translation endpoints (#30769) Nicolò Lucchesi 2025-12-16 20:36:49 +01:00
• 10ee1c64cf [CI] Generalize gsm8k test args and add Qwen3-Next MTP B200 test (#30723) Michael Goin 2025-12-16 14:28:34 -05:00
• 66c3537e5d [Docs][API] Remove warning about LoRARequest being internal-only (#30774) Mark McLoughlin 2025-12-16 16:35:46 +00:00
• e1625498f4 Update where bytes_to_unicode is imported from (#30771) Harry Mellor 2025-12-16 16:05:01 +00:00
• 0b0acc758e Remove head_mask from Ultravox and Swin (#30764) Harry Mellor 2025-12-16 16:02:41 +00:00
• af506fd76a Fix instantiation of HfHubHTTPError in LoRA test (#30768) Harry Mellor 2025-12-16 16:02:24 +00:00
• ce12b407f2 [TRTLLM] Remove the MoE GEMM weight name change (#30713) Ming Yang 2025-12-16 08:01:38 -08:00
• 59bd5f6a71 [Feat] Enable eplb with default all2all backend (#30559) Wentao Ye 2025-12-16 10:33:52 -05:00
• 00a8d7628c [BugFix] Fix memory spike in workspace allocation (#30744) Lucas WilkinsonandCyrus Leung 2025-12-16 09:46:22 -05:00
• 4de08ad698 [CI/Build] Skip broken ViT backend functionality test tempoarily (#30782) Isotr0py 2025-12-16 22:45:25 +08:00
• 75eb302a2e [Bugfix] Whisper fix number of allocated CrossAttn blocks per-request (#30772) Nicolò Lucchesi 2025-12-16 15:20:19 +01:00
• 9dbbc59b15 [ROCm][MTP] Support MTP for AITER MLA backend (#28624) Pleaplusone 2025-12-16 22:10:26 +08:00
• 104003dc77 update piecewise cudagraph warning when splitting_ops=[] (#30728) Boyuan Feng 2025-12-16 06:09:34 -08:00
• d0fb572929 [ROCm] [AITER] [DOC] Add usage description about check functions in _aiter_ops (#30586) TJian 2025-12-16 21:50:47 +08:00
• 6f15ac5de7 Don'e assume position_embedding_type will be present for BERT and RoBERTa models (#30770) Harry Mellor 2025-12-16 13:40:26 +00:00
• 676db55eec [Bugfix] Fix prefix_repetition routing in bench throughput (#29663) Junru Shenandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-16 17:37:15 +08:00
• 0e391e7570 [Bugfix] Fix RequestOutput miss lora_request (#30636) Jee Jee Li 2025-12-16 17:36:35 +08:00
• 0d0c929f23 [responsesAPI][8] input/output messages for ResponsesParser (#30158) 3 people 2025-12-16 13:54:59 +08:00
• e94384bbad [Bugfix] Fix broken ViT attention selection for Blackwell device (#30731) Isotr0py 2025-12-16 13:24:32 +08:00
• b9ff4f2a8d [feature] extend DBO to XBO (#30120) jiangkuaixue123androot 2025-12-16 13:04:01 +08:00
• c881db364e improve lazy import test (#30733) Boyuan Feng 2025-12-15 19:12:05 -08:00
• 3bd9c49158 [CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873) 3 people 2025-12-16 11:08:16 +08:00
• ff21a0fc85 [docker] Restructure Dockerfile for more efficient and cache-friendly builds (#30626) Amr Mahdi 2025-12-16 04:52:19 +02:00
• bbd850e597 [Bugfix] fix streaming final output for non harmony (#30237) penfreeandpenfree 2025-12-16 09:03:11 +08:00
• 511e81e7c9 [BUILD] use sm_100f when compiling flashmla to fix support on sm103 (#30705) Shengqi Chen 2025-12-16 06:48:01 +08:00
• a182be4308 [UX][Attention] Add attention_config argument to LLM() (#30710) Matthew Bonanni 2025-12-15 17:29:09 -05:00
• c01d589813 [Benchmarks] auto_tune.sh: Use hostname variable for server requests (#30529) 3 people 2025-12-15 17:00:29 -05:00
• 60dbf7d8f1 Update batch invariant to use attention config (#30704) Matthew Bonanniandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-15 15:24:16 -05:00
• a450c64a30 [Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708) Michael Goin 2025-12-15 15:18:02 -05:00
• b2191abdca [docs][fix] Update Arm CPU vLLM wheel installation docs (#30594) Fadi Arafeh 2025-12-15 19:46:25 +00:00
• 51e5b3e3c4 [Bugfix] Fix ViT with FlashAttention on ROCm (#30703) Matthew Bonanni 2025-12-15 14:45:21 -05:00
• ec154c36ee [Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212) Isotr0pyandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-12-16 01:36:07 +08:00
• 970713d4a4 Remove SkipValidation from ModelConfig (#30695) Harry Mellor 2025-12-15 17:34:08 +00:00
• 17fec3af09 [Bugfix] Fix missing first token in tool calls during reasoning-to-tool transition (#30671) mondaylord 2025-12-16 00:13:37 +08:00
• 855b101d75 [Frontend] add tools for dsv32 developer role (#30040) 3 people 2025-12-15 23:08:47 +08:00
• d0502b4928 [MoE][Refactor 1/N] Separate Online Quantization (#30627) Robert ShawandRobert Shaw 2025-12-15 09:54:53 -05:00
• 3f175f18a2 [Bugfix] Fix multimodal configuration for Qwen3VL MOE model (#30670) Max Hu 2025-12-15 22:06:01 +08:00
• ed586e7724 [Refactor] [3/N] Move tool parser tests and run on CPU (#30693) Cyrus Leung 2025-12-15 21:45:36 +08:00
• 2a1776b7ac [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) Chauncey 2025-12-15 20:54:52 +08:00
• 185c22bf2f [Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator + KV cache connector (#29805) Nicolò Lucchesi 2025-12-15 12:17:58 +01:00
• e4806d973a [BugFix] Add embed_input_ids method to make QWenLMHeadModel a vllm model (#30674) dukeandroot 2025-12-15 18:38:29 +08:00
• 4429d934de [Model] Automatic conversion of TokenClassification model (#30666) wang.yuqi 2025-12-15 16:13:00 +08:00
• 33278073d6 typing: Add type hints to TurnMetrics class in context.py (#30552) 3 people 2025-12-15 16:00:39 +09:00
• 1adeb3b84c [New Model] BAGEL support (AR only) (#28439) 汪志鹏andCyrus Leung 2025-12-15 14:58:23 +08:00
• e3a1cd1c59 [XPU] fix Dockerfile.xpu, avoid wheel conflicts (#30662) Kunshang Ji 2025-12-15 13:32:06 +08:00