Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 68dafcca75 [Refactor] Unify reasoning + tool-call parsing behind Parser.parse() (#44267) Flora Feng 2026-06-02 03:11:42 -04:00
• 1edfd09ffd [Model Runner V2] Use actual batch max_seq_len for attn metadata (#43991) zhrrr 2026-06-02 14:07:56 +08:00
• 8a9eb40808 [Model Runner V2] Support zeroing freshly allocated KV blocks for hybrid + fp8 KVCache (#43990) zhrrr 2026-06-02 13:56:53 +08:00
• f91fb2fcf3 [Bugfix] Convert Gemma4-MM ViT linear layers to vllm native impl (#43798) 3 people 2026-06-02 12:41:16 +08:00
• a045c7425f [MM][CG] Profile encoder CUDA graph pool memory (#41714) JooHo Lee 2026-06-02 13:27:34 +09:00
• a3a5a5ece5 [XPU][Bugfix] Fix per_token_group_fp8_quant missing dummy args on XPU (#43930) Chaojun ZhangandKunshang Ji 2026-06-02 11:09:21 +08:00
• 480fadab1b [BugFix][kv_offload]: Prevent offloading stale sliding window blocks (#42959) Or Ozeri 2026-06-02 05:59:48 +03:00
• 279d25f5cb [BugFix] Fix TypeError in MiniCPM-O audio feature unpadding (#38053) 5 people 2026-06-01 19:57:28 -07:00
• 54d0c36fff [CI] Stabilize OpenAI schema fuzzing for malformed structural tags (#44131) Andreas Karatzas 2026-06-01 21:56:15 -05:00
• 9affc17a05 [Refactor] Move unstreamed tool-arg flush from serving layer to parser (#44017) Flora Feng 2026-06-01 22:37:43 -04:00
• 816cc73a9b [Bugfix][CI] Normalize NIXL connector CUDA wheel installs (#44266) Alec 2026-06-01 19:34:05 -07:00
• 2588ec4f0a [ROCm] Upgrade AITER to v0.1.13.post1 (#44265) Micah Williamson 2026-06-01 20:48:59 -05:00
• d68f0b220e [Bugfix][Mooncake] Release GPU pin on failed store in MooncakeStoreConnector (#43742) Dao007foreverandClaude 2026-06-01 18:29:18 -07:00
• 517e74a964 [DSV4] Refactor RoPE initialization (#44262) Woosuk Kwon 2026-06-01 18:26:58 -07:00
• 48c0d13e65 [ROCm][CI] Skip unbacked dynamic shapes tests on PyTorch < 2.11 (#44256) JartX 2026-06-02 02:09:01 +02:00
• 8c3cc98cff [DSV4] Remove unncessary classes & functions (#44246) Woosuk Kwon 2026-06-01 14:43:00 -07:00
• e4cbc4385d [Test][BugFix] Fix double-BOS in PD+specdec acceptance test (#44234) Nick Hill 2026-06-01 14:31:12 -07:00
• 6f8b40a23f [BugFix][CI] Fix added _has_module tests (#44248) Nick Hill 2026-06-01 14:23:12 -07:00
• 266b9d9c64 [Frontend][Core] Add sparse NCCL weight transfer support for in-place updates (#40096) Siddharth BedekarandOpenAI Codex 2026-06-01 12:37:30 -07:00
• 182c67daf1 [Rust Frontend] Support streaming generate endpoint (#43779) XunzhuoandBugen Zhao 2026-06-02 03:30:55 +08:00
• fd9e91d7e4 [ROCm][CI] Fix and stabilize EAGLE3 acceptance tests (#41294) Andreas KaratzasandMicah Williamson 2026-06-01 12:40:01 -05:00
• 035733515f [Kernel][DSv4] Optimize sparse FP8 compressor kernels (#44161) Yongye Zhu 2026-06-01 12:18:32 -04:00
• 023808c23d [Feature] Add support for JetBrains' Mellum v2 code generation model (#43992) Madeesh KannanandRobert Shaw 2026-06-01 14:11:35 +00:00
• 985c97a6a8 [Perf] Optimize cutlass fp8 scaled mm bypassing padding, 20% kernel performance improvement (#43706) Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-06-01 09:05:21 -04:00
• bd0aecdc08 [XPU][CI] Fix test_audio_in_video flake by using module-scoped server fixture (#44146) Chaojun Zhang 2026-06-01 19:21:36 +08:00
• 8796838910 [Bugfix] fix wrong partial_rotary_factor calculation for bailing_moe model. (#43770) zztandJiangyun Zhu 2026-06-01 17:42:49 +08:00
• de21863419 [Rust Frontend] Add InternLM2 tool parser (#43481) 3 people 2026-06-01 16:58:46 +08:00
• 0910f7e0e1 [Frontend] Resettle generative scoring entrypoint. (#44153) wang.yuqi 2026-06-01 15:54:59 +08:00
• 1f6048abe5 fix: glm5.1 pp model loading (#42944) Uranus 2026-06-01 15:14:47 +08:00
• 98f1279815 [CPU][RISC-V] Add missing RVV cpu_types helpers for WNA16 (#42730) wcyandLi, Jiang <jiang1.li@intel.com> 2026-06-01 14:56:41 +08:00
• 1fd8bd02a4 [Docs] Replace broken video url in examples (#44159) Isotr0py 2026-06-01 14:01:10 +08:00
• 29d69332aa [BugFix] Fix _has_module to verify native deps via trial import (#44035) 3 people 2026-05-31 22:06:33 -07:00
• 4721bb3aa4 [MRV2] Remove Eagle's dedicated CUDA graph pool (#44078) Lucas Wilkinson 2026-06-01 01:00:33 -04:00
• f46e6be169 [Misc] Use VLLMValidationError consistently in chat completion and completion protocol validators (#36254) Umut Polat 2026-06-01 07:04:11 +03:00
• 8b8546da1c docs: fix MLA attention docstring examples (#44118) nightcitybladeandnightcityblade 2026-06-01 03:28:38 +08:00
• 6bdabbad5b [CI/Build] Enable Step3p7ForConditionalGeneration testing (#43956) Jee Jee Li 2026-05-31 13:16:12 +08:00
• 3fd9d2d357 [CPU][Zen] Route W8A8 and W4A16 linear inference through zentorch on AMD Zen CPUs (#41813) 5 people 2026-05-31 00:47:21 +05:30
• 27fa5aa3b9 [MRV2] Support breakable CUDA graph (#44050) Woosuk Kwon 2026-05-30 09:40:52 -07:00
• e1105064b2 [Bug] Fix gemma4 MTP IMA issue when TP>1, CUDA error: an illegal memory access was encountered (#43909) Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-05-30 10:34:33 -04:00
• 50c80d7923 [Governance] Add @BugenZhao as Rust frontend code owner (#44047) Bugen Zhao 2026-05-30 22:23:54 +08:00
• 3becc5db40 [ROCm] Add attention sink support to AITer flash attention backend (#43817) XiaoranandXiaoran Chen 2026-05-30 03:13:18 -07:00
• 124fac10cb [Bugfix] Fix RMSNorm kernels to multiply in weight's native dtype (#42379) Lanze Liuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-05-29 23:16:53 -07:00
• e9499996df [BugFix][Platform] Fix import vllm.platforms.rocm error on non-CUDA test_gpt_oss.py (#43571) Liangliang MaandKunshang Ji 2026-05-30 14:16:49 +08:00
• c0056b19bf [ROCm] cmake: support PYTORCH_FOUND_HIP for torch 2.13 native HIP language support (#43881) nemanjaudovicandShengqi Chen 2026-05-30 07:16:57 +02:00
• ef8840adc7 [ROCm][CI] Fix failure in the Phi3V pooling test (#44028) Andreas Karatzas 2026-05-29 23:14:37 -05:00
• 1a096d8208 [Refactor] Remove dead current_tool_name_sent assignments from tool parsers (#43997) Flora Feng 2026-05-29 21:45:15 -04:00
• 1e2ce5d11a offload prompt_embeds decode in render_prompts_async to avoid blocking (#43792) Gagan Dhakrey 2026-05-30 07:06:34 +05:30
• 559d6710bf [PERF]MiniMax-M2 gate kernel (#38445) Jee Jee LiandYiliu Dong 2026-05-30 09:28:34 +08:00
• 187457a952 Revert "[MoE Refactor] Migrate MoeWNA16Method quantization to MK orac… (#44033) bnellnm 2026-05-29 19:45:29 -04:00
• 8fad266507 [CI] Fix smoke test step key to bypass block gate (#43974) Kevin H. LuuandClaude Opus 4.6 2026-05-29 16:28:32 -07:00
• 8c6daf6e2f [CI] Remove duplicate Harmony test coverage (#44023) Flora Feng 2026-05-29 18:52:46 -04:00
• 7b98f498cd [MoE Refactor] Remove supports_expert_map (#43108) bnellnm 2026-05-29 17:26:56 -04:00
• 106aa92f04 [MoE Refactor] Migrate MoeWNA16Method quantization to MK oracle (#42647) bnellnmandClaude 2026-05-29 17:19:31 -04:00
• 46409fd2a1 [Fronten] Clean up stop_token_ids override for Harmony (#44009) yzong-rh 2026-05-29 16:28:06 -04:00
• 38b864d81d [Metrics] Exclude KV transfer tokens from iteration_tokens_total (#43346) Tyler Michael SmithandClaude Opus 4.6 2026-05-29 15:56:44 -04:00
• 5dbf1605a0 [Feature] SSL support for dp supervisor (#43688) Wentao Ye 2026-05-29 15:28:12 -04:00
• acbc203340 Add @khluu to CODEOWNERS (#44019) Kevin H. Luu 2026-05-29 12:24:29 -07:00
• 6de08e8b46 [CI] Remove redundant test_chat_with_tool_reasoning.py (#44011) Flora Feng 2026-05-29 15:23:56 -04:00
• 6aabe221a5 [CI] Make Model Executor test hangs fail fast with a traceback (#43971) Kevin H. LuuandClaude 2026-05-29 11:58:25 -07:00
• 739096a028 [Bug] Fix torch device issue for MOE permute (#44005) Wentao Ye 2026-05-29 14:55:00 -04:00
• 8b9deeec4b [Bugfix] Fix Ray placement group allocation with grouped nodes (#43998) czhu-cohere 2026-05-29 11:51:05 -07:00
• d07ad0693b [Bugfix] Use storage_block_size in KV cache reshape for compressed specs (DeepSeek V4) (#43988) qizixiandClaude Opus 4.8 2026-05-29 11:14:25 -07:00
• 4aaba00f92 [EPLB] Make async EPLB default (#43219) 3 people 2026-05-29 20:07:16 +02:00
• 84b2a8a7e7 [MoE Refactor] WNA16 MoE backend selection into oracle module (#42553) bnellnmandClaude 2026-05-29 13:11:17 -04:00
• 4ff865c38e [Bugfix] Disable allreduce_rms_fusion when pipeline_parallel_size > 1 (#43616) qizixiandClaude 2026-05-29 07:57:43 -07:00
• 5502c3b52d [Misc] added unit tests for the core pooling methods (#43818) Taneem IbrahimandWentao Ye 2026-05-29 10:40:31 -04:00
• f191d5630e docs: clarify ITL acronym in optimization docs (#43922) Chunyang Wen 2026-05-29 22:40:05 +08:00
• 11dfa3169d Add vLLM library info to Hugging Face Hub requests (#43857) LucainandClaude Opus 4.6 2026-05-29 16:04:58 +02:00
• 3f6f508e14 [Bugfix][CPU] Remove invalid extra deps (#43977) Li, Jiang 2026-05-29 22:02:09 +08:00
• 0585b5ba2e Skip docs build if PR doesn't affect docs (#43972) Harry Mellor 2026-05-29 13:09:52 +01:00
• d2889722ff [Bugfix] Corrupted MLA + linear attention (#43961) Thien Tran 2026-05-29 20:00:51 +08:00
• 0b56815a24 [ROCm][Perf] DSv3.2 MI355X TP4 decode-step orchestration cleanup (3 micro-opts) (#42982) frida-anderssonandCursor 2026-05-29 13:26:57 +02:00
• ab12aab127 [Bugfix] [ROCm] [DSV4] Fix AITER MXFP4 MoE weight loading and shuffle… (#42595) MHYangAMDandMHYangAMD 2026-05-29 19:08:33 +08:00
• 0cff0741ff [Kernel][ROCm] Native W4A16 kernel for AMD RDNA3 (gfx1100) — fp16 + bf16 (#41394) JartX 2026-05-29 13:04:40 +02:00
• 60a7a2214f [Bugfix] Fix Step3 pipeline parallel KeyError for residual tensor (#37622) Joaquín MondéjarandJee Jee Li 2026-05-29 12:04:02 +02:00
• 7ebc0ec104 [CI] Nixl+SimpleCPUOffloadingConnector unit tests (#43871) Nicolò Lucchesi 2026-05-29 11:40:42 +02:00
• e8b5199973 [XPU] support MTP of gdn attention (#43565) Qiming ZhangandKunshang Ji 2026-05-29 02:10:24 -07:00
• b7fb747d8d [CI][ROCm] Don't skip MoRI-IO Connector tests (#43703) Simon Danielsson 2026-05-29 11:06:23 +02:00
• 30c6289b8e [XPU] fix xpu install document triton-xpu version (#43947) Kunshang Ji 2026-05-29 17:05:12 +08:00
• ff990d0d32 [ROCm][CI] Fix AITER unified attention for encoder-decoder cross-attention (#43945) Andreas Karatzas 2026-05-29 03:43:39 -05:00
• 87f12e5c7c [Frontend]Responses API supports chat_template_kwargs (#43761) Chauncey 2026-05-29 15:58:19 +08:00
• ab7521d77c [ROCm][DSv4] Remove device pipeline stall in sparse attention (#43898) kliuae 2026-05-29 15:42:40 +08:00
• 94d3f4d205 [CPU Backend] CPU top-k and top-p sampling kernels using Triton (#43633) Tianmu Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-05-29 00:02:39 -07:00
• 04516eabc8 [XPU] add gelu_tanh to xpu moe backend supported activations (#42822) Yintong LuandKunshang Ji 2026-05-29 14:37:20 +08:00
• 648c3ebee6 [CI] Separate non-root smoke tests from image build step (#43712) Kevin H. LuuandClaude Opus 4.6 2026-05-28 23:34:16 -07:00
• 22a58640b4 [9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717) 3 people 2026-05-29 00:44:45 -04:00
• 710f077617 [Refactor] Remove dead code (#43234) Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-05-29 00:29:56 -04:00
• d63108fb18 [kv_offload] Skip decode-phase blocks in CPU offload (#43797) Itay EtelisandItay Etelis 2026-05-29 06:39:43 +03:00
• 9636709372 [XPU] add scale transpose to prepare_fp8_moe_layer_for_xpu and bump up kernels (#43277) Qiming ZhangandKunshang Ji 2026-05-28 20:22:51 -07:00
• dfe8ba7c80 Adjust design around encoder_cudagraph_forward (#42288) Weida Hong 2026-05-29 11:02:52 +08:00
• 212deff2ec [feat] add GlmgaProcessor specific logits in glm4_1v.py (#43575) 3 people 2026-05-29 10:56:02 +08:00
• 7bd45da585 [DSv4] Move mHC tilelang kernels & Don't use CustomOP in dsv4/nvidia (#43905) Woosuk Kwon 2026-05-28 19:25:02 -07:00
• bf18d7e0b4 [Misc][NUMA] Auto-bind to PCT priority cores on DGX B300 + widen EngineCore across shard NUMA nodes (#43270) Vadim GimpelsonandCursor 2026-05-29 06:07:44 +04:00
• 1521173c17 [Rust Frontend] Add /version endpoint using engine-reported value (#43854) Bugen Zhao 2026-05-29 08:32:27 +08:00
• b690b2bb67 [Model]Support Step-3.7-Flash (#43859) 5 people 2026-05-29 08:01:48 +08:00
• 325a1ec4fb [CI] Enable prefix caching in BFCL benchmark (#43925) yzong-rh 2026-05-28 19:36:31 -04:00
• 69c9f19957 fix(frontend): Add multimodal placeholders to Gemma4 tool message template (#41459) Harshal JanjaniandBen Browning 2026-05-29 01:48:12 +04:00
• 9769e2df2a [AMD][CI][BugFix] Fix Distributed Compile Unit Tests (2xH100-2xMI300) group (#43120) rasmith 2026-05-28 16:39:01 -05:00
• 03f03f9630 Refactor output filename handling in ci-fetch-log.sh (#43901) Michael Goin 2026-05-28 17:20:12 -04:00
• 9202ea6fda [Spec Decode] Allow causal DFlash (#43445) Benjamin Chislett 2026-05-28 17:18:44 -04:00