Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• dec13a33b7 [Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892) Giancarlo Delfin 2026-07-30 15:54:15 -07:00
• 7fe5312332 [CI] Retire the v1 PR label rule, add mrv2 (#50475) jcotant-inferactandClaude Opus 5 2026-07-30 15:25:28 -07:00
• 68fb303a41 [Bugfix] Preserve Marlin runtime tensor storage across weight reload (#48438) Ryan ClarkandClaude Fable 5 2026-07-30 14:50:03 -07:00
• e9096fcb12 [Rust Frontend] Improve startup failure and readiness logs (#50406) Bugen ZhaoandOpenAI Codex 2026-07-31 05:18:17 +08:00
• 45b60e3914 [Kernel][Helion] Disable unsafe B200 RMS reduction warp specialization (#50345) Shangdi YuandOpenAI Codex 2026-07-30 13:37:52 -07:00
• 0eec856cc3 Add Humming indexed-MoE regression test (#50468) Michael Goin 2026-07-30 16:26:24 -04:00
• 70bd10930b [Quantization] Honor --linear-backend for ModelOpt W4A16 (#50273) Netanel HaberandOpenAI Codex 2026-07-30 23:19:56 +03:00
• c27b080d26 [compile] Fix fake kernel return dtype (#50444) Richard ZouandCodex 2026-07-30 15:50:02 -04:00
• 3f90c7e9e6 [ROCm] Pass pointers to FlyDSL MoE kernels (#50378) Andreas Karatzas 2026-07-30 14:49:26 -05:00
• bdc98bf506 [CI] Initialize fused gated RMSNorm weights (#50377) Andreas Karatzas 2026-07-30 14:34:08 -05:00
• 30e333ca5f [Bugfix] Shut down private Tensorizer engines (#49840) Andreas KaratzasandOpenAI Codex 2026-07-30 14:33:22 -05:00
• 629a938a92 [Frontend] Preserve bare Inkling text in Python and Rust parsers (#50403) Bugen Zhao 2026-07-31 03:25:10 +08:00
• 12a34a6bc7 [ROCm][DSV4] B-preshuffle the attention fp8 projections (#46720) 3 people 2026-07-30 13:59:52 -05:00
• 5f8f72866c [Build] Fix CUDA release wheel builds (#50243) Kevin H. LuuandMichael Goin 2026-07-30 11:48:09 -07:00
• 61cacd272f [Bugfix][MoE] Write Humming results to the supplied output buffer (#50338) Netanel HaberandOpenAI Codex 2026-07-30 21:34:10 +03:00
• 837eae6458 [DSv4 Perf] Remove redundant full kernel for dsv4, 1.88x kernel performance improvement (#50298) Wentao Ye 2026-07-30 11:39:07 -04:00
• 904fae8be1 [DSv4 Perf] Fix redundant memory allocation and copy for dsv4 pp buffer, 448 MiB GPU memory saved (#50312) Wentao Ye 2026-07-30 11:38:51 -04:00
• f388dd6592 [XPU][CI] skip kimi-k3 test (#50447) Kunshang Ji 2026-07-30 23:27:28 +08:00
• 5b95890742 [FlexAttention] Avoid encoder block-mask compile explosion (#50339) Andreas Karatzas 2026-07-30 10:24:13 -05:00
• 30b4e7f479 [rl] Stateful Trainer Send: IPC [2/N] (#48981) Aaron Hao 2026-07-30 06:59:08 -07:00
• 59e831c09a [Compilation]Fuse Transformers Residual Add + RMSNorm (#48757) BadrBasowid 2026-07-30 21:46:36 +08:00
• 1a20d23dab [PARSER][Mistral] unified engine-based parser for reasoning and tool calls (#48947) Julien Denize 2026-07-30 15:38:00 +02:00
• e2efe79695 [ROCm]Migrating Deepseek V3.2 to vllm/models/deepseek_v32/ (#47207) 3 people 2026-07-30 08:37:43 -05:00
• 38a267cdd5 [MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570) Martin HickeyandHarry Mellor 2026-07-30 13:02:51 +01:00
• 89d97d9a16 docs(security): document Ray cluster trust model and env var propagation (#50397) Juan Pérez de Algaba 2026-07-30 13:52:55 +02:00
• 072a472782 [CPU] Bump up CPU kernels to latest version (#50387) Li, JiangandClaude 2026-07-30 19:18:43 +08:00
• aeeb36b1f1 [New model] Kimi K3 (#50000) +1323 people 2026-07-30 18:49:58 +08:00
• 0c64be8873 [Test][ROCm] Account for gfx950 FP8 RMSNorm rounding (#49839) Andreas KaratzasandOpenAI Codex 2026-07-30 05:46:37 -05:00
• 61c1d098e5 [CI] Stabilize speculator memory teardown (#50284) Andreas Karatzas 2026-07-30 05:42:55 -05:00
• 165ed33327 [CI][ROCm] Stabilize LLM GC teardown check (#50340) Andreas Karatzas 2026-07-30 05:42:03 -05:00
• 48a077e4cf [CI] Improve comment-triggered authorization and retries (#50414) Kevin H. LuuandOpenAI Codex 2026-07-30 02:48:36 -07:00
• e04a30a77c [Frontend] Lazily initialize chat media connectors (#49914) Andreas Karatzas 2026-07-30 01:56:37 -05:00
• 445d3aac0a [CI] Retry failed steps on new PR commits (#50318) Kevin H. LuuandOpenAI Codex 2026-07-29 23:54:51 -07:00
• 8122a10536 [DOC][CPU] remove tcmalloc warning from CPU docs (#50308) Fadi Arafeh 2026-07-30 07:30:21 +01:00
• f1e8fd27ae [ROCm] Add AITER FP8 ViT encoder attention (#49937) yinfengLiu 2026-07-30 14:22:10 +08:00
• 0028fc8d8d [XPU][CI]Add back skipped V1 test (#50207) xiangdong 2026-07-30 14:18:38 +08:00
• a7a204cc6e Add FlashMLA H100 tests to CI, fix them after #32810 (#50322) Jane (Yuan) Xu 2026-07-30 01:06:18 -04:00
• b88916617d [ROCm] [CI] Support cached K/V (key/value=None) in Triton prefix-prefill (#48257) stefankoncarevicandAndreas Karatzas 2026-07-30 06:31:51 +02:00
• 1ad5182ba9 [CI/Build] Limit wheel size check to CUDA 13 (#50357) Tyler Michael SmithandOpenAI Codex 2026-07-29 23:10:42 -04:00
• e5f48dfda2 [Quantization][Autoround][XPU] Add W4A16(moe) / MXFP4(linear/moe) Support (#47124) lkkandKunshang Ji 2026-07-30 09:52:13 +08:00
• 4e582c5b54 [PD][Bugfix] Rebase KV lease deadlines onto worker clock (#50326) 3 people 2026-07-29 18:25:42 -07:00
• 437e0b7f8e [BugFix] Fix P/D preemption race condition (#50297) Nick HillandClaude Opus 5 2026-07-29 18:11:18 -07:00
• 0a31372e5f [Frontend] Add detokenization streaming derender for disaggregated serving (#47301) Martin Hickey 2026-07-30 02:01:20 +01:00
• 451227cb3f [Bugfix][Kernel] Fix integer overflow in libtorch_stable/activation_kernels.cu (#49660) MollyandMichael Goin 2026-07-29 20:50:44 -04:00
• b28c178ffd Fix: FusedMoE AssertionError with Speculative Decoding on Quark-Quantized Models (#38293) Venkateswara Rao CherukuriandCursor 2026-07-29 19:03:38 -05:00
• 48aa8d8d75 [Bugfix] Prevent stale multiproc RPC deadlines from becoming unbounded waits (#41357) bugkeepandClaude 2026-07-30 07:41:34 +08:00
• 9d1aa4dda8 [Frontend] Add diarized_json support for MOSS-Transcribe-Diarize (#48543) christian 2026-07-29 20:24:30 -03:00
• 1cb3fe5844 [CI Bugfix] Temp disable Humming wNa8 INT8 H100 CI (#50329) Michael Goin 2026-07-29 19:14:12 -04:00
• fa2a2589bd [CI][ROCm] Fix AMD nightly distributed regressions (#50304) Andreas Karatzas 2026-07-29 17:02:12 -05:00
• 435c4dad97 [ROCm][CI] Avoid Ray worker startup env race (#50311) Andreas Karatzas 2026-07-29 16:30:29 -05:00
• 5fa0154448 [Rubin] Enable NVLink all-reduce paths on SM107 (#49647) 3 people 2026-07-29 13:53:25 -07:00
• 48fc2e2797 feat(grpc): add KV event source discovery (#50033) Connor CarpenterandNick Hill 2026-07-29 13:46:40 -07:00
• 2ecd8645d8 Revert "[Misc][Minimax-M3]add default video_processor (#50092)" (#50313) Nick Hill 2026-07-29 13:46:07 -07:00
• 82642d7d6c [Perf] RMSNorm uncontiguous support, 1.2~3.1x kernel performance improvement (#49750) Wentao Ye 2026-07-29 16:45:38 -04:00
• 93477454f9 [torch.compile] Compile CustomOp.forward_native for ReLU^2 to avoid raw torch ops inside opaque custom ops (#50244) roikoren755 2026-07-29 21:27:31 +03:00
• 5c7a7f9462 [docs] Add documentation for pynvvideocodec video decoding backend (#49066) Brandon PelfreyandCyrus Leung 2026-07-29 10:23:04 -07:00
• f98061ce6c fix(step3p5-mtp): honor exclude_modules for the MTP head via prefix (#48883) Chanh Nguyenandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-07-29 09:58:29 -07:00
• 82553692b8 [KV Connector] Fix NIXL mamba state pairing for multi-slot block tables (#50153) Nick Hill 2026-07-29 09:45:53 -07:00
• 381b691620 [ROCm][CI] Fix Kimi K3 KDA on ROCm (#50262) stefankoncarevic 2026-07-29 17:47:50 +02:00
• d6247d7173 [Spec Decode][Perf] Replicate DSpark Markov head across TP ranks (#49731) Michael GoinandOpenAI Codex 2026-07-29 11:43:51 -04:00
• a0c092ee72 [BugFix] Fix num_output_placeholders preemption underflow (#48245) 3 people 2026-07-29 06:41:54 -07:00
• 43eaefba5a [ModelRunner V2] Enable sequence pooling for embedding and classification models (#48791) Taneem Ibrahim 2026-07-29 09:30:45 -04:00
• e0cfa52d22 [Bugfix][Frontend] Return transcription and translation verbose as float (#49073) christian 2026-07-29 10:16:13 -03:00
• 242c591d5a [Rust Frontend] Send multimodal tensors in auxiliary frames (#49341) ReidandBugen Zhao 2026-07-29 20:21:09 +08:00
• 625871b52c [CI][Test] Fix pooling truncation test after VLLMError hierarchy change (#50241) stefankoncarevic 2026-07-29 14:15:56 +02:00
• 72297d859b [XPU] Route weightless RMSNorm to _C dispatch (#47121) 3 people 2026-07-29 18:59:58 +08:00
• f51193b9ae [Kernel][Mamba] Fused-kernel support for align-mode DS-conv state migration with num_accepted_tokens > 1 (#49291) 3 people 2026-07-29 03:54:52 -07:00
• aeaa50a71c [Bugfix][Multimodal] Include media IO config in MM cache hash (#49975) Guan-Ming Chiu 2026-07-29 18:48:40 +08:00
• 542a8fad6d [KV Offload] Move CPUOffloadingSpec onto SharedOffloadRegion (#50094) Chang GuoandCursor Agent 2026-07-29 03:05:50 -07:00
• 9a4e5f9539 [CI/Perf] Fix malformed serving benchmark config (#43538) Minh Vu 2026-07-29 11:52:42 +02:00
• c44e191b01 [Rust Frontend] Add --limit-mm-per-prompt support (#49604) Maria Guevara 2026-07-29 10:21:41 +01:00
• 5b14019576 [CI] Fix MXFP8 MOE backend selection tests on gfx942 (#50222) fxmarty-amd 2026-07-29 11:17:11 +02:00
• dad7a6383b [EC Connector] Add has_pending_push_work (#49582) omerpaz95 2026-07-29 12:04:22 +03:00
• 5b29c958c7 [XPU] upgrade to torch 2.13 (#48677) 3 people 2026-07-29 16:24:56 +08:00
• df2735ea2e [Misc][Minimax-M3]add default video_processor (#50092) rongfu.lengandCyrus Leung 2026-07-29 16:24:51 +08:00
• 32e657e689 [BugFix] eagle draft max position embeddings (#49343) 3 people 2026-07-29 16:24:47 +08:00
• ad5d29db70 [Model] Support Qwen3.5 text-only dense and MoE models (#50210) Perkz ZhengandPerkz Zheng 2026-07-29 16:21:57 +08:00
• f5a7cce9b6 [Model] Add Kimi K3 support: Python frontend [2/2] (#50093) Bugen Zhao 2026-07-29 16:06:01 +08:00
• 6370e53f24 [Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145) Seiji Eicher 2026-07-29 01:02:57 -07:00
• 65a1a16594 [CPU] Fix FP8 attention scratchpad sizing (#50194) 3 people 2026-07-29 00:34:37 -07:00
• 100d655a23 [CI] Allow PR comment acknowledgements (#50211) Kevin H. Luu 2026-07-28 23:53:56 -07:00
• 7de49bab7e [XPU][UT][CI] add xpu config to run gpt-oss accuracy in ut and ci (#48703) 3 people 2026-07-29 14:16:16 +08:00
• 7c6729b769 [Model] Add Kimi K3 support: model files and kernels [1/N] (#50089) +1222 people 2026-07-29 14:10:58 +08:00
• 6f00a1ae3b fused_moe: add VLLM_TRITON_USE_TD tensor-descriptor path (#42436) 3 people 2026-07-29 07:15:10 +02:00
• 6f91edf96d [Test] dynamic_shapes_compilation (#49974) Jared WenandIsotr0py 2026-07-29 12:54:57 +08:00
• db7a79cbf7 [CPU] Fix s390x builds and update torch version in dockerfile (#50144) Rehan KhanandLi, Jiang <jiang1.li@intel.com> 2026-07-29 10:22:17 +05:30
• dc1be79031 Add CachePolicyFactory for pluggable/external eviction policies (#49114) Philip Pesic 2026-07-29 04:34:55 +00:00
• 0bb548b60e [CI][ROCm] Stabilize Qwen2-VL LoRA test (#50161) Andreas Karatzas 2026-07-28 23:27:45 -05:00
• 58f9659397 [Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665) Zach Zhu 2026-07-29 12:20:40 +08:00
• f37f03db4a [KV Connector] Support NIXL P/D for hybrid MLA+SSM models (#49762) Nick HillandJared Wen 2026-07-28 20:50:30 -07:00
• 32a423ac0a Integrate CuTeDSL MoE for ReLU2 NVFP4 (#49580) 3 people 2026-07-29 05:46:38 +03:00
• 30c2718eaa [CompressedTensors] FP4 Qutlass Integration (#43229) 4 people 2026-07-28 22:34:20 -04:00
• 7398a30d79 [ROCm][CI] Stabilize ngram and suffix correctness test (#50190) Andreas Karatzas 2026-07-28 21:29:00 -05:00
• 17a74b745b [Model] Add Inkling compressed-tensors dynamic FP8 support (#48876) 3 people 2026-07-28 22:27:01 -04:00
• 54ab69b14e [CI] Allow comment-triggered builds past pipeline filters (#50197) Kevin H. Luu 2026-07-28 19:11:04 -07:00
• 7f4c52f2ba [CI] Add comment-based Buildkite triggers (#50132) Kevin H. LuuandOpenAI Codex 2026-07-28 18:41:48 -07:00
• 6fbbcf2151 [BugFix] Stop dummy runs from writing mamba state through stale block-table rows (#49757) Nick HillandJeff Ma 2026-07-28 18:09:41 -07:00
• 56f31af62a [Bugfix] Fix /wake_up crash on hybrid models (Mamba/DeltaNet) (#41602) Kevin Glynn 2026-07-28 20:17:35 -04:00
• fe65aa6a97 [CI][NIXL] Fix flaky DP+EP test port conflict (#50171) Divakar Verma 2026-07-28 20:12:50 -04:00
• 176256b962 [ROCm][CI] Stabilize ROCm audio streaming test (#50163) Andreas Karatzas 2026-07-28 18:58:10 -05:00