Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• ccc05de038 [Bugfix] Fix missing sequence_lengths in EXAONE-4.5 vision encoder (#45073) Jongsu Liam KimandClaude 2026-06-10 23:44:34 +09:00
• 6ec7dcd641 [Frontend][Metrics] Add vllm:tool_call_parser_invocations_total Prometheus metric (#44448) yzong-rhandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-06-10 10:29:11 -04:00
• c9e5bf8135 [Bugfix] Fix layerwise reload dropping params after a composed weight loader (#44814) 3 people 2026-06-10 15:42:05 +02:00
• 6850839c6f [Perf] Fix dsv3_router_gemm heuristic (#44217) Roberto L. Castro 2026-06-10 15:08:41 +02:00
• 87c15d46e3 [Bugfix] Lazily import the humming quantization backend (#44921) Michael GoinandClaude 2026-06-10 09:06:17 -04:00
• 4882fd7632 [Bugfix][Reasoning] Nemotron V3: surface reasoning as content when thinking is unterminated (#39091) Andrii SkliarandAndrii Skliar 2026-06-10 14:58:19 +02:00
• 77f42d9725 [Model] Remove obsolete ERNIE models (#45127) Tiezhen WANGandClaude 2026-06-10 20:54:30 +08:00
• 9dfc313bdc Feature/offloading manager stats (#35669) 5 people 2026-06-10 07:44:55 -05:00
• 9ad08c4d15 [Bugfix][Rust Frontend] Fix missing added tokens in hf/fastokens tokenizer (#44683) Isotr0pyandBugen Zhao 2026-06-10 18:52:41 +08:00
• a1ec011a83 [Bugfix] Add deepseek_v32 to Quark dynamic MXFP4 model type check (#39498) Shantipriya Parida 2026-06-10 12:52:33 +03:00
• fdfb2566c0 [Rust Frontend] [CI] Unify Rust artifact builds with setuptools-rust (#44981) Bugen Zhao 2026-06-10 17:48:34 +08:00
• 8a5cf1ccd6 [Security] Fix remote DoS via invalid recovered token reinjection (#44744) Juan Pérez de Algaba 2026-06-10 11:31:43 +02:00
• fe1d923afc [BUGFIX][XPU] fix xpu flash_attn_varlen_func interface (#45110) Kunshang Ji 2026-06-10 17:07:40 +08:00
• 32daf56b42 [Refactor] Rename rocm_moe.py to rocm_moe_rdna.py (#45011) JartXandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-06-10 11:02:09 +02:00
• 82a42234be [ROCm][CI] Defer AITER sampler import and isolate server test PYTHONPATH (#44823) Andreas Karatzas 2026-06-10 03:56:11 -05:00
• af9f583344 Revert "[Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures" (#45029) Harry Mellor 2026-06-10 09:37:03 +01:00
• bd2d83ff31 [SpecDecode] Reduce TP communication for large-vocab draft models speculative decoding (#39419) yiheng 2026-06-10 15:59:24 +08:00
• bb78168b21 [ROCm][gpt-oss] Hybrid CDNA4 swizzle gate for A8W4 MoE (#44804) xiaohuguo2023 2026-06-10 07:59:44 +01:00
• 89c6a41001 [Bench] Add BFCL dataset for vllm bench serve tool-calling workloads (#42457) 4 people 2026-06-09 23:59:18 -07:00
• 7fdfa6441d Model/colbert autoweightsloader (#44999) Furkan Fandwang.yuqi 2026-06-10 09:58:50 +03:00
• e9b728de8a Change from owning configs to owning config utils (#45058) Harry Mellor 2026-06-10 07:40:25 +01:00
• 5828a205ef Fix Harmony tool descriptions for optional fields (#44686) Varun Vinayak ShenoyandCodex 2026-06-09 23:29:22 -07:00
• 7a74f31d2e [Rust Frontend] Add seed_oss and step3p5 reasoning parsers (#44552) Yaoming Zhan 2026-06-09 23:01:33 -07:00
• 47930b59ca [Bugfix] Handle HWC images in ImageProcessorItems.get_image_size (#45057) Akshat katiyarandClaude 2026-06-10 11:05:50 +05:30
• 6aec99f030 [Refactor] Remove dead states from chat completion serving (#45081) Flora Feng 2026-06-10 01:20:15 -04:00
• f4966f8b3d [Bugfix] Fix weight loading issues caused by #41184 (#45054) bnellnm 2026-06-10 01:20:13 -04:00
• 2c9c07c85e [Bugfix][CI/Build] Fix Rust frontend build after chat conversion refactor (#45085) Mohammad Miadh Angkad 2026-06-10 11:04:41 +08:00
• 320c52b134 [Bench] benchmark_serving_multi_turn: make non-standard conversation_id payload opt-in (#43756) Change72 2026-06-09 19:41:56 -07:00
• 6deb05e0e4 [Core][Model] Gemma4: Unified FA4 for all layers + FlashAttention mm_prefix support (#42175) 4 people 2026-06-10 02:45:39 +02:00
• d82ac00923 [Refactor][Mistral] Extract parsing logic into MistralParser (#44596) Flora Feng 2026-06-09 20:12:23 -04:00
• dac9e9a640 [Rust Frontend] Extract shared options in route helper params (#44884) Bugen Zhao 2026-06-10 08:02:35 +08:00
• d7607ad273 [Bug] Fix deepseek v4 OOM issue (#44914) Wentao Ye 2026-06-09 18:47:06 -04:00
• d955745d58 [ROCm][CI] fix test_rope_kvcache_fusion.py (#44678) Charlie FuandRohan Potdar 2026-06-09 16:53:46 -05:00
• e1ed89dbee Revert "[Kernel] Speed up silu_and_mul_per_block_quant with warp-shuf… (#45066) Micah Williamson 2026-06-09 16:12:06 -05:00
• 1c2ffc6f88 feat(multi-turn-bench): add api_key and custom headers for multi turn benchmark (#44516) 3 people 2026-06-10 05:00:07 +08:00
• ca4cfd8731 [Bugfix] fix qwen3.5 ep weight loading (#45002) Jiangyun Zhu 2026-06-10 04:55:30 +08:00
• c9c1540e61 [ROCm][V2] Fix failed assertion in Llama models when using EAGLE with ROCM_AITER_FA (#44936) Micah Williamson 2026-06-09 13:30:52 -05:00
• c1d754d681 [Mooncake] Use all HCAs on multi-NIC hosts instead of GPU-indexed RNIC selection (#43799) Dao007foreverandClaude Opus 4.7 2026-06-09 11:05:36 -07:00
• 01d8cd92dd [ROCm][Perf] Use fused softplus-sqrt-topk router under AITER fused-MoE (#44945) Fangzhou AiandvLLM Contributor 2026-06-09 13:53:05 -04:00
• a4b14b98c6 [Kernel] Speed up silu_and_mul_per_block_quant with warp-shuffle reduction + vectorized I/O (#44173) SII-yangdianandSII-yangdian 2026-06-10 01:41:26 +08:00
• cf1c906724 [Security] Fix image EXIF orientation and tRNS transparency handling (#44974) Juan Pérez de Algaba 2026-06-09 18:34:44 +02:00
• 766ce2bb6b Fix MiDashengLM TP>1 crash in audio encoder attention (#44408) Michał GanczarenkoandKunshang Ji 2026-06-09 19:29:14 +03:00
• 3d119f78f7 [Docs] Add KV offloading usage guide (single- and multi-tier) (#44415) Ronen Schafferandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-06-09 19:20:23 +03:00
• 1b1359c332 [Security] Fix DoS via audio decompression bomb in speech-to-text endpoint (#44970) Juan Pérez de Algaba 2026-06-09 18:18:53 +02:00
• cad4ca12b8 [Bugfix] Add X-Session-ID from conversation_id in multi-turn benchmark (#44663) Tyko Niemi 2026-06-09 18:57:00 +03:00
• b697119800 [ROCm][CI] Stabilize ModernBERT token-classification parity against Hugging Face (#44040) Andreas Karatzas 2026-06-09 10:52:36 -05:00
• b4c6dc6454 [WIP][XPU] upgrade torch-xpu to 2.12 (#42262) Kunshang Ji 2026-06-09 23:51:39 +08:00
• 2ee5106372 Remove raw_inputs from transformers backend (#39425) Raushan Turganbay 2026-06-09 17:01:04 +02:00
• 7a89b72564 [Perf] fuse qk rmsnorm rope gate for qwen3.5 (#44176) Jiangyun Zhu 2026-06-09 22:12:17 +08:00
• dc10e467a9 [Bugfix] Fix minimax_qk_norm_fusion (#44983) Jee Jee Li 2026-06-09 21:43:46 +08:00
• ee4d7df2b5 [Cohere] Cohere2 moe parser fix (#44907) Terrence Zhao 2026-06-09 09:32:18 -04:00
• 3e8afdf785 [Cohere] Fix Cohere2MoE weight loading when using Transformers ≥5.10 (#44747) Terrence Zhao 2026-06-09 09:27:40 -04:00
• 6690a0c4de [PD][Bugfix] Fix KV Cache sharing with HMA (#44629) Nicolò Lucchesi 2026-06-09 15:10:06 +02:00
• 1c23c42030 [Rust Frontend] Support Kimi K2 tool call IDs (#44901) Maria Guevara 2026-06-09 13:31:26 +01:00
• b12e42d132 [XPU][CI] Refine docker image build and pull/create lock mechanism in Intel GPU CI (#44481) xiangdong 2026-06-09 20:20:32 +08:00
• 69fdaffbcd [Rust Frontend] Add /tokenize and /detokenize endpoints (#44222) 3 people 2026-06-09 19:11:37 +07:00
• 80e2c4462d [ROCm][Compile] Fuse AR + RMSNorm + per-group FP8 quant (+ DSv3.2 indexer fan-out) (#42864) Markus HartikainenandFrida Andersson 2026-06-09 15:06:56 +03:00
• 5b3807e862 [KV Events] Switch event structs from array to map encoding (#42892) Sage 2026-06-09 14:39:52 +03:00
• 59401ac9f1 [Kernel][Perf] Tune fused_moe FP8 config for Qwen3-Next-80B tp=4 on H100 (+25% at batch 96-512) (#44830) Qiuyang Yue 2026-06-09 04:15:51 -07:00
• d841386d27 [Rust Frontend] Support API key authentication (#44321) 3 people 2026-06-09 18:15:20 +08:00
• fff9210b2a [CI/Docs] Remove stale disagg prefill links (#44918) Mohammad Miadh Angkad 2026-06-09 18:05:53 +08:00
• 70db1488c5 [DSV4][XPU] Add MHC fused_post_pre support (#44144) Ma Jian 2026-06-09 17:23:17 +08:00
• 2385e140d6 [ROCm][CI] Stabilize sleep-mode memory release (#43022) Andreas Karatzas 2026-06-09 03:51:12 -05:00
• dab60fc658 [Bugfix][CI] Fix test_offloading_connector.py::test_fs_tiering_offloading (#44903) Nicolò Lucchesi 2026-06-09 09:57:34 +02:00
• 996222f4bf [CI] Reorganize entrypoints CI (#44947) wang.yuqi 2026-06-09 15:46:11 +08:00
• e6fc848d4f [Bugfix][MiniCPM-o] Fix cuda/cpu device mismatch in Resampler2_5 pos_embed (#43844) 4 people 2026-06-09 11:58:26 +05:30
• f843ac1a1c [Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures (#44952) Andreas Karatzas 2026-06-09 00:49:30 -05:00
• 7c2aa3108a fix: prevent MM cache hang from stale LRU order keys (#43595) jeff.yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-06-09 13:48:31 +08:00
• ebf53ba373 [Bugfix][Rust Frontend] Set a structured-output backend so requests do not 500 (#44729) Ting SUNandBugen Zhao 2026-06-09 13:30:54 +08:00
• baacbfcebf [ROCm][MLA][Bugfix] Reserve FP8 prefill workspace before lock for Kimi-K2.5 (#42978) 3 people 2026-06-09 07:25:52 +02:00
• d8218b1ee7 [Bugfix] Propagate ImportError from load_audio_pyav when vllm[audio] … (#44750) littlecircle0730andHsiao-Yuan Chen 2026-06-08 21:24:52 -07:00
• 9f153aa781 [MM][Perf][CG] Support ViT full CUDA graph for glm4_1v image and video inference (#40576) 3 people 2026-06-09 11:13:56 +08:00
• d3de61502f [XPU][CI] fix test case path (#44940) Kunshang Ji 2026-06-09 11:02:31 +08:00
• 540aaf2140 [Bugfix][Model] Qwen3-Omni: move cu_seqlens to GPU before VIT attention (#44264) Lanze Liu 2026-06-08 20:02:27 -07:00
• 4128605ad4 [Docs] Remove broken link to deleted disaggregated_prefill.sh (#44929) Lanze Liu 2026-06-08 18:40:06 -07:00
• e2f993dc41 [WideEP] Integrate DeepEP v2 (#41183) Tyler Michael SmithandClaude Opus 4.6 2026-06-08 21:07:29 -04:00
• 05cb606cad [ROCm][CI] Re-route NixlConnector jobs (#44809) Andreas Karatzas 2026-06-08 18:57:11 -05:00
• 3f627ebef7 [Misc] usage_stats: report more engine, spec-decode, and EP config (#44595) Zachary XiandCursor 2026-06-08 15:20:00 -07:00
• bc941f375d [Rust Frontend] [Refactor] Refine utility call interfaces (#44856) Bugen Zhao 2026-06-09 06:13:08 +08:00
• 6afa25000c [Bugfix] Canonicalize FP8 weight layout to (K, N) at the source (#44735) Michael Goin 2026-06-08 16:37:36 -04:00
• 823a0ab754 [Bugfix][MoE] Fix fused MoE expert mapping helper call sites (#44897) Mohammad Miadh Angkad 2026-06-09 04:35:04 +08:00
• 2c27c294c0 [Model Runner V2] Fix mrv2 mm lora issue (#44450) Wentao Ye 2026-06-08 14:30:09 -04:00
• ba94a3b998 [Attention] Extract KV-cache update from CPU attention backend (#40470) 3 people 2026-06-08 11:43:05 -04:00
• dc68bd8c41 [MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184) bnellnm 2026-06-08 10:42:58 -04:00
• 753e9d55e6 [Quantization] add online fp8 ptpc (#44132) Walter Beller-Moralesandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2026-06-08 10:42:11 -04:00
• ac3409d162 [Benchmark] Auto-detect and correct client/server tokenizer mismatch for random dataset (#44708) akii96 2026-06-08 16:10:20 +03:00
• 93ee4cd47f [CI] Consolidate multimodal entrypoint tests. (#44819) wang.yuqi 2026-06-08 19:48:08 +08:00
• 980796cd07 [CI/Build][CPU] Fix flaky CI image build failure and unexpected warnings (#44852) Li, Jiang 2026-06-08 19:10:06 +08:00
• 5add018beb [Connector] Remove P2pNcclConnector (#44854) Nicolò Lucchesi 2026-06-08 12:58:29 +02:00
• d5fe994e79 [CPU][Spec Decode] Warn about throughput loss when libiomp5 is not preloaded (#44419) 3 people 2026-06-08 13:45:08 +03:00
• fa662b1a8b [XPU] Cap topk/topp Triton BLOCK_SIZE to 4096 to fix Top-p mask difference failures (#44470) Chaojun Zhang 2026-06-08 17:36:51 +08:00
• 3c0b4432be [Rust Frontend] Add /pause, /resume, /is_paused endpoints (#44499) Sahil SinghandBugen Zhao 2026-06-08 14:58:37 +05:30
• 469f3dcf1d [BugFix] Use served model name in gemma4 audio-tower error message (#44828) Sungjae Lee 2026-06-08 15:58:31 +09:00
• 94fcdd007f [XPU][CI] Add more test cases in Intel GPU CI (#43663) xiangdong 2026-06-08 14:21:24 +08:00
• d9ff7e4e9a [ROCm][CI] Stabilizing teardown and timeout of flaky tests to prevent rare OOMs (#44761) Andreas Karatzas 2026-06-08 01:11:17 -05:00
• 967c5c3bc3 [ROCm][CI] Stage C mirrors (#42793) Andreas Karatzas 2026-06-08 01:00:59 -05:00
• 54c660c3a6 [XPU][Minor] format moe kernel name and add in kernel list (#44771) Yan Ma 2026-06-08 13:58:16 +08:00
• 8fb0274415 [MM][CG] Simplify ViT CUDA graph interfaces (#44484) Shanshan Shen 2026-06-08 13:57:06 +08:00
• eebce65756 [XPU]feat: add DeepSeek-V4 XPU attention decode path (#42953) Ma Jian 2026-06-08 13:27:12 +08:00
• 303916e93d [Bugfix]: Fix assertion in MambaManager.allocate_slots() (#39562) 3 people 2026-06-08 12:34:37 +08:00