Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 912fbe9555 [Bugfix] Fix Qwen2.5-Omni/Qwen3-Omni use_audio_in_video with multi-video inputs (#37147) Isotr0py 2026-03-16 16:56:06 +08:00
• 52131f88d9 use skip_all_guards_unsafe to drop global_state and torch_function_mode_stack guards instead of previous hacks (#36204) Laith Sakka 2026-03-16 01:52:31 -07:00
• 821eb80c0d [Performance][Model Loader] Skip non-local expert weights during EP model loading (#37136) Roy Wang 2026-03-16 16:33:36 +08:00
• a2956a0f8e [ROCm][CI] Retrying in case of batch variance effects and reducing flakiness (#36442) Andreas Karatzas 2026-03-16 03:08:51 -05:00
• 911355e216 [ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845) Andreas Karatzas 2026-03-16 03:07:27 -05:00
• 8d3f8f485e [Bugfix] fix Qwen3.5 tool calling bug (#36774) Chauncey 2026-03-16 15:38:42 +08:00
• 96efb91480 [Model Runner V2] Fix processed logits in sample() (#37144) Woosuk Kwon 2026-03-16 00:35:49 -07:00
• 2754231ba3 [Kernel] Add FlashInfer MoE A2A Kernel (#36022) 4 people 2026-03-16 02:45:32 -04:00
• 2390d44209 [Model] Add HyperCLOVAX-SEED-Think-14B language model support (#37107) bigshanedogg 2026-03-16 15:40:05 +09:00
• 7362b4450a [Bugfix] Avoid LD_PRELOAD check on MacOS (#37145) Li, Jiang 2026-03-16 14:31:44 +08:00
• 57a314d155 [CI][Bugfix] Fix 500 errors from priority overflow and TemplateError subclasses in schema fuzz tests (#37127) Andreas Karatzas 2026-03-16 00:27:21 -05:00
• d4c57863f7 [ROCm][CI] Fix engine teardown and text normalization to stabilize voxtral test (#37138) Andreas Karatzas 2026-03-15 23:49:31 -05:00
• 68e1b711f1 [XPU] Add deepseek_scaling_rope fused kernel (#36612) Wang, Yiting 2026-03-16 12:35:08 +08:00
• 0024f39a32 [ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so moriio_connector to restore P/D functionality (#34907) rasmith 2026-03-15 21:36:51 -05:00
• e9163b536e [responsesAPI][ez] add a unit test for SimpleContext logprobs (#37126) Andrew Xia 2026-03-15 17:12:26 -07:00
• 7acaea634c In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970) 5 people 2026-03-16 05:05:35 +05:30
• 697e4ff352 [GDN] add a config for gdn kernel selection (#36647) Jiangyun ZhuandRoger Wang 2026-03-16 00:40:17 +08:00
• a3e2e250f0 [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) Hari 2026-03-15 17:08:21 +05:30
• 143e4dccdf [Misc] Add online audio_in_video test (#36775) Isotr0py 2026-03-15 15:14:11 +08:00
• 6590a3ecda [Frontend] Remove torchcodec from audio dependency (#37061) Isotr0py 2026-03-15 13:15:59 +08:00
• b3debb7e77 [Build] Upgrade xgrammar to get a security fix (#36168) Russell Bryant 2026-03-14 23:13:48 -04:00
• 458c1a4b2d [Frontend] Reduce chat template warmup logging levels (#37062) Nick Hill 2026-03-14 13:48:59 -07:00
• 821fde2df4 [Bugfix] Fix xgrammar dtype mismatch on macOS CPU inference (#32384) Karan BansalandInokinoki 2026-03-14 22:59:06 +05:30
• 8c29042bb9 [Feature] Add InstantTensor weight loader (#36139) arlo 2026-03-15 01:05:23 +08:00
• 5467d137b3 [Frontend] Avoid startup error log for models without chat template (#37040) Cyrus Leung 2026-03-15 00:36:11 +08:00
• 3ed46f374b [Model Runner V2] Add Support for XD-RoPE (#36817) Santino Ramos 2026-03-14 09:27:55 -07:00
• 84868e4793 [Bugfix][Frontend] Fix audio transcription for MP4, M4A, and WebM formats (#35109) seanmamasde 2026-03-14 23:44:03 +08:00
• a8e8d62dd8 [Misc] Clean up Kimi-audio whisper encoder loading (#36903) Isotr0py 2026-03-14 23:37:52 +08:00
• e42b49bd69 Mistral common v10 (#36971) 4 people 2026-03-14 15:26:43 +01:00
• 4a718e770d [Bug] Fix Failure in /v1/chat/completions/render for Multimodal Requests (https://github.com/vllm-project/vllm/issues/35665) (#35684) Sergey Zinchenko 2026-03-14 17:10:11 +03:00
• 600a039f57 [CI] Shard Multi-Modal Models (Standard) into 4 parallel jobs (#37014) Kevin H. LuuandClaude Opus 4.6 2026-03-14 01:26:54 -07:00
• ffa5d74f15 Enable loading of fused expert weights in the Transformers modelling backend (#36997) Harry Mellor 2026-03-14 07:01:06 +00:00
• 74fe80ee95 [CI] Split Distributed Tests (4 GPUs) into 3 parallel jobs (#37015) Kevin H. LuuandClaude Opus 4.6 2026-03-13 21:21:13 -07:00
• bcfdadb1bc [Refactor] Relocate chat completion and anthropic tests (#36919) Flora Feng 2026-03-14 00:16:16 -04:00
• 236de72e49 [CI] Pin helion version (#37012) Yanan CaoandClaude Opus 4.6 2026-03-13 20:25:29 -07:00
• a116f96930 [V1] Remove pin_memory() in async_copy_to_gpu to fix sporadic stalls (#37006) sbeurnier 2026-03-14 02:37:32 +01:00
• 092ace9e3a [UX] Improve UX of CPU backend (#36968) Li, Jiangandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2026-03-14 09:27:29 +08:00
• f680dc1b39 [responsesAPI] prioritize content over summary in reasoning item input (#36516) 3 people 2026-03-13 18:20:30 -07:00
• b41aa264f9 fix: resolve chat template names before kwargs detection (#36937) 3 people 2026-03-14 01:20:16 +01:00
• 367cf5cd3e [Feat][Bugfix] Enable additional dimension for Flashinfer MLA and fix routing dtype (#36931) Dimitrios BariamisandDimitrios Bariamis 2026-03-14 00:41:16 +01:00
• 6d53efd2a5 [Bugfix] Fix MLA attention crash with AWQ/GPTQ quantized models (#34695) haosdent 2026-03-14 07:25:41 +08:00
• 8b346309a5 [Refactor] Consolidate SupportsEagle (#36063) Benjamin Chislett 2026-03-13 19:22:40 -04:00
• 54a6db827f [BugFix] Fix "DP Coordinator receives unexpected..." messages (#37008) Nick Hill 2026-03-13 16:18:05 -07:00
• 9efc4db965 [Bugfix] Fix DeepSeek-V3.2 tokenizer stripping spaces (#37004) Matthew Bonanni 2026-03-13 18:55:36 -04:00
• f1816fb192 [CI] Split V1 e2e + engine (1 GPU) into separate jobs (#36945) Kevin H. LuuandClaude Opus 4.6 2026-03-13 14:16:02 -07:00
• 0005d2a3c9 Use Transformers v5 WeightRenaming for Transformers modeling backend (#31545) Harry Mellor 2026-03-13 20:49:08 +00:00
• d0b402974f [Bugfix][Spec Decode] Avoid double call of Ngram CPU (#36952) Ekagra Ranjan 2026-03-13 16:33:19 -04:00
• 6341d43043 [ROCm][Quantization] add quark w4a8 mxfp4_fp8 for LinearLayer (#35316) Divakar Verma 2026-03-13 15:44:24 -04:00
• 7afe0faab1 [Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666) 3 people 2026-03-13 19:10:06 +00:00
• 5a3f1eb62f [Misc] Set default kv_buffer_device in a better way (#36862) Harry Mellor 2026-03-13 19:07:33 +00:00
• b3ce711b93 Fp8 lora dense kernel (#35242) yugong333 2026-03-13 12:05:08 -07:00
• abf61aaa8e [Bugfix] Fix Qwen2.5-omni/Qwen3-omni mm_processor cache for audio_in_video request (#36800) Isotr0py 2026-03-14 02:16:05 +08:00
• 4508532fbd [Bugfix] fix paddleocr crash on some image shape (#36959) 3 people 2026-03-13 21:46:55 +08:00
• d5af196c18 [2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627) 3 people 2026-03-13 15:25:33 +02:00
• 82f836d976 [XPU] Support LoRA via torch.compile on XPU platform (#36962) Chaojun Zhang 2026-03-13 18:34:59 +08:00
• 4fccd30f19 [ROCm][CI] Upgrading orchestrator to handle python pipeline markers and options (#36181) Andreas Karatzas 2026-03-13 04:04:22 -05:00
• cfaf4668f7 [kv_offload+HMA][1/N]: Support multiple KV groups in OffloadingSpec (#36610) Or Ozeri 2026-03-13 10:04:21 +02:00
• 99a57bdf74 [ROCm][CI] Corrected the GPT-OSS test root path (#36711) Andreas Karatzas 2026-03-13 02:53:43 -05:00
• a2268617cf [Frontend] Delegate preprocessing to OpenAIServingRender (#36483) Sage 2026-03-13 09:39:43 +02:00
• a4ad9db541 Enable RoPE+KV cache fusion for ROCm AITER FA (non-shuffle layout) (#35786) Rohan Potdar 2026-03-13 02:33:22 -05:00
• b373b5102a [Tests] Shutdown test RemoteVLLMServer cleanly (#36950) Nick Hill 2026-03-13 00:32:55 -07:00
• f296a1966d [Bugfix] Fix FlashInfer GDN warmup ValueError on SM90 GPUs (#36876) Thomas Parnell 2026-03-13 07:09:39 +01:00
• bc2c0c86ef [Frontend] Fix usage incorrectly returned with empty stream_options` (#36379) Csrayz 2026-03-13 11:33:04 +08:00
• 891c60dcd5 fix(kv-cache): increase hybrid attention grouping threshold from 1.25 to 1.5 (#36684) jaime campos salas 2026-03-12 23:28:27 -04:00
• 1ce13cf992 [Model] Add support for BERT-like Chinese ERNIE pooling models (#36385) whyiugandwang.yuqi 2026-03-13 11:23:53 +08:00
• 10f08dedfa [Model] Add ColPali late interaction model for multi-modal retrieval (#36818) NikitaandCyrus Leung 2026-03-13 03:18:57 +01:00
• 5e1a373d2e [BUG] Fix rank calculation in NCCLWeightTransferEngine (#36940) Aaron Hao 2026-03-12 18:56:51 -07:00
• 572c776bfb build: update smg-grpc-servicer to use vllm extra (#36938) Simo Lin 2026-03-12 18:31:36 -07:00
• 55d8073d06 [Bugfix] ep_scatter kernel store-load race condition (#34991) Yifan Qiao 2026-03-12 18:07:59 -07:00
• cd32d6f586 [Model Runner V2] Some code simplification (#36929) Nick Hill 2026-03-12 17:59:23 -07:00
• aaa3092f51 [MoE] Add routing simulation override for MXFP4 quantized MoE (#33595) Jaewon 2026-03-12 17:30:44 -07:00
• 87985077a4 [Speculative Decoding] Add norm_before_fc for gpt-oss draft models (#36545) 3 people 2026-03-12 19:03:32 -04:00
• a79c1c2c80 [AMD][Build] Add DeepEP to ROCm Dockerfile (#36086) Ryan Rock 2026-03-12 16:33:32 -05:00
• cc8f1f4764 [ROCm][CI] Preparing gfx90a mirroring (#36210) Andreas Karatzas 2026-03-12 15:42:25 -05:00
• 05b9e8ab5b Revise environment setup in AGENTS.md (#36909) Michael GoinandHarry Mellor 2026-03-12 20:21:11 +01:00
• 2cdf92228c [Feature]: Remove Chunking From FusedMoE (#34086) Xinan MiaoandSouthWest7 2026-03-13 02:24:38 +08:00
• c973ecdead [bnb] Skip moe + bnb test (#36896) Marc Sun 2026-03-12 19:03:25 +01:00
• e39257a552 Add AGENTS.md (#36877) Harry Mellorandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2026-03-12 17:20:50 +00:00
• cc16b24b17 Update Flashinfer to 0.6.6 (#36768) Dimitrios BariamisandDimitrios Bariamis 2026-03-12 18:19:19 +01:00
• bdc2343454 [Bugfix] Fix KeyError in parse_response_input for reasoning items with optional content (#34499) Eunkwang Jeon 2026-03-13 01:13:36 +09:00
• f444c05c32 [Attention] Use FA4 for MLA prefill (#34732) Matthew Bonanni 2026-03-12 12:10:17 -04:00
• 85199f9681 [Bugfix] fix main branch pre-commit error (1 line change) (#36897) SoluMilken 2026-03-13 00:08:37 +08:00
• a1257fd1ea [Kernel] Add FP8 KV cache support to Triton MLA decode attention (#34597) grimulkan 2026-03-12 10:32:34 -05:00
• abcffbba8c [CI] Fix mypy pre-commit errors on main (#36882) Thomas ParnellandClaude Opus 4.6 2026-03-12 16:22:29 +01:00
• 53ec16a705 [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) Kunshang Ji 2026-03-12 22:57:47 +08:00
• 2e693f48e7 [Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307) Wei ZhaoandMichael Goin 2026-03-12 10:32:31 -04:00
• 7f1f36bf91 [CI] Fix mypy for vllm/reasoning (#35742) Martin HickeyandHarry Mellor 2026-03-12 12:21:33 +00:00
• 5282c7d4d0 [docs] Add lightweight AI assisted contribution policy (#30947) Mark McLoughlin 2026-03-12 11:46:13 +00:00
• 9e19f8338b [Perf] add packed recurrent fast path for decode (#36596) caozuobaandRoger Wang 2026-03-12 19:01:57 +08:00
• 06e0bc21d2 [Frontend] Split OpenAIServingModels into OpenAIModelRegistry + OpenAIServingModels (#36536) Sage 2026-03-12 12:29:37 +02:00
• 5a71cdd76e [Bugfix] Fix crash when tool_choice=required exceeds max_tokens (#36841) Chauncey 2026-03-12 18:28:45 +08:00
• f0d3658c0f [MM][OOT] Support CPU seq_lens for OOT MMEncoderAttention kernels (#36605) Shanshan ShenandIsotr0py 2026-03-12 18:28:23 +08:00
• 57431d8231 [UX] Only show FP4 Marlin fallback warning for w4a4 models (#36806) Michael GoinandClaude 2026-03-12 10:19:35 +01:00
• 3e64fe4a18 [Bugfix] Warm up Triton autotuner for GDN layers during V1 profiling (#36599) Xu Jinyang 2026-03-12 15:51:09 +08:00
• 8cb24d3aed [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) sfeiqiangandphaedonsun 2026-03-12 15:46:20 +08:00
• 00726c74c9 [Bugfix][Model] Fix DeepSeek-OCR TensorSchema crash on empty images_crop (#36670) István Ketykó 2026-03-12 08:35:54 +01:00
• 9fe404ed04 [Frontend] OpenAI Responses API supports Tool/Function calling with streaming (#29947) Chauncey 2026-03-12 15:03:50 +08:00
• 802f306cd1 [Tests] Skip model weight download for render-only test server (#36813) Sage 2026-03-12 08:24:42 +02:00
• 894843eb25 replace with torch.cuda.device with with torch.accelerator.device_index (#36144) Yan Ma 2026-03-12 14:12:57 +08:00
• 584a3f56de [Kernel][Helion][13/N] Force static_shapes=False in helion register (#36677) Yanan CaoandClaude Opus 4.6 2026-03-11 22:35:29 -07:00