|
6fe67cbbf3
|
[Spec][V2] Support MTP speculative decoding under pipeline parallelism (#46994)
Signed-off-by: Chris Eastwood <chris.eastwood@pwn4g3.dev>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 17:55:21 +00:00 |
|
|
Sören Dréano
|
9a35c081e8
|
[Docs] Correct API key authentication scope (/inference does NOT bypass the API key) (#56269)
Signed-off-by: Sören Dréano <gailenstorm@gmail.com>
|
2026-09-11 16:54:35 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
9dd969da09
|
[Model][ROCm] Enable DeepSeek V4 Vision (#55107)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-11 09:17:30 -07:00 |
|
|
Shanshan Shen
|
127143e27f
|
Revert "[Rocm][Kimi-k3] Fix pipeline_parallel support for the kimik3 DCP mode (#53664)" (#56429)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-11 09:17:26 -07:00 |
|
|
LucainandClaude Opus 5
|
b87339888d
|
[httpx migration] Import httpx from huggingface_hub (#56460)
Signed-off-by: Lucain Pouget <lucain@huggingface.co>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 16:29:31 +01:00 |
|
|
Wentao Ye
|
5fe77aecfc
|
[Deprecation] Deprecate items scheduled for 0.29 (#55353)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-11 08:17:02 -07:00 |
|
|
Wentao Ye
|
1e1060f998
|
[Kimi Perf] Group fp8 mla cahche insertion, 4~6x kernel level performance improvement for small batch (#55356)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-11 08:16:57 -07:00 |
|
|
Isotr0py
|
22258a26bc
|
[Multimodal] Use GPU NVDEC for EPD encoder-only instance video media IO (#53675)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-11 22:20:11 +08:00 |
|
|
djramic
|
5392fbca2a
|
[ROCm][Docker] Pin AINIC apt repo to snapshot 1.117.5-a-77 (#56459)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-09-11 14:14:16 +00:00 |
|
|
Guy StoneandClaude Fable 5
|
d5a9d0f59b
|
[Metrics] Consolidate Prometheus histogram bucket defaults into a single module (#48866)
Signed-off-by: Guy Stone <guys@spotify.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-11 10:12:36 -04:00 |
|
|
Harry MellorandClaude Opus 5
|
c191787a68
|
[Bugfix] Align vLLM YaRN with Transformers and stop re-scaling max_model_len (#56446)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 13:01:38 +00:00 |
|
|
labAxiaoming
|
a5b714eee4
|
[Bugfix] Fix Qwen3-VL and Cosmos3-Edge text architectures for CPU and pipeline parallelism (#53699)
Signed-off-by: xiaoming <1259730330@qq.com>
|
2026-09-11 05:58:15 -07:00 |
|
|
김재억andClaude Opus 5
|
912dfb3758
|
[Bugfix][Scoring] Warn when serving original Qwen3 reranker without chat template (#56017)
Signed-off-by: 김재억 <gadian88@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 12:52:45 +00:00 |
|
|
Yuxuan Zhang
|
89dbb26445
|
[Bugfix] Fix GLM-OCR MTP position masking during CUDA graph capture (#56447)
Signed-off-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk>
|
2026-09-11 12:31:10 +00:00 |
|
|
|
295ac4e52e
|
[Bugfix][Multimodal] Parse decoded video frame lists as a single video (#55326)
Signed-off-by: waizuichougou <2082431897@qq.com>
Signed-off-by: waizuichougou <105572299+waizuichougou@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 12:16:05 +00:00 |
|
|
Nicole LiHui 🥜andChauncey
|
7ef4d9bfed
|
[Bugfix][Responses] Fix browser.find action type (#55305)
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-11 12:07:04 +00:00 |
|
|
Matt
|
b4da4d17ae
|
[ROCm][Bugfix] Fix AITER preshuffled FP8 block-scale kernel (#56433)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-09-11 11:44:57 +00:00 |
|
|
shaohuaxiandCodex
|
a2bc2ffb2c
|
[Bugfix][Pooling] Restore token limits for offline Jina scoring (#56415)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-11 10:26:44 +00:00 |
|
|
|
79c137c6ad
|
[Bugfix][Rust Frontend][Renderer] Align DeepSeek tool-call arguments with deepseek-recipe (#56260)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: JinYan Su <751080330@qq.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-11 10:19:55 +00:00 |
|
|
Nicolò LucchesiandHarry Mellor
|
8c1d1c2974
|
[Misc] Log FlashInfer allreduce workspace init failure as error (#55127)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-11 09:35:56 +00:00 |
|
|
Andreas Karatzas
|
eb7e894432
|
[ROCm][CI] Add HY-V4 generation coverage (#55667)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-09-11 17:24:28 +08:00 |
|
|
|
e77daef89e
|
[Model] Support DeepSeek-V4.1-Flash (#56214)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 02:11:19 -07:00 |
|
|
Tony Lin
|
e6821ceac9
|
[XPU][CI] Add decord to test requirements (#56355)
Signed-off-by: Tony Lin <tony.lin@intel.com>
|
2026-09-11 08:58:27 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
1cf6555214
|
[Bugfix] Pin EPLB and MLA host-to-device transfer buffers (#56138)
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-11 01:57:47 -07:00 |
|
|
|
d0dfe587d5
|
[Bugfix] Fall back to full decode graphs for noncompiled models (#55095)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-11 01:56:05 -07:00 |
|
|
Nicolò Lucchesi
|
9dcab80215
|
[Bugfix][Bench] Fix bench mm-processor crash in shared request sampling (#56300)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-11 16:53:04 +08:00 |
|
|
|
69db1c26b4
|
[CI/Build][Rust Frontend] Publish vllm-proto on crates.io (#56365)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-11 16:28:52 +08:00 |
|
|
Fadi ArafehandLi, Jiang <jiang1.li@intel.com>
|
e3f755b732
|
[CPU] Speedup LM Head on Arm CPUs (#55352)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-11 16:21:14 +08:00 |
|
|
pmanczak
|
6376c601ed
|
[XPU][Tests] Enable test_per_token_group_quant_int8 on XPU (#55681)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-09-11 15:59:13 +08:00 |
|
|
|
fadfe1c7d4
|
[Bugfix][Core] Retire Mamba states across null gaps (#55450)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-11 15:50:47 +08:00 |
|
|
Micah Williamson
|
a9271c750f
|
[ROCm][CI] Accept base-v2-preview images during content hash lookup for ROCm base images (#56356)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-09-11 02:30:39 -05:00 |
|
|
Alexander
|
5c642796e8
|
[Docs] Add Nebius Serverless AI deployment guide (#56414)
Signed-off-by: Alexander Salikov <salikov57@gmail.com>
|
2026-09-10 23:58:49 -07:00 |
|
|
|
4b839c3378
|
[Attention] Extend XQA decode support on SM90 (#50439)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-11 06:19:55 +00:00 |
|
|
|
fbf51c7026
|
[Bugfix] Fix FlashInfer KV sharing with omitted K/V (#55864)
Signed-off-by: zhicheng Liu <lzc021026@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 23:07:52 -07:00 |
|
|
wang.yuqi
|
fe4d4109c2
|
[Frontend][last/N] Move all non-OpenAI content out of the OpenAI folder. (#56369)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-11 05:33:26 +00:00 |
|
|
Hung Hoang (黄兴）andCursor Agent
|
5ff50f3996
|
[Bugfix][MM] Fix swapped H/W in dummy video profiling inputs (#56385)
Signed-off-by: hungh <hungh@nvidia.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-09-11 05:25:51 +00:00 |
|
|
Simon Danielsson
|
ae48466cf3
|
[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-11 13:19:57 +08:00 |
|
|
|
980c16c8e4
|
[PCP][Spec Decode] Adds PCP support for single-module MTP and replicated DSpark. (#56107)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-10 22:07:53 -07:00 |
|
|
Tianyu Guo
|
e7edf17cea
|
[EC] Automatically enable embedding inputs on EC/KV consumers (#56379)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-09-11 04:53:37 +00:00 |
|
|
Kushal
|
b5d4186300
|
[Bugfix][LoRA] Use stored rsLoRA scaling factor in MoE expert packing (#55548)
Signed-off-by: Kushal <72650064+kushaldabbe@users.noreply.github.com>
|
2026-09-11 03:52:33 +00:00 |
|
|
|
ce08bb5b34
|
[Bugfix][Mooncake] Fix heterogeneous PP transfer completion (#56033)
Signed-off-by: wangyicong <wangyicong@bytedance.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 10:57:19 +08:00 |
|
|
YukioZzz
|
07b7553465
|
[Feature][SimpleCPU] Load fine-grained hybrid prefix hits (#54736)
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
|
2026-09-10 20:36:37 -05:00 |
|
|
|
828f4f19b4
|
[ROCm][Bugfix] Route GLM-5.3-Flash MTP through ragged sparse MLA (#55239)
Signed-off-by: jamesETsmith <james.smith9113@gmail.com>
Signed-off-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 20:13:14 -05:00 |
|
|
焦恺文
|
84030bbe3d
|
[Bugfix][Core] Stop zero-progress preemption cascades for deferred KV frees (#49675)
Signed-off-by: LearningMachine621 <147347705+LearningMachine621@users.noreply.github.com>
|
2026-09-11 00:40:10 +00:00 |
|
|
Marceli FylcekandClaude Opus 5
|
5b6cf93e8e
|
[XPU] Add forward_xpu to Mixer2RMSNormGated and FusedRMSNormGated (#54968)
Signed-off-by: Marceli Fylcek <marceli.fylcek@intel.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-11 07:58:28 +08:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
a89de950a4
|
[CI/Build] Pin HyperCLOVAX V2 test model revision (#56335)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-10 16:26:11 -07:00 |
|
|
Colin McNamara
|
360f33f61c
|
[Bugfix] Set stop_sequence explicitly in streaming message_delta event (#55325)
Signed-off-by: Colin McNamara <colin@2cups.com>
|
2026-09-10 18:21:21 -04:00 |
|
|
MattandClaude Opus 5
|
9163190dda
|
[ROCm][Bugfix][Perf] Tune multi-stream shared experts use; wvSplitKrc fixes (#56098)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-10 15:14:22 -07:00 |
|
|
shaohuaxiandCodex
|
ae71862c51
|
[Bugfix][Frontend] Check EC requirements for each metadata item (#56070)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-10 19:23:34 +00:00 |
|
|
Jiatai WangandOpenAI Codex
|
a36dfc93cb
|
[Bugfix][Multimodal] Restore cached audio inputs with UUIDs (#56310)
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-10 19:20:03 +00:00 |
|