 amd-xavierwang
|
2d75e586fc
|
[ROCm][Kernel][DSV4] Remove tl.constexpr to avoid cold-compile churn in indexer gather kernel (#56153)
Signed-off-by: xawang <xawang@amd.com>
|
2026-09-11 21:34:17 +00:00 |
|
|
Giancarlo Delfin
|
9dcf6bf344
|
[BugFix] Fix DP token padding in dflash attention metadata (#56181)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-09-11 14:33:53 -07:00 |
|
|
mevinceandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
c1b69aa0d4
|
[Bugfix][KV Connector] Only enforce disk block alignment for O_DIRECT (#55424)
Signed-off-by: Vincent <vincexxchan@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 13:12:59 -07:00 |
|
|
Nick HillandAndreas Karatzas
|
cc5dd0a857
|
[MRV1] Scope breakable cudagraphs to the piecewise path only (#56312)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-11 19:55:34 +00:00 |
|
|
Lyle Lai
|
dffb863c97
|
Upgrade tpu-inference to v0.29.0 (#56388)
Signed-off-by: Lyle Lai <lyle.lai@cienet.com>
|
2026-09-11 12:32:47 -07:00 |
|
|
chengchengpeiandTyler Michael Smith
|
0c1e89ceb9
|
[Bugfix][Kimi-K3] Fix KDA projection overlap on Hopper (#55426)
Signed-off-by: Chengcheng Pei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: Chengcheng Pei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-09-11 19:07:30 +00:00 |
|
|
Misha Goin
|
00e5cda926
|
[Agents] Link Triton skill to JIT kernel warmup guide (#56499)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-11 12:05:41 -07:00 |
|
|
Misha Goin
|
8a7f98c8c3
|
[Kernel][MoE] Optimize batched_moe_align_block_size with cooperative writes (#53280)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-11 12:05:22 -07:00 |
|
|
Andy Lo
|
dc07f1638f
|
[Bugfix][MLA] Read sparse model settings from text config (#56160)
Signed-off-by: Andy Lo <andy@mistral.ai>
|
2026-09-11 18:02:13 +00:00 |
|
|
|
6fe67cbbf3
|
[Spec][V2] Support MTP speculative decoding under pipeline parallelism (#46994)
Signed-off-by: Chris Eastwood <chris.eastwood@pwn4g3.dev>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 17:55:21 +00:00 |
|
|
Sören Dréano
|
9a35c081e8
|
[Docs] Correct API key authentication scope (/inference does NOT bypass the API key) (#56269)
Signed-off-by: Sören Dréano <gailenstorm@gmail.com>
|
2026-09-11 16:54:35 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
9dd969da09
|
[Model][ROCm] Enable DeepSeek V4 Vision (#55107)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-11 09:17:30 -07:00 |
|
|
Shanshan Shen
|
127143e27f
|
Revert "[Rocm][Kimi-k3] Fix pipeline_parallel support for the kimik3 DCP mode (#53664)" (#56429)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-11 09:17:26 -07:00 |
|
|
LucainandClaude Opus 5
|
b87339888d
|
[httpx migration] Import httpx from huggingface_hub (#56460)
Signed-off-by: Lucain Pouget <lucain@huggingface.co>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 16:29:31 +01:00 |
|
|
Wentao Ye
|
5fe77aecfc
|
[Deprecation] Deprecate items scheduled for 0.29 (#55353)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-11 08:17:02 -07:00 |
|
|
Wentao Ye
|
1e1060f998
|
[Kimi Perf] Group fp8 mla cahche insertion, 4~6x kernel level performance improvement for small batch (#55356)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-11 08:16:57 -07:00 |
|
|
Isotr0py
|
22258a26bc
|
[Multimodal] Use GPU NVDEC for EPD encoder-only instance video media IO (#53675)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-11 22:20:11 +08:00 |
|
|
djramic
|
5392fbca2a
|
[ROCm][Docker] Pin AINIC apt repo to snapshot 1.117.5-a-77 (#56459)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-09-11 14:14:16 +00:00 |
|
|
Guy StoneandClaude Fable 5
|
d5a9d0f59b
|
[Metrics] Consolidate Prometheus histogram bucket defaults into a single module (#48866)
Signed-off-by: Guy Stone <guys@spotify.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-11 10:12:36 -04:00 |
|
|
Harry MellorandClaude Opus 5
|
c191787a68
|
[Bugfix] Align vLLM YaRN with Transformers and stop re-scaling max_model_len (#56446)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 13:01:38 +00:00 |
|
|
labAxiaoming
|
a5b714eee4
|
[Bugfix] Fix Qwen3-VL and Cosmos3-Edge text architectures for CPU and pipeline parallelism (#53699)
Signed-off-by: xiaoming <1259730330@qq.com>
|
2026-09-11 05:58:15 -07:00 |
|
|
김재억andClaude Opus 5
|
912dfb3758
|
[Bugfix][Scoring] Warn when serving original Qwen3 reranker without chat template (#56017)
Signed-off-by: 김재억 <gadian88@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 12:52:45 +00:00 |
|
|
Yuxuan Zhang
|
89dbb26445
|
[Bugfix] Fix GLM-OCR MTP position masking during CUDA graph capture (#56447)
Signed-off-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk>
|
2026-09-11 12:31:10 +00:00 |
|
|
|
295ac4e52e
|
[Bugfix][Multimodal] Parse decoded video frame lists as a single video (#55326)
Signed-off-by: waizuichougou <2082431897@qq.com>
Signed-off-by: waizuichougou <105572299+waizuichougou@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 12:16:05 +00:00 |
|
|
Nicole LiHui 🥜andChauncey
|
7ef4d9bfed
|
[Bugfix][Responses] Fix browser.find action type (#55305)
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-11 12:07:04 +00:00 |
|
|
Matt
|
b4da4d17ae
|
[ROCm][Bugfix] Fix AITER preshuffled FP8 block-scale kernel (#56433)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-09-11 11:44:57 +00:00 |
|
|
shaohuaxiandCodex
|
a2bc2ffb2c
|
[Bugfix][Pooling] Restore token limits for offline Jina scoring (#56415)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-11 10:26:44 +00:00 |
|
|
|
79c137c6ad
|
[Bugfix][Rust Frontend][Renderer] Align DeepSeek tool-call arguments with deepseek-recipe (#56260)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: JinYan Su <751080330@qq.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-11 10:19:55 +00:00 |
|
|
Nicolò LucchesiandHarry Mellor
|
8c1d1c2974
|
[Misc] Log FlashInfer allreduce workspace init failure as error (#55127)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-11 09:35:56 +00:00 |
|
|
Andreas Karatzas
|
eb7e894432
|
[ROCm][CI] Add HY-V4 generation coverage (#55667)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-09-11 17:24:28 +08:00 |
|
|
|
e77daef89e
|
[Model] Support DeepSeek-V4.1-Flash (#56214)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 02:11:19 -07:00 |
|
|
Tony Lin
|
e6821ceac9
|
[XPU][CI] Add decord to test requirements (#56355)
Signed-off-by: Tony Lin <tony.lin@intel.com>
|
2026-09-11 08:58:27 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
1cf6555214
|
[Bugfix] Pin EPLB and MLA host-to-device transfer buffers (#56138)
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-11 01:57:47 -07:00 |
|
|
|
d0dfe587d5
|
[Bugfix] Fall back to full decode graphs for noncompiled models (#55095)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-11 01:56:05 -07:00 |
|
|
Nicolò Lucchesi
|
9dcab80215
|
[Bugfix][Bench] Fix bench mm-processor crash in shared request sampling (#56300)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-11 16:53:04 +08:00 |
|
|
|
69db1c26b4
|
[CI/Build][Rust Frontend] Publish vllm-proto on crates.io (#56365)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-11 16:28:52 +08:00 |
|
|
Fadi ArafehandLi, Jiang <jiang1.li@intel.com>
|
e3f755b732
|
[CPU] Speedup LM Head on Arm CPUs (#55352)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-11 16:21:14 +08:00 |
|
|
pmanczak
|
6376c601ed
|
[XPU][Tests] Enable test_per_token_group_quant_int8 on XPU (#55681)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-09-11 15:59:13 +08:00 |
|
|
|
fadfe1c7d4
|
[Bugfix][Core] Retire Mamba states across null gaps (#55450)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-11 15:50:47 +08:00 |
|
|
Micah Williamson
|
a9271c750f
|
[ROCm][CI] Accept base-v2-preview images during content hash lookup for ROCm base images (#56356)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-09-11 02:30:39 -05:00 |
|
|
Alexander
|
5c642796e8
|
[Docs] Add Nebius Serverless AI deployment guide (#56414)
Signed-off-by: Alexander Salikov <salikov57@gmail.com>
|
2026-09-10 23:58:49 -07:00 |
|
|
|
4b839c3378
|
[Attention] Extend XQA decode support on SM90 (#50439)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-11 06:19:55 +00:00 |
|
|
|
fbf51c7026
|
[Bugfix] Fix FlashInfer KV sharing with omitted K/V (#55864)
Signed-off-by: zhicheng Liu <lzc021026@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 23:07:52 -07:00 |
|
|
wang.yuqi
|
fe4d4109c2
|
[Frontend][last/N] Move all non-OpenAI content out of the OpenAI folder. (#56369)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-11 05:33:26 +00:00 |
|
|
Hung Hoang (黄兴）andCursor Agent
|
5ff50f3996
|
[Bugfix][MM] Fix swapped H/W in dummy video profiling inputs (#56385)
Signed-off-by: hungh <hungh@nvidia.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-09-11 05:25:51 +00:00 |
|
|
Simon Danielsson
|
ae48466cf3
|
[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-11 13:19:57 +08:00 |
|
|
|
980c16c8e4
|
[PCP][Spec Decode] Adds PCP support for single-module MTP and replicated DSpark. (#56107)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-10 22:07:53 -07:00 |
|
|
Tianyu Guo
|
e7edf17cea
|
[EC] Automatically enable embedding inputs on EC/KV consumers (#56379)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-09-11 04:53:37 +00:00 |
|
|
Kushal
|
b5d4186300
|
[Bugfix][LoRA] Use stored rsLoRA scaling factor in MoE expert packing (#55548)
Signed-off-by: Kushal <72650064+kushaldabbe@users.noreply.github.com>
|
2026-09-11 03:52:33 +00:00 |
|
|
|
ce08bb5b34
|
[Bugfix][Mooncake] Fix heterogeneous PP transfer completion (#56033)
Signed-off-by: wangyicong <wangyicong@bytedance.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-11 10:57:19 +08:00 |
|