 Nicolò Lucchesi
|
0ca7aef4e3
|
[Bugfix][NixlPush] Guard _remote_agents read in _do_send_reg_notif (X1) (#56317)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-14 18:37:12 +08:00 |
|
|
Juan Pérez de AlgabaandCursor
|
ea723c81c3
|
[Security] Cap Qwen-VL video sampling knobs (#56729)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-14 10:22:18 +00:00 |
|
|
jiangkuaixue123
|
1678b39627
|
[Bugfix][EPD] Preserve media processing options in encoder requests (#56786)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
|
2026-09-14 10:05:13 +00:00 |
|
|
Martin Hickey
|
934b1fcbcb
|
[Frontend] Replace VLLM_ENABLE_SCALE_OUT_ENDPOINTS with --enable-scale-out (#55176)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-09-14 10:02:14 +00:00 |
|
|
|
2c7ee87223
|
[Bugfix][Mooncake] Report failed remote KV loads to the scheduler (#50984)
Signed-off-by: liuqihao <liuqihao@myhexin.com>
Co-authored-by: liuqihao <liuqihao@myhexin.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-14 09:55:39 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
5236bef721
|
[CI] Keep OTel bytecode out of mounted checkouts (#56766)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-14 02:52:45 -07:00 |
|
|
Matthias Gehre
|
dc2e8f1157
|
[ROCm][Perf] W4A16: keep skinny GEMM zero-points packed 4-bit (#54965)
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
|
2026-09-14 17:40:25 +08:00 |
|
|
|
238cb2b191
|
[Perf][GLM-5.3-Flash] Dense/masked-MHA sparse prefill for the NoPE (256, 0, 256) layout + skip the NoPE K concat (#55738)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-14 09:36:39 +00:00 |
|
|
Li, Jiang
|
79f0be21ff
|
[Bugfix][CPU] Fix DeepSeek-R1 (FP8 MLA + MoE) correctness on CPU backend (#56773)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-14 17:30:28 +08:00 |
|
|
Chinmay-Kulkarni-AMDandLi, Jiang <jiang1.li@intel.com>
|
dc89fdfb0e
|
[CPU][Profiler] Group torch profiler tables by input shape when record_shapes is on (#56016)
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-14 17:16:48 +08:00 |
|
|
|
b443c1cc4e
|
[Perf][GLM-5.3-Flash] Use FlashKDA for KDA chunked prefill (1.7-3.8x faster than the Triton chunk path) (#55737)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-14 08:36:19 +00:00 |
|
|
wang.yuqi
|
23cfaad497
|
[CI] Update entrypoints CI (#56763)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-14 07:59:51 +00:00 |
|
|
|
78e84261ab
|
[Performance] Add Triton kernel for Gemma3n sparse GELU (#48498)
Signed-off-by: BWAAEEEK <jooho414@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-14 07:42:15 +00:00 |
|
|
AlecandOpenAI Codex
|
e6b4e47d2d
|
[Bugfix][Rust Frontend] Preserve selected-token logprob mode (#56406)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
|
2026-09-14 07:05:33 +00:00 |
|
|
Hung Hoang (黄兴）
|
663d7f679e
|
[Bugfix] Fix --lora-modules name=path parsing when path contains '=' (#53353)
Signed-off-by: hungh <hungh@nvidia.com>
|
2026-09-13 23:55:21 -07:00 |
|
|
Isotr0py
|
dbf49dad11
|
[Fast Start] Use GPU uuid as socket folder identifier (#56669)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-14 06:28:13 +00:00 |
|
|
Bugen Zhao
|
cf1584f373
|
[Refactor] Normalize DeepSeek V4.1 model package naming (#56741)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-13 23:17:50 -07:00 |
|
|
Alexander LeeandOpenAI Codex
|
10e8d5614c
|
[Bugfix][Beam Search] Respect skip_special_tokens during decoding (#56211)
Signed-off-by: lxy-alexander <lxy_alexander@outlook.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-14 05:49:44 +00:00 |
|
|
Anjie HouandCodex
|
73d2a8cf86
|
[2/2][Model Runner V2] FULL CUDA graph capture for microbatched steps (DBO) (#51700)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-13 22:42:33 -07:00 |
|
|
wang.yuqi
|
67111973ee
|
[Frontend] Move grpc_server to launchers. (#56746)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-14 05:03:08 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
dc36fcce90
|
[CI] Collect GPU memory telemetry for MIG slices (#56747)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-13 21:30:29 -07:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
214248c7d8
|
[CI] Move smaller H200 workloads to 18GB MIG slices (#56695)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-13 21:30:11 -07:00 |
|
|
Hotragn PettuganiandIsotr0py
|
a2685f2cda
|
[Bugfix][Multimodal] Validate base64 video payloads, matching image and audio (#54323)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
|
2026-09-14 04:14:26 +00:00 |
|
|
Chaojun Zhang
|
39545e475d
|
Revert "[CI][XPU] Disable model runner V2 for XPU quantization test for some partially pre-quantized models" (#56394)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-09-14 11:40:13 +08:00 |
|
|
|
7632f767f0
|
[Rust Frontend] Support HTTP RL weight synchronization (#56567)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-14 03:37:04 +00:00 |
|
|
Kevin H. Luu
|
2d9c30a7b5
|
[CI][Bugfix] Complete FSE fixture R-SWA contract (#56710)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-09-14 03:30:25 +00:00 |
|
|
siyuandIsotr0py
|
52dd0d7562
|
[Fast Start] Fast loader support nnode>1 (#55468)
Signed-off-by: siyu <mg21330037@smail.nju.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
|
2026-09-14 03:05:54 +00:00 |
|
|
CedricHuangandOpenAI Codex
|
eb42686a30
|
[Bugfix][Frontend] Support Responses text types in DeepSeek V4.1 (#56299)
Signed-off-by: CedricHuang <38417461+CedricHwong@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-14 10:43:09 +08:00 |
|
|
Fangzhou Ai
|
dfa1984e58
|
[ROCm][Perf] Tune MiniMax-M3 decode top-k for short contexts (#55235)
Signed-off-by: fai <fangzhouai@gmail.com>
|
2026-09-13 21:36:27 -05:00 |
|
|
|
58d45fd767
|
[Bugfix][KV Connector] MooncakeStore: exclude non-prefix-cacheable (QSA ring) groups; fix align-mode check (#55027)
Signed-off-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-13 19:18:16 -07:00 |
|
|
liuzhenwei
|
fe49665eb3
|
[XPU][CI] update test requirements (#56704)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-09-14 02:01:50 +00:00 |
|
|
Woosuk Kwon
|
3b533197a9
|
[Perf] Parallelize mHC pre-norm JIT warmup (#56683)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-09-13 18:58:20 -07:00 |
|
|
Wentao Ye
|
9f03b510c3
|
[DSv4 Bug] fix dsv4 start up error NotImplementedError: DeepSeek V4 MegaMoE currently requires expert parallel (#55914)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-13 20:22:08 -04:00 |
|
|
Tianyu Guo
|
319cc5ef19
|
[Performance][EPD] Reduce Python proxy serialization overhead (#56657)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-09-13 15:07:12 -07:00 |
|
|
|
b23433088b
|
[Attention] Remove DCP indexer interleave guard and test TP1 output parity (#55802)
Signed-off-by: Stu Cao <stucao@Stus-MacBook-Pro.local>
Signed-off-by: <>
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stu Cao <stucao@Stus-MacBook-Pro.local>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-13 13:56:28 -07:00 |
|
|
Roberto L. CastroandCodex
|
186a1e6222
|
[Warmup] Gemma 4 de-JITification (#55768)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-13 16:47:21 -04:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
586f652f8d
|
[Bugfix][PCP][DCP] Respect interleave in indexer KV gather mapping (#56715)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-13 16:45:17 -04:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
7fe8fc803d
|
[NIXL][PCP][DCP] Expose PCP producer KV shards as transfer ranks (#56645)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-13 20:23:15 +00:00 |
|
|
Woosuk KwonandOpenAI Codex
|
71888f507a
|
[Perf] Avoid redundant conversions in FP8 dummy initialization (#56688)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-13 12:06:13 -07:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
b6e2aa748b
|
[CI] Initialize warmup registry in V2 QSA runner fixture (#56707)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-13 13:34:09 -04:00 |
|
|
Kevin H. Luu
|
dec0b5d63f
|
[Bugfix] Skip Triton autotune inspection without Triton (#56676)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-09-13 17:05:29 +00:00 |
|
|
|
f09c52a587
|
[ROCm][Performance] Avoid blocking MiniMax M3 scalar upload (#56170)
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-13 16:56:02 +00:00 |
|
|
|
b7e0cdac5d
|
[Bugfix] Detect unloaded NVFP4 weight scales with a NaN sentinel (#52501)
Signed-off-by: pavelzak <pavel.zakharov@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-13 14:58:09 +00:00 |
|
|
|
82a85dc1d2
|
[Attention] Add Triton/FlashInfer composite for multimodal prefix attention (#56305)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-13 14:29:41 +00:00 |
|
|
Shenglei FuandClaude Sonnet 5
|
8cf9de9080
|
[Test][Determinism] Cover VLM batch invariance in default execution mode (#56528)
Signed-off-by: Shenglei Fu <sfu@confluent.io>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-09-13 10:22:03 -04:00 |
|
|
linitra24
|
dd4c841070
|
[LoRA] Add LoRA support for DeepSeek-V4 Flash Vision (#55897)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
|
2026-09-13 07:10:54 -07:00 |
|
|
liuzhenwei
|
de500290ff
|
[XPU][CI] fix jit_warmup_triton_launcher (#56670)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-09-13 21:44:24 +08:00 |
|
|
Taneem Ibrahim
|
2e9f7bb454
|
[Pooling] Report actual input token usage for scoring APIs (#56573)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-13 09:20:21 -04:00 |
|
|
Kebe
|
c351fd3c64
|
[Core] Fix ValueError on KV load failure with a hybrid KV cache (#50388)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2026-09-13 21:03:05 +08:00 |
|
|
Tianyu Guo
|
fa1b3b1922
|
[Bugfix][EPD] Preserve explicit multimodal UUIDs with caches disabled (#56432)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-09-13 10:08:30 +00:00 |
|