 Tae Jeong
|
62890e204c
|
Fix duplicated logging when loading a corrupt or partial video (#46467)
Signed-off-by: hhhhhhhhhhhhhhhhho <man2719@naver.com>
|
2026-06-24 06:14:13 -07:00 |
|
|
Nicolò Lucchesi
|
a2cb08b3d5
|
[Misc][PD] Disable bidirectional xfer mode for NixlPushConnector (#46473)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-06-24 21:14:05 +08:00 |
|
|
Rui YinandOr Ozeri
|
cf9fd6457e
|
Fix KV offload request-finished lifecycle contract (#46284)
Signed-off-by: test test <2260891073@qq.com>
Signed-off-by: Rui Yin <2260891073@qq.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-06-24 15:42:40 +03:00 |
|
|
Kunshang Ji
|
d4448b511d
|
[XPU][Docker] switch to ubuntu 24.04 as base image (#45973)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-24 20:39:20 +08:00 |
|
|
Ting SUNandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f1a6703edd
|
[Bugfix][Config] Keep pydantic validation for fields with a TYPE_CHECKING Literal alias (#46220)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 12:25:50 +00:00 |
|
|
Roy Wang
|
160c80a34c
|
[Rust Frontend] Raise frontend JSON body limit (#46582)
Signed-off-by: esmeetu <jasonailu87@gmail.com>
|
2026-06-24 12:15:31 +00:00 |
|
|
Martin Hickey
|
f237e16b41
|
[KV Offload] Replace OffloadingHandler with OffloadingWorker (#45053)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-06-24 14:44:24 +03:00 |
|
|
JartXandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
70749fdcca
|
[Feature] Triton INT4 per-token-head KV cache quantization (#40835)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 10:21:25 +00:00 |
|
|
Wei ZhaoandYifan Qiao
|
d20dbf921b
|
[Mooncake] Only check and store new KV cache range (#46412)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-06-24 03:10:50 -07:00 |
|
|
Xinyu ChenandKunshang Ji
|
ede54b926e
|
set AttentionCGSupport.UNIFORM_BATCH for fa2 on xpu (#46555)
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-24 18:05:02 +08:00 |
|
|
LynnandClaude Opus 4.8
|
52fbe12283
|
[Perf][Multimodal] Avoid building a full timestamps list in video frame sampling (#46543)
Signed-off-by: Lynn <lynnhe02@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-24 09:38:27 +00:00 |
|
|
Dakai An
|
dc0d318177
|
[Attention] Add FLASH_ATTN_MLA_SPARSE backend for Hopper sparse MLA (#46189)
Signed-off-by: Dakai An <dakaian108@gmail.com>
|
2026-06-24 09:33:10 +00:00 |
|
|
soaringk
|
d7c1821b5a
|
[Model][MiniMax-M3] Add pipeline parallelism support (#45810)
Signed-off-by: soaringk <k3vin.zhang@gmail.com>
|
2026-06-24 08:23:03 +00:00 |
|
|
Tiezhen WANGandClaude
|
4cd1a84c88
|
[Model] Remove BaiChuanForCausalLM and BaichuanForCausalLM (#46362)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-24 16:13:57 +08:00 |
|
|
Mohammad Miadh Angkad
|
191826ec61
|
[CI/Build] Fix topk histogram build on SM75 (#46550)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-24 00:51:11 -07:00 |
|
|
Andreas Karatzas
|
549c7074cd
|
[ROCm][CI] Skip the MoE Marlin tile-padding helper assertion (#46580)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-24 07:31:33 +00:00 |
|
|
|
489abadfb8
|
feat: support to OpenMOSS-Team (#44124)
Signed-off-by: nagisa-kun <1434936049@qq.com>
Signed-off-by: nagisa19 <1434936049@qq.com>
Signed-off-by: nagisa <1434936049@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 00:08:13 -07:00 |
|
|
Woosuk Kwon
|
96de8bb389
|
[MoE] Free unused MXFP4 scales in OAI Triton Backend (#46549)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-24 00:06:41 -07:00 |
|
|
Jee Jee Li
|
9d6fdc2901
|
[Kernel] GLM5 Router GEMM (#46385)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-06-23 22:54:50 -07:00 |
|
|
Benjamin Chislett
|
4c5bc41ba6
|
[Bugfix][Spec Decode] Fix probabilistic sampling for parallel drafting (#45956)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-06-24 05:36:23 +00:00 |
|
|
Michał Ganczarenko
|
ac1fa74616
|
[Bugfix] Fix NemotronLayerNorm1P hardcoded cuda device type (#46495)
Signed-off-by: <Michal Ganczarenko> <michal.ganczarenko@intel.com>
|
2026-06-24 13:21:02 +08:00 |
|
|
Sting Lin
|
556bc4e3a0
|
Upgrade tpu-inference to v0.23.0 (#46568)
|
2026-06-23 21:15:14 -07:00 |
|
|
Wei Zhao
|
05a0caba91
|
[Mooncake] Optimize lookup pool key string construction (#46188)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-06-24 11:51:53 +08:00 |
|
|
Nick Hill
|
7ee4d22009
|
[Spec Decode] Reject placeholder (-1) draft tokens in rejection sampler (#46533)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-06-24 03:32:32 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ce9f64020b
|
[Rust Frontend] Pass effective reasoning_parser_kwargs for structured output (#46360)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-24 03:13:44 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
4ed8eaafb0
|
[Rust Frontend] Integrate xgrammar-structural-tag for strict and required tool calling (#46057)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-24 10:46:49 +08:00 |
|
|
Nick Hillandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
6af0559ddb
|
[Core][DP] Throttle prefills based on local prefill work (#46532)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 02:27:12 +00:00 |
|
|
Micah Williamsonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e2bdc24612
|
[ROCm][Bugfix] Fix use_v2_model_runner inside Ray driver thread (#45998)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 08:41:56 +08:00 |
|
|
Andreas Karatzas
|
bcbeaac786
|
[ROCm][CI] Stage C-II of gating additional test groups (#46537)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-23 17:36:40 -07:00 |
|
|
Maxwill Lin
|
e48f2aa4ca
|
[Bugfix][Frontend] Emit a content block for empty Anthropic completions (#46525)
Signed-off-by: EazyReal <8047065+EazyReal@users.noreply.github.com>
|
2026-06-24 00:04:26 +00:00 |
|
|
Roberto L. Castro
|
d86c66c981
|
[Feat] Add runtime monitor for post-warmup CuTeDSL compilation (#46167)
|
2026-06-23 23:33:17 +00:00 |
|
|
Nico Holmberg
|
80e511772f
|
[ROCm][Bugfix][Perf] enable shared expert fusion for Qwen3.5 (#44434)
Signed-off-by: Nico Holmberg <nico.holmberg@amd.com>
|
2026-06-23 23:19:51 +00:00 |
|
|
Roberto L. Castro
|
855cd4d787
|
[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
|
2026-06-23 16:11:00 -07:00 |
|
|
Guy StoneandClaude
|
3cc871aaf1
|
[Perf] Skip detokenization in online beam search (#46422)
Signed-off-by: Guy Stone <guys@spotify.com>
Signed-off-by: Guy Stone <guystone3@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-23 15:46:09 -07:00 |
|
|
Woosuk Kwonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
0a3e2dbc09
|
[Optimization] Skip DP padding tokens in MoE (#46428)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-23 14:54:46 -07:00 |
|
|
fxmarty-amdandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
84f13374b3
|
[CI] Fix test_auto_gptq on ROCm CI (#46164)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-23 16:38:06 -05:00 |
|
|
Micah Williamson
|
b28103e1ca
|
[ROCm][CI] Shard LM Eval Qwen3-5 Models (B200-MI355) in AMD CI (#46520)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-23 16:32:05 -05:00 |
|
|
Wentao Ye
|
abc33134fa
|
[CI Test] Mark batch invariance test flaky (#46530)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-06-23 21:01:34 +00:00 |
|
|
Maxwill LinandEazyReal
|
6617db1bfb
|
[Bugfix][Frontend] Emit non-ASCII tool-call arguments without \uXXXX escapes (#46308)
Signed-off-by: EazyReal <8047065+EazyReal@users.noreply.github.com>
Co-authored-by: EazyReal <8047065+EazyReal@users.noreply.github.com>
|
2026-06-23 20:43:11 +00:00 |
|
|
Ting SUNandFlora Feng
|
899d72a58c
|
[Bugfix][ToolParser] Handle braces in required tool streaming strings (#45389)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-06-23 20:29:34 +00:00 |
|
|
Yongye Zhu
|
11b56b2ff2
|
[Kernel] Add FlashInferCutedslMxfp8LinearKernel (cute-dsl mm_mxfp8) (#46393)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-06-23 12:45:49 -07:00 |
|
|
|
0d4d164488
|
[Bugfix] Allow flashinfer_cutlass as a clamped NVFP4 MoE backend (#46492)
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-06-23 12:43:36 -07:00 |
|
|
Mike G
|
0775b882ba
|
[NVFP4 MoE/Deepseek V4] Marlin: wire SwiGLU clamp + allow it for clamped models on non-Blackwell (#45836)
Signed-off-by: Mike G <180722391+mikekg@users.noreply.github.com>
|
2026-06-23 12:21:19 -07:00 |
|
|
Michael GoinandClaude
|
7c2e08451a
|
[Docker] Remove redundant flashinfer download-cubin step (#46517)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-23 12:16:51 -07:00 |
|
|
Giancarlo Delfin
|
ef361de916
|
[Model Runer V2][DFlash] Fix lm head sharing for dflash (#46435)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-06-23 19:09:06 +00:00 |
|
|
Yan Ma
|
acce57d8dd
|
Deprecate old FP8 online MoE quantization class (#44514)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-06-23 11:53:38 -07:00 |
|
|
|
68afd78897
|
[Bugfix][ROCm] Fix cumem sleep and teardown (#46203)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-24 02:45:31 +08:00 |
|
|
Michael GoinandClaude
|
37a682d392
|
[Kernel] Extend Marlin thread-tile padding to MoE (WNA16 + FP8/MXFP8) (#45703)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-23 11:45:10 -07:00 |
|
|
Rui Yin
|
d8e422ccda
|
[Bugfix] Parse MiniMax M3 streaming reasoning by text markers (#45718)
Signed-off-by: test test <2260891073@qq.com>
|
2026-06-23 14:43:58 -04:00 |
|
|
fxmarty-amd
|
e368415daa
|
[AMD][OCP MX][CI] Fix tests to not dispatch on UNFUSED_TRITON backend on MI300, improve w_mxfp4_a_fp8 emulation support (#46142)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-06-23 14:25:27 -04:00 |
|