 liuzhenwei
|
bd6536071c
|
[XPU][Test] Pin block size in test_multi_connector (#51213)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-08-10 21:57:45 +08:00 |
|
|
pmanczak
|
ec21f61d82
|
[Misc] Enable test_fused_moe_wn16 on XPU (#51672)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-08-10 21:57:02 +08:00 |
|
|
Taneem IbrahimandWentao Ye
|
ea3115e30b
|
[CI] Stabilize DP supervisor lifecycle tests (#51557)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-10 09:13:52 -04:00 |
|
|
Lucas Wilkinson
|
789c4f905e
|
[CI] Bump CUTLASS DSL to 4.6.2 (#51566)
|
2026-08-10 09:06:08 -04:00 |
|
|
Harry Mellor
|
cf8f3a3bb2
|
[2/N] Harden Transformers modelling backend multi-modal path (#51657)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 12:57:12 +00:00 |
|
|
vllmellmandtjtanaa
|
436be94e13
|
[ROCm][Bugfix] Use TCP store when AITER custom all-reduce is enabled (#51635)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-08-10 11:07:14 +00:00 |
|
|
Raj Vijay FirkeandHarry Mellor
|
3dafaef027
|
[Bugfix][Core] Emit --no-{key} for false BooleanOptionalAction flags in YAML config (#51573)
Signed-off-by: Raj Firke <79653531+rajfirke@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 11:05:15 +00:00 |
|
|
efschu
|
900d09f91a
|
[Bugfix][Model] Fix Qwen3.5 MTP for text-only checkpoints (#50734)
Signed-off-by: efschu <51944948+efschu@users.noreply.github.com>
|
2026-08-10 11:04:53 +00:00 |
|
|
Emmanuel Acheampong
|
3a79957b62
|
[Doc] Add Crusoe Managed Inference deployment guide (#49353)
Signed-off-by: Emmanuel Acheampong <achampion.emma@gmail.com>
|
2026-08-10 11:31:34 +01:00 |
|
|
xiangdong
|
51562de5ab
|
[CI][XPU] Add VLLM_DISABLE_COMPILE_CACHE=1 for other random failed cases in Intel GPU CI (#51604)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-08-10 17:32:16 +08:00 |
|
|
|
243c63baf5
|
[V1][Scheduler] Apply Mamba alignment before encoder caps (#51603)
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Akshat Anand <40275336+cipheraxat@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-10 16:37:17 +08:00 |
|
|
Kunshang Ji
|
d89ba6481b
|
[XPU] bump up xpu kernel to v0.1.12.3 (#50441)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-10 16:09:23 +08:00 |
|
|
|
74c94b9f29
|
[CI] Upgrade huggingface-hub to 1.27.0 (#51422)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 08:59:15 +01:00 |
|
|
Harry Mellor
|
70b84f0bcb
|
Fix Gemma 4 for upcoming Transformers version (#49797)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 07:48:26 +00:00 |
|
|
Itay EtelisandItay Etelis
|
81840a172f
|
[KV Connector] Canonical CPU layout for parallelism-agnostic KV offload (#48414)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
|
2026-08-10 10:44:54 +03:00 |
|
|
Andreas KaratzasandMicah Williamson
|
31cd109f18
|
[ROCm][CI] Extend ROCm AITER MHA (FA) coverage (#40958)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
|
2026-08-10 15:35:13 +08:00 |
|
|
Zetian Li - ikunandClaude
|
7303c66f68
|
[Bugfix] Fix lfm2 tool parser dropping calls with brackets or newline… (#48171)
Signed-off-by: Zetian Li <804561096@qq.com>
Co-authored-by: Claude (Anthropic) <noreply@anthropic.com>
|
2026-08-10 15:10:06 +08:00 |
|
|
|
61c1dd0966
|
[EC Connector] Call to EC Connector update_connector_output from scheduler (#49579)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Signed-off-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-10 14:25:57 +08:00 |
|
|
|
ba1cdcfcf0
|
[Model][Quantization] Add Ling-3.0-flash-fp8 support (#51265)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-09 23:09:08 -07:00 |
|
|
Isotr0py
|
3b4c86e489
|
[Bugfix][Quantization] Fix fp32 weight scale for mxfp4 quantization and per-expert checkpoint mapping (#51419)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-09 23:08:52 -07:00 |
|
|
Rehan KhanandLi, Jiang <jiang1.li@intel.com>
|
b22afe45ac
|
[CPU] Enable GPTQ and AWQ quantization for s390x (#51148)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-10 11:41:43 +08:00 |
|
|
Li, Jiang
|
7ce84b99ce
|
[CPU] Restore linear dispatch for small unquantized GEMMs (#51379)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-08-10 11:29:59 +08:00 |
|
|
Srinivas Krovvidiandsrinivas_oo7
|
a123159f7a
|
Add tiering offloading metrics (#48798)
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
|
2026-08-10 05:23:14 +03:00 |
|
|
|
11ba93f364
|
[BugFix] Use file:// rendezvous for single-node executors to eliminate startup port races (#50999)
Signed-off-by: Parsa Mazaheri <p_mazaheri@apple.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Parsa Mazaheri <p_mazaheri@apple.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-09 22:00:04 -04:00 |
|
|
Jason
|
0820125ae9
|
[Bugfix][Parser] Emit REASONING_END for Inkling tool calls that follow no thinking block (#50528)
Signed-off-by: Jason Yao <wsyjh8@gmail.com>
|
2026-08-09 21:04:53 -04:00 |
|
|
Lena OnyshchenkoandKunshang Ji
|
751f2ccdd3
|
[Kernel][XPU] Tensor-descriptor operand loads for Triton W8A8 scaled_mm (#47205)
Signed-off-by: oonyshch <xonyshch@gmail.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-10 00:56:11 +00:00 |
|
|
Yifan QiaoandOpenAI Codex
|
d6941300fc
|
[BugFix] Scope divergent hybrid cache hits to capable connectors (#50344)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-09 15:38:13 -07:00 |
|
|
Harry Mellor
|
83ad767eed
|
[CI] fix docs on main (#51539)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-09 09:46:12 +00:00 |
|
|
Jeff (Junze) Ma
|
04d13b5d65
|
[K3] Allow tpu to import kimi_k3.common (#51529)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
|
2026-08-09 17:06:34 +08:00 |
|
|
ChaunceyandOr Ozeri
|
c423998642
|
[KV Offload] Emit self-describing events for partial recurrent blocks (#51243)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-08-09 11:28:44 +03:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
7f6432cc0d
|
[ROCm][CI] Reuse equivalent ROCm CI images (#48646)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-09 01:25:03 -07:00 |
|
|
|
f18e10a7e1
|
Bump Flashinfer version to 0.6.16.post3 (#50892)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-08-09 00:54:07 -07:00 |
|
|
|
eb24bc38cf
|
[Bugfix][KV Offload] Handle chunked local attention in offloading scheduler (#51161)
Signed-off-by: almogtavor <almogtavor@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-09 10:25:57 +03:00 |
|
|
Robbie J
|
1b0ce31f32
|
[KV Offload] Fix failed-load livelock by marking the lookup verdict as a miss (#49328)
Signed-off-by: Robbie J <RobbieJ@users.noreply.github.com>
|
2026-08-09 10:25:36 +03:00 |
|
|
Jane (Yuan) XuandShengqi Chen
|
f8d03e7741
|
[Bugfix][Build] Patch stable string memleak fix from 2.14 for 2.13 (#51185)
Signed-off-by: Jane Xu <janeyx@meta.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-08-08 21:12:39 -07:00 |
|
|
Isotr0py
|
073c510c91
|
[Migration] Migrate bitsandbytes support to OOT plugin (#43529)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-09 10:27:31 +08:00 |
|
|
|
dedbf6be8b
|
[V1][Metrics] Preserve prefix-cache stats on zero-output steps (#48668)
Signed-off-by: Rishi Puri <riship@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-09 01:58:38 +00:00 |
|
|
|
cb1a52aee3
|
[Build] Upgrade runtime image to Ubuntu 24.04, pick up rdma-core > 44 (#51058)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-08-08 18:17:50 -07:00 |
|
|
Aarushi JainandAarushi Jain
|
7581c56c86
|
[Test] Add ROCm AITER FP8 MLA prefill accuracy test (#51457)
Signed-off-by: Aarushi Jain <aarushi@amd.com>
Co-authored-by: Aarushi Jain <aarushi@amd.com>
|
2026-08-08 19:42:26 -05:00 |
|
|
Nick Hill
|
fbff187d59
|
[Core] Make the GPU sync check thread-local and fix its suppressors (#51455)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-08 17:13:40 -07:00 |
|
|
Nick Hill
|
9b0afeb4f6
|
[Perf] Avoid some more unnecessary GPU<->CPU syncs (#51458)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-08 17:13:26 -07:00 |
|
|
|
d608dfabfd
|
[Bugfix][MRV2] Reserve spec-decode lookahead blocks in V2 warmup (#51438)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
|
2026-08-08 23:58:43 +00:00 |
|
|
Nick HillandClaude Opus 5
|
9e6be4a72b
|
[Perf][Sparse MLA] Drop the atomic contention in the index remap (#50365)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 16:32:40 -07:00 |
|
|
Vegetog
|
1c1077c6cc
|
[Bugfix][Parser] Confirm reasoning end when an Inkling content block opens (#49876)
Signed-off-by: Vegetog <110553275+Vegetog@users.noreply.github.com>
|
2026-08-08 18:07:39 -04:00 |
|
|
|
75231eff2f
|
[Bugfix][Parser] Prevent Inkling block-end leakage with tools (#51391)
Signed-off-by: cherry77-cloud <1615405@qq.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-08 12:34:32 -04:00 |
|
|
|
58d3918e3e
|
[BugFix] Preserve divergent FA hits with external Mamba state (#51468)
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-08 20:20:16 +08:00 |
|
|
ylsunandClaude Opus 5
|
0fe9a916e8
|
[Bugfix] Fix LFM2 ShortConv prefix breaking quant ignore list (#51495)
Signed-off-by: ylsun <1654366371@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 11:27:13 +00:00 |
|
|
Tianyu Guo
|
653ebb52df
|
Add torch compile for qwen3_vl encoder (#40116)
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-08 08:23:18 +00:00 |
|
|
Andreas Karatzas
|
643c125fab
|
[ROCm][CI] Baseline legacy extensions in the Torch ABI audit (#50805)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-08 01:01:04 -05:00 |
|
|
Andreas Karatzas
|
6e18901195
|
[Bugfix][MM] Avoid device sync in FusedInputNorm initialization (#51435)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-08 13:32:23 +08:00 |
|