 liuzhenwei
|
2a0323b4e0
|
[XPU][Test] Support MultiConnector accuracy testing on XPU (#51160)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-08-06 13:49:48 +08:00 |
|
|
Qiuyang Yue
|
777b01d1a8
|
[MM][CG] Support ViT full CUDA graph for Ernie-4.5-VL image inference (#45254)
Signed-off-by: Qiuyang Yue <yueqiuyang1389@gmail.com>
|
2026-08-06 05:04:19 +00:00 |
|
|
Li JuqiandCyrus Leung
|
821717118f
|
[BugFix][Pooling] Skip weight-prefix probe when model has WeightsMapper (#50890)
Signed-off-by: Juqi Li <2223621784@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-05 21:12:33 -07:00 |
|
|
Yunzhu LuandCyrus Leung
|
f84df12c6a
|
[Bugfix][MM] Fix MiniCPM-V placeholder replacement and image processor loading on Transformers v5 (#48413)
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Signed-off-by: Yunzhu Lu <lucia.yunzhu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-05 21:12:00 -07:00 |
|
|
Giancarlo Delfin
|
81bc196913
|
[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-08-05 19:12:46 -07:00 |
|
|
Aarushi Jain
|
71f975af43
|
[ROCm][CI] Add MLA decode accuracy and determinism tests (#50480)
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com>
|
2026-08-05 20:35:56 -05:00 |
|
|
|
b50fdebce0
|
[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)
Signed-off-by: Silen Naihin <silen.naihin@gmail.com>
Co-authored-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-08-06 09:13:10 +08:00 |
|
|
aoshen02andAndy Lo
|
8cfa01cdd2
|
[BugFix] Dense multinode DP rescope with regression test (#49212)
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Andy Lo <andy@mistral.ai>
|
2026-08-05 18:12:03 -07:00 |
|
|
gabriel-peracioandKimi K3
|
47a4e410ba
|
[Bugfix][Spec Decode] Fix NaN handling in rejection sampler tl.argmax (#50183)
Signed-off-by: Gabriel Peracio <gabriel@sigsonic.com>
Co-authored-by: Kimi K3 <noreply@moonshot.ai>
|
2026-08-05 18:01:09 -07:00 |
|
|
LZWandRoger Wang
|
d36f24b66a
|
[KV Connector][Mooncake] Add tenant ID support to MooncakeStoreConnector (#48069)
Signed-off-by: lzw <2994587066@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-05 17:31:18 -07:00 |
|
|
|
7c77868cdf
|
[Bugfix] Size and iterate w13 by shard count for non-gated MoE (#51125)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Matej Sirovatka <matej.sirovatka@gmail.com>
Co-authored-by: Rishi Puri <riship@nvidia.com>
Co-authored-by: Hsiao-Yuan Chen <littlecircle0730@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 17:24:47 -07:00 |
|
|
Tianyu Guo
|
b30291cf0c
|
[EPD] Remove duplicate image preprocessing in EPD and enable preprocess on GPU (#50390)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-05 15:59:54 -07:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
38ebd97bca
|
[ROCm] Relax MLA rope+cache test tolerances for bf16 (#51083)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-05 17:50:52 -05:00 |
|
|
bnellnm
|
373fe8b83e
|
[MoE Refactor] Remove MoE legacy code (#51078)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-08-05 14:35:36 -07:00 |
|
|
Micah WilliamsonandAndreas Karatzas
|
4282fe52d5
|
[ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-05 21:27:33 +00:00 |
|
|
Netanel Haber
|
482c613423
|
[Bugfix][Humming] Preserve ModelOpt FP8 weight dimensions (#51093)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2026-08-05 14:08:55 -07:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
65addac701
|
[ROCm][CI] Keep rocprofiler-sdk out of DeepEP HT MoE test workers (#51173)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-05 15:28:41 -05:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
c2d8009044
|
[ROCm] Work around DeepEP teardown SIGSEGV in MoE test harness (#51174)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-05 14:44:42 -05:00 |
|
|
Michael Goin
|
e6d67fddb4
|
[CI] Prune PyTorch Fullgraph Test (#51074)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-05 12:27:27 -07:00 |
|
|
Michael GoinandOpenAI Codex
|
8f158d0ee2
|
[MoE] Share apply_moe_activation support metadata (#44359)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-05 12:05:47 -07:00 |
|
|
Wentao Ye
|
613411a90c
|
[CI Bug] Fix Chunked prefill is required for mamba cache mode 'align'. (#51177)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-05 11:33:45 -07:00 |
|
|
|
9833aa53d5
|
[Bugfix] Fail fast with a clear error when CPU offload region exceeds available space (#50358)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-08-05 20:59:55 +03:00 |
|
|
Ronen SchafferandOr Ozeri
|
8543522ca7
|
[KV Offload] Support out-of-tree secondary tier managers via module_path (#51007)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-08-05 20:30:53 +03:00 |
|
|
zexplorerhj
|
d4da0c55af
|
[Model][Frontend] Add Ling 3.0 Flash BF16, MTP, and parser support (#51045)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
|
2026-08-06 00:38:28 +08:00 |
|
|
|
66b3c0e61f
|
[Kernel][Model] Optimize FA4 mm_prefix range lookup (#50294)
Signed-off-by: Juqi Li <2223621784@qq.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-05 07:33:49 -07:00 |
|
|
ChaunceyandOr Ozeri
|
62c5e21621
|
[KV Offloading] Support partial-tail prefix reuse with fine-grained prefix matching (#50507)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-08-05 22:31:50 +08:00 |
|
|
Gabriel WuandPavani Majety
|
08b8613b7b
|
[Bugfix][Model] Fix MiniMax-M3 NVFP4 inference correctness (#48929)
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>
|
2026-08-05 07:25:46 -07:00 |
|
|
music-dino
|
a9b39d6dcb
|
[Bugfix] Enable chunked prefill for qwen3.5-0.8B ppl test (#51153)
Signed-off-by: Dino Music <Dino.Music@amd.com>
|
2026-08-05 13:21:43 +00:00 |
|
|
|
fd859d2e06
|
[KV Connector][Mooncake] Add store group semantics (#44956)
Signed-off-by: Schatten <czhengt@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-05 08:25:38 +00:00 |
|
|
MINJUN GIL
|
b92352ca2c
|
[Perf][KV Offload] Avoid quadratic ARC batch eviction (#50992)
Signed-off-by: MINJUN GIL <alswnsrlf12@naver.com>
|
2026-08-05 10:58:36 +03:00 |
|
|
Tianyu Guo
|
50c51682a1
|
[Bugfix][EC Connector] Don't stop an encoder-instance request before its images are encoded (#50275)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-05 05:53:58 +00:00 |
|
|
TrainToGPBandClaude
|
eb3dce9757
|
[Bugfix][Model] Gemma3n/Gemma4: pad variable-length audio batches (#50958)
Signed-off-by: TrainToGPB <kaiba0514@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-05 12:46:00 +08:00 |
|
|
|
c25093a305
|
[Kernel] Batch invariant NVFP4 MoE using cutlass (#40372)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-05 04:31:32 +00:00 |
|
|
|
41a7e7da0c
|
[KV Offload] Support partial secondary-tier load results (#50321)
Signed-off-by: Moein Khazraee <moein@nvidia.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-08-04 20:48:58 -07:00 |
|
|
aoshen02andyihengz
|
6153dbe036
|
[R3] Unify routed expert shape configuration (#50940)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: yihengz <yihengz@nvidia.com>
|
2026-08-04 20:20:41 -07:00 |
|
|
Divakar Verma
|
bb543efdfd
|
[ROCm][CI] Add aiter per-token FP8 quant roundtrip and RMSNorm determinism tests (#50905)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-08-04 21:32:08 -05:00 |
|
|
Michael Goin
|
9cd9f8c20b
|
Prune redundant tests points in correctness_e2e/[test_sequence_parallel,test_async_tp] (#51068)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-04 19:18:50 -07:00 |
|
|
Michael Goin
|
d16e7f9da4
|
[CI] Prune PyTorch Compilation Unit Tests (#51069)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-05 09:53:50 +08:00 |
|
|
Nick Hill
|
77b519912b
|
[CI][Bugfix] Fix test_shutdown_on_engine_failure startup deadlock (#51050)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-04 20:29:35 -05:00 |
|
|
Yifan Qiaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ffee32460d
|
[BugFix][Mooncake] Use global data_parallel_index for the DP engine index (#48061)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 17:10:51 -07:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
12292d94b2
|
[CI] Detect and fail evals on when NaNs appear in logits (#50323)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 23:02:58 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
a5149b2fee
|
[CI] Stabilize GLM-5.2 PCP evaluation (#51015)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 14:13:59 -07:00 |
|
|
NVShreyasandOpenAI Codex
|
8ae8337ffa
|
[Spec Decode] Enable fused non-causal TokenSpeed MLA for DSpark (#50911)
Signed-off-by: Shreyas Misra <shreyasm@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 18:05:40 +00:00 |
|
|
Wentao Ye
|
d31de3c421
|
[Kimi K3 Perf] option to shard the shared expert for non mega case, 16.98 GiB memory/GPU saved (#50912)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-04 14:00:44 -04:00 |
|
|
Nick HillandClaude
|
7635a9002b
|
[Core] Explicitly manage torch CPU threads in workers (#49919)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-04 10:06:38 -07:00 |
|
|
amitz-nvandOpenAI Codex
|
52c0e3cb08
|
[Kernel] Add support for Flashinfer Mamba SSU algorithm selection (#50157)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 09:40:23 -07:00 |
|
|
|
7ac2ec7582
|
[Kimi-K3][AMD] Fuse AttnRes state updates and norms (#50593)
Signed-off-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 12:32:13 -04:00 |
|
|
aoshen02andaoshen02
|
7153fd70f6
|
[Bugfix][MoE] Filter packed expert weights during EP loading (#49558)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-08-04 16:32:03 +00:00 |
|
|
|
166f4e2dc3
|
fix: fuse weightless RMSNorms at their declared width (#50867)
Signed-off-by: Anuj Bolewar <anujbolewar@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Anuj Bolewar <anujbolewar@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-04 16:03:09 +00:00 |
|
|
Bugen Zhao
|
7743486190
|
[Frontend] DeepSeek V4 0731 reasoning effort prompts & mappings (#50580)
|
2026-08-04 08:51:32 -07:00 |
|