|
44dd18fe0b
|
[Model][Gemma4] Load Weights with AutoWeightsLoader (#55911)
Signed-off-by: Josephasafg <ajgard7@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-18 12:07:30 +00:00 |
|
|
Kevin H. LuuandKimi
|
f2b6152ec2
|
[CI] Add flaky rerun markers / timeout skips to sibling tests lacking them (#57359)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-18 03:40:32 -07:00 |
|
|
SunandCodex
|
42a33039eb
|
[Perf] Fuse CohereASR relative attention score accumulation (#55190)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-18 06:18:41 +00:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2bbdfcfcfe
|
[Perf][GLM5.3-Flash] Use cooperative top-k for small GLM decode batches (#57327)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-18 10:31:35 +08:00 |
|
|
Rohan PotdarandClaude
|
213c379fca
|
[ROCm][Bugfix] Gate AITER MXFP8 MoE on the aiter enable flag (#57426)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-18 00:06:05 +00:00 |
|
|
rasmithandAndreas Karatzas
|
d3074acdda
|
[AMD][CI][The Rock] Fix language models standard for The Rock on mi355 (#53837)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 22:13:13 +00:00 |
|
|
|
41f9104fa6
|
[DSv4.1] Integrate Mega-Gate from DeepGEMM (#56266)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-09-17 12:06:36 -07:00 |
|
|
Taneem IbrahimandHarry Mellor
|
e960ead0aa
|
[Mypy] Fix mypy typing for Transformers models (#54320)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-17 12:11:31 -04:00 |
|
|
jiangkuaixue123andCodex
|
de24e51908
|
[MM][V2] Enable encoder-only ViT CUDA graph capture (#56922)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 16:12:17 +08:00 |
|
|
leoandOpenAI Codex
|
b3079e6e46
|
[Perf][DSpark] Stack DeepSeek V4 context WKV projections (#54674)
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-17 00:04:53 -07:00 |
|
|
Woosuk Kwon
|
30b847c1fa
|
[Perf][DSV4.1] Remove MegaMoE padding and shared padding workaround (#57204)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-09-16 19:09:30 +00:00 |
|
|
Shanshan Shen
|
bc0f47cd03
|
[ROCm][Bugfix] Revert #56433 + #51692 to fix accuracy breakdown for DeepSeek-V4 (#57132)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-16 18:58:23 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
651a88c09a
|
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 10:57:24 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
8c1557a79c
|
Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 16:44:29 +00:00 |
|
|
|
dff1bde84d
|
[Model] Qwen4Exp: fp8_e4m3 main KV cache on the QSA path (#55557)
Signed-off-by: Andrea Semeraro <andrea.semeraro@sezione1.it>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-09-16 15:07:52 +00:00 |
|
|
sashko-zakharchukandzjy0516
|
f8b5c11468
|
[Bugfix][Kimi-K3] Do not classify a stateless first chunk as a decode (#51483)
Signed-off-by: Oleksandr Zakharchuk <oleksandr.zakharchuk@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-09-16 21:24:48 +08:00 |
|
|
Canlin GuoandCodex
|
03f67b3ad1
|
[Perf][DSV4.1] Pad shared experts for native MegaMoE fusion (#56568)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 17:08:42 +08:00 |
|
|
|
af1c01499b
|
[Bugfix] Make GPU sync checks safe under torch.compile (#56904)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@raft.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-15 21:37:08 -07:00 |
|
|
Abhinav VermaandClaude Opus 5
|
1e47ec00d2
|
[Bugfix][Gemma 4] Don't read fft_length when profiling unified audio (#56721)
Signed-off-by: Abhinav Verma <verma.abhinav275@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-15 14:57:32 +00:00 |
|
|
Nicolò LucchesiandJorge Gallego Feliciano
|
995e8581f4
|
[Model] Voxtral Realtime: add support for CUDAGraphMode.FULL_DECODE_ONLY (#51167)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Jorge Gallego Feliciano <jorge.gallego@mistral.ai>
|
2026-09-14 19:16:39 +00:00 |
|
|
|
b3124a8237
|
[Model] Add support for Nanbeige4.2 (transformers backend) (#56071)
Signed-off-by: zqlcode <lizongqiang@kanzhun.com>
Signed-off-by: zql <37731799+zqlcode@users.noreply.github.com>
Co-authored-by: zqlcode <lizongqiang@kanzhun.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-14 15:06:01 +00:00 |
|
|
linitra24
|
9d4d9aa5bc
|
[LoRA][Refactor] Unify multimodal LoRA token count hooks (#55071)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
|
2026-09-14 13:19:15 +00:00 |
|
|
|
3f55ad2f07
|
[Qwen3.8-Flash-Next] Fuse PLE residual and QSA output gate (#55309)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-09-14 12:16:25 +00:00 |
|
|
Bugen Zhao
|
cf1584f373
|
[Refactor] Normalize DeepSeek V4.1 model package naming (#56741)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-13 23:17:50 -07:00 |
|
|
Taneem Ibrahim
|
2e9f7bb454
|
[Pooling] Report actual input token usage for scoring APIs (#56573)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-13 09:20:21 -04:00 |
|
|
YleanandCodex
|
a987777755
|
[Bugfix][Gemma4] Keep image kwargs out of video preprocessing (#56652)
Signed-off-by: Ylean <61880605+Woolgathererer@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-13 09:07:12 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
1ee4be4dbc
|
[CI] Update DeepSeek V4.1 MegaMoE routing test (#56599)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-12 11:31:13 -07:00 |
|
|
Taneem Ibrahim
|
1b29c508bc
|
[Bugfix] Initialize data parser in Nano-Nemotron audio test (#56401)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-12 09:07:20 -04:00 |
|
|
Taneem Ibrahim
|
a0914ab7d0
|
[Nano-Nemotron] Fix Nano-Nemotron precomputed multimodal embeddings (#56398)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-12 09:07:10 -04:00 |
|
|
Wei Zhao
|
9d88ceb026
|
[KDA] Update flashKDA to support bf16 checkpoint state (#56485)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-09-11 23:53:24 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
9dd969da09
|
[Model][ROCm] Enable DeepSeek V4 Vision (#55107)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-11 09:17:30 -07:00 |
|
|
Shanshan Shen
|
127143e27f
|
Revert "[Rocm][Kimi-k3] Fix pipeline_parallel support for the kimik3 DCP mode (#53664)" (#56429)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-11 09:17:26 -07:00 |
|
|
Andreas Karatzas
|
eb7e894432
|
[ROCm][CI] Add HY-V4 generation coverage (#55667)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-09-11 17:24:28 +08:00 |
|
|
|
e77daef89e
|
[Model] Support DeepSeek-V4.1-Flash (#56214)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-11 02:11:19 -07:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
a89de950a4
|
[CI/Build] Pin HyperCLOVAX V2 test model revision (#56335)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-10 16:26:11 -07:00 |
|
|
siyuandIsotr0py
|
73fb19151f
|
[Fast Start] Support fp4 (#55465)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 13:22:17 +00:00 |
|
|
|
9b959b8657
|
[Model] DeepSeek-V4.1-Flash Model Definitions (#56228)
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-10 20:16:26 +08:00 |
|
|
Wentao Ye
|
86aca66191
|
[Kimi K3 Perf] Avoid KDA mixed-batch gather/scatter, 5.2%~7.7% E2E Throughput Improvement (#56159)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-10 17:57:01 +08:00 |
|
|
|
fe26c705f7
|
[Model] Add Bailing V3 VL support (#55921)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-10 02:46:56 -07:00 |
|
|
Jared WenandClaude Fable 5.1
|
1768273c13
|
[Perf][GLM-5.3-Flash] Decode hot-path cleanups: strided KDA recurrent inputs, NoPE MQA query without concat, no duplicate router GEMM (#55736)
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-10 16:28:33 +08:00 |
|
|
|
9521c60bdc
|
[ROCm][Perf] Kimi-K3 Fused kernels for KDA prefill reland (#54038)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: kliuae <17350011+kliuae@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-09-10 15:37:54 +08:00 |
|
|
Yunzhu LuandIsotr0py
|
442d36031c
|
[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 06:28:48 +00:00 |
|
|
Li, Jiang
|
c3ccc0e957
|
[Model] Add DeepSeek-V4 CPU backend (#55355)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-10 14:14:48 +08:00 |
|
|
Qiming Zhang
|
6e1d051fc9
|
[CI][XPU] skip test_models_text on XPU (#56038)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-09-10 11:03:09 +08:00 |
|
|
djramic
|
cce50657b7
|
[ROCm][CI] Use a platform-independent GEMM in the merged-column fuser test (#56130)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-09-09 15:08:39 -05:00 |
|
|
|
22d95d1adc
|
[Bugfix] Make mm_device_do_normalize encoder-cudagraph safe (#55370)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 01:43:22 +08:00 |
|
|
Harry MellorandClaude Opus 5
|
719284fe15
|
[Core][Model] Unify XD-RoPE into M-RoPE and derive the channel count (#56078)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-09 09:23:30 -07:00 |
|
|
|
d8d53f17c2
|
[Rocm][Kimi-k3] Add pipeline_parallel support for the kimik3 model (#53664)
Signed-off-by: haic0 <149741444+haic0@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-09 07:50:24 -07:00 |
|
|
Harry Huangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
3116c5d06b
|
[Qwen4Exp] Support UVA PLE-offload and Engram tensor parallelism (#54371)
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-09 07:32:34 -07:00 |
|
|
Thomas OrtnerandHarry Mellor
|
e509d32b5a
|
[Transformers backend] Enable QKV-Fuser for Gemma4 (#55690)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Ortner <bohnstinglthomas@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-09 14:46:31 +01:00 |
|