pmanczak
|
f7f62d1916
|
[XPU][MoE] Tune Triton fused MoE for Intel XPU (#53065)
|
2026-10-08 00:02:13 +08:00 |
|
 Canlin GuoandOpenAI Codex
|
8e1f97e709
|
[Qwen3.8-Flash-Next] Tune FP8 TP2/TP4 Triton MoE on B200 (#55890)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-08 22:45:18 +08:00 |
|
leo
|
12579c7f01
|
[Kernel][Perf] Tune H20 block-FP8 MoE low-batch configs (+21%) (#54668)
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>
|
2026-09-08 03:20:21 +00:00 |
|
Baki Burak Öğün
|
f2e2936f91
|
[Kernel] Add fused MoE tuned config for E=256,N=512 on NVIDIA A100 80GB PCIe (#55511)
Signed-off-by: Baki Burak Ogun <63836730+bakiburakogun@users.noreply.github.com>
|
2026-09-06 03:15:01 +00:00 |
|
![Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) 
|
044b05220e
|
[Kernel][Perf] Tune fused_moe FP8 config for Qwen3.5 on L40S (+7%) (#53819)
Signed-off-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: nizhang1 <nizhang1@coupang.com>
Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
2026-08-26 04:02:26 +00:00 |
|
pavelzak
|
7ea4b40954
|
[Hardware][NVIDIA] Add GB10 fused-MoE fp8 tuning configs (E=256, E=512) (#52502)
|
2026-08-16 20:04:15 -07:00 |
|
zexplorerhj
|
d4da0c55af
|
[Model][Frontend] Add Ling 3.0 Flash BF16, MTP, and parser support (#51045)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
|
2026-08-06 00:38:28 +08:00 |
|
zzt
|
413e70d52c
|
Perf/h20 moe config e256 n512 (#48825)
Signed-off-by: zzt <zengzetang.zzt@antgroup.com>
|
2026-08-03 17:47:58 -07:00 |
|
zzt
|
2595d5cebc
|
[Model] Optimize Qwen3.5 on H20 (#48350)
Signed-off-by: zzt <zengzetang.zzt@antgroup.com>
|
2026-07-13 03:30:48 +00:00 |
|
Michael Goin
|
e8e7b592d1
|
[Kernel][MoE] Tune block-FP8 fused MoE for low-batch decode (#46642)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-06-25 12:38:28 -07:00 |
|
Amanzhol Salykov
|
725c3bc808
|
[ROCm][Perf] Enable W4A16 FlyDSL MoE (#44400)
Signed-off-by: amd-asalykov <asalykov@amd.com>
Signed-off-by: Amanzhol Salykov <asalykov@amd.com>
|
2026-06-14 00:14:39 -07:00 |
|
Qiuyang Yue
|
59401ac9f1
|
[Kernel][Perf] Tune fused_moe FP8 config for Qwen3-Next-80B tp=4 on H100 (+25% at batch 96-512) (#44830)
Signed-off-by: Qiuyang Yue <yueqiuyang1389@gmail.com>
|
2026-06-09 04:15:51 -07:00 |
|
zhangxin81
|
de3da0b97c
|
Add tuned triton fused_moe configs on H100 for gpt-oss (#39904)
Signed-off-by: zhangxin81 <115389973+zhangxin81@users.noreply.github.com>
|
2026-04-28 03:38:48 -07:00 |
|
Manu
|
51cfc0e76c
|
perf(moe): add tuned fused_moe config for RTX PRO 6000 Blackwell Server Edition (#39183)
Signed-off-by: manu <fortin.emmanuel@gmail.com>
|
2026-04-10 11:32:42 -06:00 |
|
vllmellm
|
551b3fb39f
|
[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8 tp=2 and Qwen/Qwen3.5-35B-A3B-FP8 tp=2 (#38086)
Signed-off-by: big-yellow-duck <jeffaw99@hotmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
|
2026-04-02 08:13:42 +00:00 |
|
rongfu.leng
|
88149b635e
|
Add nvidia h800 moe config (#31201)
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
|
2026-03-27 16:28:48 -07:00 |
|
Wentao Ye
|
0ef7f79054
|
[Perf] Add tuned triton moe config for Qwen3.5 H200, 9.9% E2E throughput improvement (#37340)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-03-18 14:18:34 -04:00 |
|
Amanzhol Salykov
|
8a24842765
|
[ROCm] add tuned moe_wna16_triton kernel configs for CDNA4 (#35093)
Signed-off-by: salykova <amsalykov@gmail.com>
Signed-off-by: amd-asalykov <asalykov@amd.com>
|
2026-03-11 19:00:08 +00:00 |
|
tianshu-Michael-yu
|
a197eda9c3
|
Add tuned H100 MoE configs for LFM2 8B and 24B (#36699)
|
2026-03-10 21:22:02 -07:00 |
|
 Chengyi NieandChengyi Nie
|
a572baff5e
|
[Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457)
Signed-off-by: Chengyi Nie <cnie@roblox.com>
Co-authored-by: Chengyi Nie <cnie@roblox.com>
|
2026-02-27 13:51:14 +08:00 |
|
 yugong333andMichael Goin
|
576fe50333
|
Adding Nemotron fp8 Triton MoE Config (#34674)
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-02-24 15:56:38 -08:00 |
|
 Matthias GehreandTJian
|
934acddef9
|
[Perf] fused_moe: add int4_w4a16 benchmark support and tuning config (#34130)
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-02-13 00:14:27 -08:00 |
|
danisereb
|
dea63512bb
|
Add config file for fused MoE for Nemotron (TP4, B200) (#34411)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
|
2026-02-12 06:09:55 -08:00 |
|
navmarri14
|
1ecfabe525
|
glm 4.6 fused tuned inference config for B200 (#32958)
|
2026-02-08 18:55:47 +00:00 |
|
shaharmor98
|
8869cd8ec1
|
Add MoE config for Super B200 TP2 (#33510)
|
2026-02-01 18:48:37 +00:00 |
|
 
|
f0bca83ee4
|
Add support for Mistral Large 3 inference with Flashinfer MoE (#33174)
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-01-30 22:48:27 -08:00 |
|
danisereb
|
8e2a469b3b
|
Add Triton fused MoE config for B200 (Nemotron Nano) (#32804)
|
2026-01-29 19:21:33 +00:00 |
|
 Andreas KaratzasandMatthew Wong
|
eb1629da24
|
[ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-01-22 13:55:25 +08:00 |
|
Mamy Ratsimbazafy
|
b9793e6a8c
|
Add Fused MoE Triton kernels for GLM-4.5-Air, GLM-4.5v, GLM-4.6v on 2x RTX Pro 6000 (#31407)
Signed-off-by: Mamy Ratsimbazafy <mamy_github@numforge.co>
|
2025-12-28 08:38:33 -08:00 |
|
Jzz1943
|
0b6b701050
|
[Model] Add tuned triton fused_moe configs for Qwen3Moe on B200 (#31448)
Signed-off-by: Zhongze Jiang <jiangzhongze.jzz@ant-intl.com>
|
2025-12-28 08:38:07 -08:00 |
|
navmarri14
|
b8c477c115
|
tuned fused configs for B300 (#30629)
|
2025-12-18 11:41:59 -08:00 |
|
Vadim Gimpelson
|
717ac33d9c
|
[PERF] Qwen3-next. Add fp8 cutlass MoE tuned configs. chmod -x *MI308X.json (#29553)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
|
2025-12-18 13:16:04 +08:00 |
|
 
|
d8c6210eea
|
Add Mistral Large 3 and Ministral 3 (#29757)
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>
|
2025-12-02 10:29:00 +00:00 |
|
Federico
|
f55c76c2b3
|
chore: add RTX_PRO_6000 GLM4.6-FP8 kernel tuning (#29240)
|
2025-11-22 08:42:48 -08:00 |
|
FlintyLemming
|
052950e5b3
|
Add fused MoE config for H200 E160 N192 fp8 (#29182)
Signed-off-by: FlintyLemming <admin@flinty.moe>
|
2025-11-21 17:37:51 -08:00 |
|
Robert Shaw
|
fe69f331f8
|
[Kernels] Improve H200 Fused MoE Config (#28992)
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2025-11-19 19:23:54 +00:00 |
|
Zhewen Li
|
1ec978c209
|
[Kernel][Moe Configs] llama4 maverick fp8 moe config tp8 on mi325 (#28709)
Signed-off-by: Zhewen Li <zhewenli@meta.com>
|
2025-11-15 01:10:48 -08:00 |
|
![gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) Xiake Sunandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
03fa4d3fb3
|
[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for Qwen3 omni for MI308X (#28373)
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xisun@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-11-10 04:53:40 +00:00 |
|
Eric Yue
|
0370679ce9
|
[Kernel][Model] Tune fused_moe Triton configs for MiniMax-M2 on H100 (#28200)
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
|
2025-11-06 07:29:46 -08:00 |
|
tou
|
4ea62b77f5
|
[Qwen3-Next] MOE configs for A100-SXM4-80GB TP4 TP8 (#27740)
|
2025-11-05 09:25:09 +08:00 |
|
tomeras91
|
e4ee658672
|
[Model] add optimal triton fused moe configs for NemotronH MoE (#27967)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
|
2025-11-04 12:59:43 +00:00 |
|
Eric Yue
|
bdb01a38fe
|
[Hardware][AMD][Model] Triton MoE tuning configs for GLM-4.6 for MI300X (#27323)
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
|
2025-10-27 22:58:06 -07:00 |
|
shivampr
|
4d0f266113
|
[Kernel][Model] Tune fused_moe Triton configs for Qwen3-30B A3/A3B on H100 (FP8/BF16) (#26268)
Signed-off-by: Shivam <shivampr.dev@gmail.com>
|
2025-10-20 07:48:01 -07:00 |
|
ZiTian Zhao
|
c981f0ea78
|
[Perf] Add H100 fused MoE config (#25398)
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
|
2025-10-18 02:21:27 +00:00 |
|
 Reima Karhila (AMD)andxaguilar
|
c253745eb8
|
[Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI350 and MI355 (#25586)
Signed-off-by: Reima Karhila <reima.karhila@amd.com>
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
Co-authored-by: xaguilar <Xavier.AguilarFruto@amd.com>
|
2025-10-17 04:56:12 -07:00 |
|
felixzhu555
|
f96bc3649c
|
[Qwen3-Next] Add tuned MoE config for Qwen3-Next FP8 on H100 tp2 (#26887)
Signed-off-by: Felix Zhu <felixzhu555@gmail.com>
|
2025-10-15 18:55:05 -07:00 |
|
Dhruvil Bhatt
|
0e65818910
|
Added MoE configs for llama 4, H200 device with tp=4/8 tuning (#26837)
Signed-off-by: Dhruvil Bhatt <bhattdbh@amazon.com>
|
2025-10-14 14:21:03 -07:00 |
|
Ze'ev Klapow
|
aba48f7db1
|
[Kernel][MoE] Add MoE tunings for GLM 4.6-FP8 and GLM 4.5 Air on NVidia B200 (#26818)
|
2025-10-14 11:20:39 -07:00 |
|
Chen Zhang
|
29fd2662ba
|
[deepseek] add EP8 FusedMOE config for H200 and B200 (#26331)
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
|
2025-10-07 10:38:54 -07:00 |
|
Asaf Joseph Gardin
|
35fe398c7c
|
[Kernel][Moe Configs] Add more tuned triton configs for ExpertsInt8 and FP8 (#25858)
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
|
2025-09-30 07:30:44 -07:00 |
|