iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
14,386 Commits 3 Branches 0 Tags
fa6a6be51978bd4b49ba0da17039e60f96dc5b13
Commit Graph
100 Commits
Author SHA1 Message Date
Chengyi NieandChengyi Nie a572baff5e [Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457) 
Signed-off-by: Chengyi Nie <cnie@roblox.com>
Co-authored-by: Chengyi Nie <cnie@roblox.com>
 2026-02-27 13:51:14 +08:00
yugong333andMichael Goin 576fe50333 Adding Nemotron fp8 Triton MoE Config (#34674) 
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2026-02-24 15:56:38 -08:00
Matthias GehreandTJian 934acddef9 [Perf] fused_moe: add int4_w4a16 benchmark support and tuning config (#34130) 
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2026-02-13 00:14:27 -08:00
danisereb dea63512bb Add config file for fused MoE for Nemotron (TP4, B200) (#34411) 
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
 2026-02-12 06:09:55 -08:00
navmarri14 1ecfabe525 glm 4.6 fused tuned inference config for B200 (#32958) 2026-02-08 18:55:47 +00:00
shaharmor98 8869cd8ec1 Add MoE config for Super B200 TP2 (#33510) 2026-02-01 18:48:37 +00:00
Dimitrios BariamisDimitrios BariamisCyrus Leung
 		f0bca83ee4 Add support for Mistral Large 3 inference with Flashinfer MoE (#33174) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-01-30 22:48:27 -08:00
danisereb 8e2a469b3b Add Triton fused MoE config for B200 (Nemotron Nano) (#32804) 2026-01-29 19:21:33 +00:00
Andreas KaratzasandMatthew Wong eb1629da24 [ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-01-22 13:55:25 +08:00
Mamy Ratsimbazafy b9793e6a8c Add Fused MoE Triton kernels for GLM-4.5-Air, GLM-4.5v, GLM-4.6v on 2x RTX Pro 6000 (#31407) 
Signed-off-by: Mamy Ratsimbazafy <mamy_github@numforge.co>
 2025-12-28 08:38:33 -08:00
Jzz1943 0b6b701050 [Model] Add tuned triton fused_moe configs for Qwen3Moe on B200 (#31448) 
Signed-off-by: Zhongze Jiang <jiangzhongze.jzz@ant-intl.com>
 2025-12-28 08:38:07 -08:00
navmarri14 b8c477c115 tuned fused configs for B300 (#30629) 2025-12-18 11:41:59 -08:00
Vadim Gimpelson 717ac33d9c [PERF] Qwen3-next. Add fp8 cutlass MoE tuned configs. chmod -x *MI308X.json (#29553) 
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
 2025-12-18 13:16:04 +08:00
Julien DenizeRoger WangMickael Seznec
 		d8c6210eea Add Mistral Large 3 and Ministral 3 (#29757) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>
 2025-12-02 10:29:00 +00:00
Federico f55c76c2b3 chore: add RTX_PRO_6000 GLM4.6-FP8 kernel tuning (#29240) 2025-11-22 08:42:48 -08:00
FlintyLemming 052950e5b3 Add fused MoE config for H200 E160 N192 fp8 (#29182) 
Signed-off-by: FlintyLemming <admin@flinty.moe>
 2025-11-21 17:37:51 -08:00
Robert Shaw fe69f331f8 [Kernels] Improve H200 Fused MoE Config (#28992) 
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2025-11-19 19:23:54 +00:00
Zhewen Li 1ec978c209 [Kernel][Moe Configs] llama4 maverick fp8 moe config tp8 on mi325 (#28709) 
Signed-off-by: Zhewen Li <zhewenli@meta.com>
 2025-11-15 01:10:48 -08:00
Xiake Sunandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 03fa4d3fb3 [Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for Qwen3 omni for MI308X (#28373) 
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xisun@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-10 04:53:40 +00:00
Eric Yue 0370679ce9 [Kernel][Model] Tune fused_moe Triton configs for MiniMax-M2 on H100 (#28200) 
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
 2025-11-06 07:29:46 -08:00
tou 4ea62b77f5 [Qwen3-Next] MOE configs for A100-SXM4-80GB TP4 TP8 (#27740) 2025-11-05 09:25:09 +08:00
tomeras91 e4ee658672 [Model] add optimal triton fused moe configs for NemotronH MoE (#27967) 
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
 2025-11-04 12:59:43 +00:00
Eric Yue bdb01a38fe [Hardware][AMD][Model] Triton MoE tuning configs for GLM-4.6 for MI300X (#27323) 
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
 2025-10-27 22:58:06 -07:00
shivampr 4d0f266113 [Kernel][Model] Tune fused_moe Triton configs for Qwen3-30B A3/A3B on H100 (FP8/BF16) (#26268) 
Signed-off-by: Shivam <shivampr.dev@gmail.com>
 2025-10-20 07:48:01 -07:00
ZiTian Zhao c981f0ea78 [Perf] Add H100 fused MoE config (#25398) 
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
 2025-10-18 02:21:27 +00:00
Reima Karhila (AMD)andxaguilar c253745eb8 [Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI350 and MI355 (#25586) 
Signed-off-by: Reima Karhila <reima.karhila@amd.com>
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
Co-authored-by: xaguilar <Xavier.AguilarFruto@amd.com>
 2025-10-17 04:56:12 -07:00
felixzhu555 f96bc3649c [Qwen3-Next] Add tuned MoE config for Qwen3-Next FP8 on H100 tp2 (#26887) 
Signed-off-by: Felix Zhu <felixzhu555@gmail.com>
 2025-10-15 18:55:05 -07:00
Dhruvil Bhatt 0e65818910 Added MoE configs for llama 4, H200 device with tp=4/8 tuning (#26837) 
Signed-off-by: Dhruvil Bhatt <bhattdbh@amazon.com>
 2025-10-14 14:21:03 -07:00
Ze'ev Klapow aba48f7db1 [Kernel][MoE] Add MoE tunings for GLM 4.6-FP8 and GLM 4.5 Air on NVidia B200 (#26818) 2025-10-14 11:20:39 -07:00
Chen Zhang 29fd2662ba [deepseek] add EP8 FusedMOE config for H200 and B200 (#26331) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-10-07 10:38:54 -07:00
Asaf Joseph Gardin 35fe398c7c [Kernel][Moe Configs] Add more tuned triton configs for ExpertsInt8 and FP8 (#25858) 
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
 2025-09-30 07:30:44 -07:00
xaguilar-amd 52621c8f5c [Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI300X (#25703) 
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
 2025-09-26 01:18:20 -07:00
Chenxi YangandChenxi Yang 0d235b874a Add CUTLASS FP8 MOE benchmark scripts and kernel config (#25302) 
Signed-off-by: Chenxi Yang <cxyang@fb.com>
Co-authored-by: Chenxi Yang <cxyang@fb.com>
 2025-09-23 18:07:42 -06:00
Sara-KS ac243886b0 [Kernel] MI-300X triton moe configs (#23445) 
Signed-off-by: Sara Kokkila Schumacher <saraks@ibm.com>
 2025-09-22 14:29:54 +00:00
Saman A. PourandJee Jee Li 238c4c1705 [QWEN NEXT] Fused MoE kernels Optimization configs (#24924) 
Signed-off-by: Saman Keon <samanamp@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-09-16 13:06:03 +08:00
Elvir Crnčević 9f04d9d55f [Qwen3-Next] MoE configs for H100 TP=1,2 and TP2/EP (#24739) 
Signed-off-by: elvircrn <elvircrn@gmail.com>
 2025-09-12 07:54:04 -07:00
Jee Jee Li 12a8414d81 [Qwen3-Next] MoE configs for H20 TP=1,2,4,8 (#24707) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-09-12 10:06:26 +08:00
Chen Zhang f82f7a8990 [Qwen3-Next] MOE configs for H100 TP4 (#24699) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-09-11 15:45:52 -07:00
Vadim Gimpelson 7a70a71892 [Qwen3-Next] Add B200 MoE configs for Qwen3-next (#24698) 
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
 2025-09-11 15:34:58 -07:00
Woosuk Kwon 569bf1c9c0 [Qwen3-Next] MoE configs for H200 TP=1,2,4 (#24695) 
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
 2025-09-11 14:38:16 -07:00
Woosuk Kwon c733bd5e87 [Qwen3-Next] Add MoE Config for H200 (#24688) 
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
 2025-09-11 12:40:15 -07:00
Saman A. Pour 3d1393f6fc Kimi K2 Fused MoE kernels Optimization configs (#24597) 
Signed-off-by: Saman Keon <samanamp@outlook.com>
 2025-09-10 23:06:16 -07:00
Jee Jee Li 62f66be1f7 [Bugfix] Fix Qwen3-coder moe tuned config (#24072) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-09-07 05:19:46 +00:00
Saman A. Pour 75334956c2 QWEN3 Thinking Fused MoE kernels Optimization configs (#24330) 
Signed-off-by: Saman Keon <samanamp@outlook.com>
 2025-09-07 03:18:54 +00:00
Saman A. Pour 482e52f56c QWEN3 Coder Fused MoE kernels Optimization configs (#24266) 
Signed-off-by: Saman Keon <samanamp@outlook.com>
 2025-09-04 20:33:43 +00:00
zixuanzhang226 b1625dbe9c feat: add triton fused moe config for GLM-4.5-Air-FP8 on B200 (#23695) 
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
 2025-08-26 18:06:10 -07:00
Ming Yang 504d914314 [Perf] Add Triton config for DeepSeek V3 FP8 EP32 H200 (#23504) 
Signed-off-by: Ming Yang <minos.future@gmail.com>
 2025-08-24 18:06:35 -07:00
Chenxi YangandChenxi Yang 308fa287a8 Add glm4.5v tp2,4 fp8 config on H100_80GB (#23443) 
Co-authored-by: Chenxi Yang <cxyang@meta.com>
 2025-08-23 02:54:19 +00:00
JaceyShaoandshaojunqi c2dba2dba8 Add H20-3e fused MoE kernel tuning configs for GLM-4.5 (#22433) 
Signed-off-by: shaojunqi <shaojunqi.sjq@alibaba-inc.com>
Co-authored-by: shaojunqi <shaojunqi.sjq@alibaba-inc.com>
 2025-08-07 00:24:47 -07:00
Jee Jee Li 04ff4be310 [Misc] Add fused_moe configs for Qwen3-Coder-480B-A35B-Instruct-FP8 (#21700) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-27 20:12:18 -07:00