iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
81 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yongye ZhuClaude Opus 5.5Kevin H. Luu
 		4d58fa254a [MoE] Unify DeepGEMM MegaMoE experts behind one feature-matrix layer; add NVFP4 (#61538) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-10-15 19:02:01 +00:00
Yongye ZhuandClaude Opus 5.5 a6009ea85b [Kernel][Build] Bump DeepGEMM to the 26/09/30 release and adapt the sparse indexer (#61149) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-10-12 23:24:43 -07:00
Yongye ZhuandClaude Opus 5.5 2eb491e18b [Perf][MiniMax-M3] MSA prefill attends with the E4M3 query; bump fmha_sm100 to 968061a (#60684) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-11 13:40:45 +08:00
Yongye ZhuandClaude Opus 5.5 7566d83bd3 [Attention][MiniMax-M3] NVFP4 KV cache on the MSA sparse attention path (#59300) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-01 14:39:55 -07:00
Yongye ZhuandClaude Opus 5.5 77871126f9 [Kernel][DSV4.1] Fuse MoE finalize into the TP all-reduce + mHC boundary (#58586) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-27 03:08:36 +08:00
Yongye ZhuandClaude Opus 5.5 378504a544 [MoE] Defer the TRTLLM-Gen top-k finalize on the modular path (#58635) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-25 15:38:29 +08:00
Yongye ZhuandClaude Opus 5.5 5ff3bbfb08 [Perf][DSv4] Fuse inverse RoPE + FP8 quant into FlashInfer sparse MLA (#58621) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-24 23:26:50 -07:00
Yongye ZhuandSummer Yang 442bd00d9f [Perf][Distributed] Add low-SM multimem reduce-scatter for SM100/SM103 (#55072) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
 2026-09-25 03:27:21 +00:00
Yongye Zhu 929aa2a7ed [Build] Bump DeepGEMM pin to a6bbb80 (#57218) 2026-09-16 14:49:35 -07:00
Yongye ZhuYongye ZhuClaude Opus 5Yunxiao NingAI Assistant
 		d6a1677d55 [Model][DSv4.1] FlashMLA mega attention and the NVFP4 compressed KV cache (#56935) 
Signed-off-by: Yongye Zhu <yongye@inferact.ai>
Signed-off-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Yunxiao Ning <73625538+foraxe@users.noreply.github.com>
Co-authored-by: AI Assistant <noreply@openai.com>
 2026-09-16 03:07:50 -07:00
Yongye ZhuandClaude Opus 5 8263ea12bd [Build] Move DeepGEMM pin to the vLLM fork and update the Mega MoE call convention (#56876) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-15 00:57:18 -07:00
Yongye ZhuYongye ZhuClaude Opus 5
 		e6eb0d120c [Model][DSv4.1] Store the whole KV in MXFP8 (FlashMLA V4.1 record) (#56893) 
Signed-off-by: Yongye Zhu <yongye@inferact.ai>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-14 20:12:55 -07:00
Yongye Zhu 5372e72a98 [Perf][DSv4.1] Fold the mHC post block into the delayed pre projection (#56633) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-09-14 18:57:37 +00:00
Yongye ZhuJee Jee Liandyluo7OpenAI Codexzjy0516Claude Opus 5
 		e77daef89e [Model] Support DeepSeek-V4.1-Flash (#56214) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-11 02:11:19 -07:00
Yongye ZhuandClaude Opus 5 be1cb9834b [Kernel] Optional Q-norm in fused DSv4 MLA epilogue; group_size=32 for packed FP8 quant (#56215) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-10 00:35:59 -07:00
Yongye ZhuandClaude Fable 5 bc2ee48073 [Perf] Prefetch the weight before the PDL wait in fused_q_kv_rmsnorm (#55020) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-09-03 15:40:16 -07:00
Yongye ZhuandClaude Fable 5 9509fc8ae6 [Perf][Kimi-K3] Cut MLA decode concat/cache epilogue latency (#54896) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-09-03 15:39:58 -07:00
Yongye ZhuandOpenAI Codex 3ba9907a1d [Kimi-K3] Overlap low-M TP8 KDA projections (#54697) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-02 03:35:28 +00:00
Yongye Zhu d6d6658543 [Kimi-K3][Perf] Make native CUDA AttnRes the SM100 default (#54261) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-08-31 23:18:12 +00:00
Yongye ZhuandOpenAI Codex d9dabfa351 [Kimi-K3][Kernel] Optimize the low-M fused latent MoE tail (#54168) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-28 10:45:36 -07:00
Yongye ZhuandOpenAI Codex e9d1398d9e [Bugfix][Kimi K3] Enable deferred MoE finalization before weight loading (#53327) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-22 11:23:32 +08:00
Yongye ZhuandClaude Opus 5 967e104fad [Config] Unify indexer cache dtype under attention_config.indexer_kv_dtype (#52550) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-17 10:20:04 +08:00
Yongye Zhu acb0f1dcdb [Bugfix][Spec Decode] DSpark: inherit the target's attention backend when the speculative config names none (#52288) 2026-08-15 09:32:59 +08:00
Yongye ZhuClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		903d2efe7e [Attention][MLA] Fuse Kimi-K3 chunked-context K/V packing (#51772) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-12 22:42:57 -07:00
Yongye ZhuandKimi Code 025d56a11e [Build] Update DeepGEMM pin to deepseek-ai nv_dev tip (#52035) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
 2026-08-12 13:49:04 -07:00
Yongye ZhuOpenAI CodexClaude Opus 5
 		c76a425278 [Kernel] Optimize long-context MLA cache gathers (#51739) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-10 22:23:43 -07:00
Yongye ZhuandClaude Opus 4.8 9021589498 [Minimax-M3] Using tok_sparse_select from MSA instead of triton kernels (#47502) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-07 21:01:12 -07:00
Yongye ZhuandClaude Opus 4.8 fa248139a0 [MoE] Plumb gemm1_alpha/beta/clamp_limit into TRT-LLM FP8 MoE (#45723) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-01 14:34:05 -07:00
Yongye Zhu d3229431f9 [DSV4] Better MXFP8 quantization kernel (#47229) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-07-01 14:33:51 -07:00
Yongye Zhu 11b56b2ff2 [Kernel] Add FlashInferCutedslMxfp8LinearKernel (cute-dsl mm_mxfp8) (#46393) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-06-23 12:45:49 -07:00
Yongye ZhuClaude Opus 4.8Thien Tran
 		6691f087a6 [Minimax-M3] BF16/FP8 Indexer using MSA (#45892) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
 2026-06-23 10:28:49 -07:00
Yongye Zhu 2ba68d9bf7 [Test] Fix one-sided MNNVL alltoall test workspace under-reservation (#44946) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-06-11 00:43:12 +08:00
Yongye ZhuandClaude ec0a31d4aa [Bugfix][Kernel] Fix mHC fused-RMSNorm big-fuse miscompile for hidden_size != 4096 (#44692) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-06 10:44:21 +08:00
Yongye Zhu b5235fca2e [DSv4] Adding TRTLLM gen attention kernel (#43827) 2026-06-04 07:35:09 -07:00
Yongye Zhu 035733515f [Kernel][DSv4] Optimize sparse FP8 compressor kernels (#44161) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-06-02 00:18:32 +08:00
Yongye Zhu 2d2c660104 [MoE] Remove inplace fused experts mechanism (#43727) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-27 20:00:19 -07:00
Yongye Zhu 03d9cc2fe2 [misc] Bump cutedsl version to 4.5.2 (#43745) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-27 08:25:36 -07:00
Yongye Zhu 6ab6ffb428 [Feat][DSV4] Fuse q pad into deepseek v4 fused kernel (#43162) 2026-05-26 05:12:54 -10:00
Yongye Zhu 367cb81966 [DSV4] More multi-stream enablement for c4a (#42925) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-23 09:22:27 +08:00
Yongye Zhu 843715739b [Refactor] Extract DeepSeek V4 sparse MLA impl into model folder (#43149) 2026-05-22 10:06:31 -07:00
Yongye ZhuandClaude f8848b2f2d [Bugfix] Add swiglu limits to deepgemm fp8 methods (#41986) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-05-14 15:43:13 -07:00
Yongye ZhuandRoger Wang 0d2732dd91 [MLA Attention Backend] Add TOKENSPEED_MLA backend for DSR1/Kimi K25 prefill + decode on Blackwell (#41778) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-05-13 23:48:02 -07:00
Yongye Zhu 301305c093 Add @zyongye to CODEOWNERS (#42200) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-10 16:07:32 +08:00
Yongye Zhu 80d5e7d103 [Bugfix] Fix condition to clear persistent topk so that it can be captured regardless (#41665) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-06 16:17:48 -07:00
Yongye Zhu 1c607d7b2c [DSV4] Guard megamoe flag with Pure TP (#41522) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-02 16:41:40 -07:00
Yongye Zhu edd60ac93a [Bugfix] Fix persistent_topk inter-CTA init race on RadixRowState (#41444) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-01 14:42:52 -07:00
Yongye Zhu bcf5cac9fb [DSV4] Add knob to enable pre-attn gemm (#41443) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-01 12:23:17 -07:00
Yongye ZhuandRoger Wang a3c83ff2fd Faster per-token fp8 group quant packed kernel for blackwell (#41326) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-04-30 18:09:55 -07:00
Yongye ZhuZijing LiuClaude Opus 4.7
 		b4806c8ee1 [DSV4] Add BF16 and MXFP8 A2A support for flashinfer a2a one sided (#40960) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-30 15:33:12 -07:00
Yongye ZhuandClaude Opus 4.7 a749a33d8d [Bugfix] Fix persistent_topk cooperative deadlock at TopK=1024 (#41189) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-29 21:03:45 -07:00
Yongye Zhu 5aa371dc8e [DSV4] Enable Multi-stream for Pre-Attn GEMM (#41061) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-04-28 09:08:55 -07:00
Yongye Zhu 706a04d34b [DSV4] Add silu clamp limit to shared expert (#40950) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-04-27 00:37:43 -07:00
Yongye Zhu 739e5945dc [Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-04-13 12:53:58 -04:00
Yongye Zhu 620e8924d9 [Bugfix] [Tests] Enforce out tensor device in kernel/moe/test_cutedsl_moe.py (#39644) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-04-12 17:08:08 -07:00
Yongye Zhu 2e98406048 [Refactor] Improve indexer decode path metadata preparation (#38865) 2026-04-08 20:49:15 -07:00
Yongye ZhuMichael GoinRoger Wang
 		e8ebbdde83 [Quantization] Add FlashInfer CuteDSL batched experts backend for NVFP4 MoE (#38251) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-04-06 11:57:53 -07:00
Yongye Zhu 8617f8676b [Bugfix] Fix DSV32 weight loading (#38870) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-04-03 19:57:52 -07:00
Yongye Zhu 678b3c99e8 [MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration (#38050) 2026-03-25 10:16:40 -07:00
Yongye Zhu c058ff44d4 [Bigfix]fix lora test by pass padded size back to the layer (#37811) 2026-03-22 13:20:13 -06:00
Yongye ZhuandClaude Opus 4.6 87bd91892f [MoE Refactor] Mxfp4 oracle rebased (#37128) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-21 03:37:04 +00:00
Yongye ZhuClaude Opus 4.5Nick HillNick Hill
 		86e1060b17 [Bugfix] Fix inner_dp_world initialization order for multi-node TP (#35892) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2026-03-05 22:04:44 -08:00
Yongye Zhu 1976356ee6 [MoE Refactor] MXFP4 Cutlass Experts to MK (#34542) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-02-25 17:32:39 -08:00
Yongye ZhuandRobert Shaw 40da9625a1 [MoE Refactor] Convert mxfp4 marlin into modular kernel format (#34588) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-02-18 14:37:14 -08:00
Yongye ZhuandRobert Shaw 31c29257c8 [MoE Refactor][17/N] Apply Refactor to Bf16 (#31827) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-01-15 12:53:40 -08:00
Yongye ZhuandRobert Shaw d62cfe546d [MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change compressed tensor kernel selection (#31752) 
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
 2026-01-08 19:01:30 -05:00
Yongye ZhuandRobert Shaw 776ca1e187 [MoE Refactor] Aiter Experts for BF16 MoE (#31542) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-01-05 14:52:59 -08:00
Yongye ZhuandRobert Shaw a3f2f40947 [MoE Refactor] Explicit construct mk for flashinfer bf16 kernel (#31504) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-01-02 13:54:50 -08:00
Yongye ZhuandRobert Shaw 5a468ff7c7 [MoE Refactor] Split invoke_fused_moe_kernel (#31050) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-01-02 13:47:15 -08:00
Yongye Zhu 7b926e8901 [MoE Refactor][9/N] Use modular kernel for unquantized Triton MoE (#31052) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-12-22 17:34:19 +00:00
Yongye Zhu 88f5b19f0b [DeepSeek] Fix DeepSeek V3.2 Rope Embedding (#28968) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-11-19 16:30:04 -05:00
Yongye Zhu f5ed68ef63 [Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-10-15 16:05:01 +08:00
+6
Yongye ZhuChen ZhangyoukaichaoLucas WilkinsonRobert ShawLucas Wilkinsonyewentao256Wentao YemgoinLucia FangLucia FangNickLuccheSiyuan FuMatthew BonanniXiaozhu MengBarry Kang
 		fa7e254a7f [New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
 2025-09-30 17:14:41 +08:00
Yongye Zhu 082cc07ef8 DP/EP Support for gpt-oss with deepep-ht comm kernel on SM100 (#23608) 2025-08-27 17:33:21 -04:00
Yongye ZhuandMichael Goin 39cd09dc86 [Bugfix] use flash attn on sm90 (#22933) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-08-14 16:37:22 -07:00
Yongye Zhu 007dd90859 [gpt-oss] Enable gpt-oss on ampere (#22714) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-08-12 03:21:44 -07:00
Yongye ZhuandWoosuk Kwon f756a682d9 [gpt-oss] guard import when triton kernel is not installed (#22529) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-08 11:18:33 -07:00
Yongye Zhu e789cad6b8 [gpt-oss] triton kernel mxfp4 (#22421) 
Signed-off-by: <zyy1102000@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-08-08 08:24:07 -07:00
Yongye Zhu 5c7cc33f4d [gpt-oss] fix model config with hf_config (#22401) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-08-06 18:04:04 -07:00
Yongye Zhuandsimon-mo 31f09c615f [gpt-oss] flashinfer mxfp4 (#22339) 
Signed-off-by: simon-mo <xmo@berkeley.edu>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
 2025-08-06 12:37:27 -07:00
Yongye Zhuandsimon-mo 31f5dc5b2a [gpt-oss] Enhance error msg on attention sink init (#22335) 
Signed-off-by: simon-mo <xmo@berkeley.edu>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
 2025-08-06 11:41:42 -07:00
Yongye ZhuLiuXiaoxuanPKUsimon-moChen ZhangWoosuk KwonHongxia YangMinseok Lee
 		90ec006937 [gpt-oss] flashinfer attention sink init (#22330) 
Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
 2025-08-05 23:48:19 -07:00