iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,297 Commits 3 Branches 0 Tags
main
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jee Jee Li e56b1603af [Kernel]Add norm fused kernel for Step-5 Preview and Muse Spark Open (#62132) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-10-17 01:53:00 -07:00
Jee Jee Li 39983a5e7a [Kernel] Add FP32 router GEMM support for Step-5 Preview and Muse Spark Open (#62126) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-10-16 22:17:55 -07:00
Jee Jee Li bee95149e2 Update DeepGEMM commit (#61744) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-10-15 17:54:40 -07:00
Jee Jee Li f9c9e8ac24 [LoRA] Remove tensorizer (#60024) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-10-05 07:01:56 -07:00
Jee Jee Li e3af5bf3ce [LoRA] Code cleanup (#60017) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-10-05 09:15:53 +00:00
Jee Jee Li de6674b002 [MoE] Use GateLinear for all MoE models (#58234) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-09-23 05:40:13 +00:00
Jee Jee Li d90f0eade5 [Build] Fix CUDA 12 KV connector dependency selection (#57945) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-09-22 06:13:07 -07:00
Jee Jee Li 86ce4d10e2 [BUGFIX][HY4] Record indexer completion event for full CUDA graph capture (#57811) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-09-21 10:59:11 +08:00
Jee Jee LiandYongye Zhu 9c297e3b8b [Kernel] PDL enablement for fusedQKNormRopeKernel (#55755) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-09-07 20:49:03 -07:00
Jee Jee Li 607a6e48c5 [CI/Build] Fix unused fake implementation testing (#55797) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-09-08 03:36:18 +00:00
Jee Jee Li 199cb9b964 [Kernel] Remove unused fake implementation (#55535) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-09-06 17:54:32 -07:00
Jee Jee Li e2c8eeac40 [kernel] Fused embedding kernel (#53677) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-31 11:34:14 +00:00
Jee Jee Li 8e92248f79 [Kernel] Retire the DSv3 router GEMM CUDA kernel (#54040) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-31 07:15:31 +00:00
Jee Jee Li 648b7468b8 [CI/Build] Fix Kimi K3 Eagle3 test fixture (#54482) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-31 03:29:45 +00:00
Jee Jee Li 75aa189ba0 [LoRA] Cleanup VocabParallelEmbedding (#53843) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-26 16:19:35 +08:00
Jee Jee Li 88e1b11313 [Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-26 01:46:56 +00:00
Jee Jee LiandCyrus Leung 4f686e182a [MISC] Cleanup deprecated parameters (#53559) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-08-24 10:19:04 -07:00
Jee Jee Li 2687fec6ef Replicated embedding and norm fusion for DSV3 flat model (#48484) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-18 14:53:21 +08:00
Jee Jee Li 69e0e58da1 [Doc] Update model support information (#52289) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-14 09:47:30 +00:00
Jee Jee Li dd7cc85f17 Add MoE output contract for MoE tail fusion (#51407) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-11 22:23:59 +08:00
Jee Jee Li f85c1d2f84 K3: remove the add operation for megamoe path (#51146) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-06 01:48:25 +00:00
Jee Jee Li b9d1e2437e K3: Move LatentMoERunner (#50678) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-03 09:36:17 +00:00
Jee Jee Li 4635cc3e8f Shard the K3 Latent-MoE up-projection on large batches (#50383) 2026-08-03 00:49:39 -07:00
Jee Jee Li 92643d68f5 K3 DSpark AR fusion (#50242) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-31 11:12:03 +00:00
Jee Jee Li da64db78b9 [LoRA] Optimize TrtLlmLoRAExperts (#48759) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-18 10:26:14 +08:00
Jee Jee Li 313fae3e89 [Bugfix] Fix GLM5 config (#48711) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-15 09:55:39 +00:00
Jee Jee Li fdf2cf66d3 [LoRA][1/N] Integrate flashinfer MoE LoRA for BF16 model (#48632) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-15 10:54:00 +08:00
Jee Jee LipeiyuanzClaudezhouzhou
 		19069bcbd5 FP32 router GEMV optimization (#48335) 
Signed-off-by: peiyuanz <peiyuanz@inferact.ai>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: peiyuanz <peiyuanz@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: zhouzhou <zhouzhou@zhouzhoudeMacBook-Pro.local>
 2026-07-11 13:07:48 +00:00
Jee Jee Li 5d23ca47ab [Kernel] Applies routed_scaling_factor internally (#47408) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-07 02:00:54 -07:00
Jee Jee Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 32ab064621 [UX] Add model_class_overrides for development and debugging (#47148) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-07 11:43:08 +08:00
Jee Jee Li 1360c42fe6 [UX] Include NVTX in cuda.txt (#47319) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-01 19:38:50 -07:00
Jee Jee Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> d0a2584773 [Misc] Use functions instead of PTX for the PDL instruction (#46984) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-01 19:38:35 -07:00
Jee Jee Li 8f82be5705 [CI/Build] Fix LoRA testing (#47242) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-01 15:36:13 +08:00
Jee Jee Li 7be582697b [Bugfix] Fix DeepseekV2Model hidden_size (#46986) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-29 16:44:05 +00:00
Jee Jee Li 23aed9b0ee [Kernel] Enable PDL for per_token_group_quant_8bit_kernel (#46508) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-25 08:42:51 +08:00
Jee Jee Li 9d6fdc2901 [Kernel] GLM5 Router GEMM (#46385) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-23 22:54:50 -07:00
Jee Jee Li 9f6f296428 [CI/Build] Remove BaiChuanForCausalLM from the LoRA test (#46494) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-23 22:09:48 +08:00
Jee Jee LiJiangyun ZhuRoger Wang
 		2e2c47928b [Doc] Update MiniMax-M3 (#45940) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-06-22 01:23:27 -07:00
Jee Jee Li 745bba5ea8 [Model]Fix MiniMaxM2ForCausalLM perf regression (#45935) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-22 00:28:52 +08:00
Jee Jee Li 22cc891108 [Kernel] Add PDL support for DeepGEMM kernel (#46006) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-18 20:49:01 +08:00
Jee Jee Li 4403af8fb5 [Kernel] Add PDL support for DeepGEMM kernel (#42996) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-17 20:37:17 -07:00
Jee Jee Li ebbb2d55ac [CI/Build][Bugfix] Fix SD LoRA (#45941) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-06-18 00:34:15 +00:00
Jee Jee LiNick HillWoosuk Kwon
 		eacff17c8d [Model Runner V2][Bugfix] Fix MRV2 LoRA warmup (#35536) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
 2026-06-15 13:17:23 -07:00
Jee Jee Li dc10e467a9 [Bugfix] Fix minimax_qk_norm_fusion (#44983) 2026-06-09 06:43:46 -07:00
Jee Jee Li 4d1fd13613 [CI/Build] Fix LoRA testing (#44425) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-06-03 08:58:06 -07:00
Jee Jee Li 6bdabbad5b [CI/Build] Enable Step3p7ForConditionalGeneration testing (#43956) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-31 05:16:12 +00:00
Jee Jee LiandYiliu Dong 559d6710bf [PERF]MiniMax-M2 gate kernel (#38445) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: qianlihuang <91178480+qianlihuang@users.noreply.github.com>
Co-authored-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>
 2026-05-29 18:28:34 -07:00
Jee Jee Li 6e503868ca [Kernel] Porting fuse_minimax_qk_norm to manual fusion (#43410) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-26 13:16:03 -07:00
Jee Jee Li ec5de7fa7d [LoRA] Add one shot triton kernel For MoE LoRA (#42290) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-05-25 19:47:04 -07:00
Jee Jee Li d4004455d2 [Kernel] Remove NormGateLinear (#43554) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-25 09:49:19 +00:00
Jee Jee Li b06813e872 [Kernel] Add mhc_pre_big_fuse_with_norm_tilelang (#43474) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-25 01:19:45 +00:00
Jee Jee Li 15f7cd33dc [LoRA] Reduce memory of 2D weights when EP is set (#42737) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-22 06:41:56 -07:00
Jee Jee Li ee05e8137e [Minor] Bigger overlap for FI AR (#43103) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-20 21:20:57 -07:00
Jee Jee Li 2267f70070 [Kernel] Pack topk id/weights triton kernel (#42527) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-18 03:04:31 -07:00
Jee Jee Ligemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Roger Wang
 		7d5b033782 [LoRA] Support 2D and 3D MoE LoRA adapter at the same time (#42242) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-05-18 15:22:26 +08:00
Jee Jee Li 32b7177909 [LoRA][Bugfix] Dedup LoRA wrapping for modules referenced from multiple attribute paths (MoE gate) (#42757) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-05-16 11:22:35 +08:00
Jee Jee Lijeejeeleemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		0a65d46628 [DSV4] Fuse norm and router for low latency scenario (#41263) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: jeejeelee <jeejeelee@verda-b300-05.datacrunch.io>
Co-authored-by: jeejeelee <jeejeelee@verda-b300-05.datacrunch.io>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-14 05:11:02 -07:00
Jee Jee LiandYongye Zhu 53181384e0 [Bugfix] Fix DSV4 swiglu_limit on marlin backend (#42287) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-11 13:03:56 -07:00
Jee Jee Li 05d610e5cd [CI/Build] Reduce LoRA model tests. (#42266) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-11 14:49:08 +08:00
Jee Jee Li 84f7a55340 [CI] Trigger LoRA test when changing MoE code. (#42196) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-10 01:26:09 -07:00
Jee Jee Li ecd0b60aad [LoRA] Initial EP support for LoRA (#40867) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-09 00:31:23 -07:00
Jee Jee Li 9c0812ffd0 [Bugfix] Fix FusedMoEWithLoRA has no attribute runner (#41889) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-07 04:53:14 -07:00
Jee Jee Li 307b17ce33 [DSV4] Avoid redundant dtype conversion. (#41374) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-30 09:57:27 -07:00
Jee Jee Liandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 9d8ad5b408 [Bugfix] Fix repeated DSv4 RoPE cache initialization (#41148) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-29 20:29:55 +08:00
Jee Jee Li a269744e9f [Bugfix] Fix rope (#41113) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-28 22:42:35 -07:00
Jee Jee Li 2c8b76c5cb [Model][DSV4] Support base model (#41006) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-28 08:16:55 +08:00
Jee Jee Li 8cd174fa35 [LoRA] MoE LoRA Refactor (#40338) 2026-04-26 01:55:19 +00:00
Jee Jee Li bfde49e287 [DOC] Add fuse_minimax_qk_norm (#39782) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-18 00:41:37 -07:00
Jee Jee Li 715681c127 [LoRA] Support dual CUDA streams-Linear Layer (#35721) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-13 10:57:07 +08:00
Jee Jee Li ecd1ea1363 [Kernel] Porting the TRTLLM minimax_allreduce_rms kernels (#37045) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-11 00:20:20 +08:00
Jee Jee LiandRoger Wang ac30a8311e [Bugfix][Model] Fix PixtralForConditionalGeneration LoRA (#36963) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-03-29 23:59:42 -07:00
Jee Jee Li 2bfbdca23c [Bugfix] Fix benchmark_fused_collective.py (#38082) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-25 23:51:00 -07:00
Jee Jee Li aec2dc6c0d [Bugfix][LoRA] Fix incorrect LoRA Log (#37877) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-23 11:42:52 +00:00
Jee Jee Li 1f0d210641 [CI/Build][LoRA] Update Qwen35 LoRA testing (#37816) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-23 12:55:49 +08:00
Jee Jee Li dd20ee4e3e [UX] Enable torch_profiler_with_stack (#37571) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-20 11:17:26 +00:00
Jee Jee Li 8fbe3f303f [Bugfix][LoRA] Fix Qwen35 LoRA (#36976) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-20 11:09:32 +08:00
Jee Jee LiandCyrus Leung 96266f119b [LoRA] Minor improvements to LoRA log (#37557) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-03-19 15:18:06 +00:00
Jee Jee Li 8c31f47c63 [LoRA] Make LoRA respect language_model_only (#37375) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-18 07:53:34 +00:00
Jee Jee Li 1e5ad9b74f [Bugfix] Fix Qwen3NextForCausalLM packed_modules_mapping (#35413) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-02-26 19:46:30 -08:00
Jee Jee Li 7291d1b288 [Bugfix] Fix kernel benchmark (#33752) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-02-22 21:18:08 -08:00
Jee Jee Li 978a37c823 [Model] GLM adaptation (#34124) 2026-02-09 17:32:52 +08:00
Jee Jee Li db4ede9743 [Model] Enable Step3p5ForCausalLM testing (#33755) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-02-07 05:25:24 -08:00
Jee Jee Li 73b243463b [BugFix] Add env variable to control PDL in LoRA (#32836) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-25 16:32:30 +08:00
Jee Jee Li 2636d76257 [Misc] Remove unused ModelKeys (#32608) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-19 17:34:59 +00:00
Jee Jee LiCyrus Leunggemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		05e8981234 [Doc] Improve LoRA docs (#32159) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-12 02:19:17 -08:00
Jee Jee Li 49568d5cf9 [Doc] Improve MM models LoRA notes (#31979) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-08 08:55:22 -08:00
Jee Jee Li 30399cc725 UX: add vLLM env info in '/server_info' (#31899) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-07 17:13:02 +00:00
Jee Jee Li cbd4690a03 [LoRA]Disable linear LoRA kernel PDL (#31777) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-06 23:12:25 +08:00
Jee Jee Li d5503ca7f9 [LoRA] LoRA PDL improvement (#31660) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-05 08:28:46 +00:00
Jee Jee Li f099cd557a [Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-05 02:31:31 +00:00
Jee Jee Libk-201prashanth058Anexdeus
 		ce1eafd1a5 [Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) 
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
 2025-12-26 04:48:20 -08:00
Jee Jee Li c3666f56fd [Misc] Fix Qwen2-MoE shared_expert_gate (#31339) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-26 05:10:39 +00:00
Jee Jee Li 27c6c2f98c [Bugfix] Fix MoE LoRA bin/pt loading (#31161) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-23 19:09:15 +08:00
Jee Jee Li 6b16fff01b [Bugfix] Fix Jais2ForCausalLM (#31198) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-23 07:44:01 +00:00
Jee Jee Li 097978a15d [Kernel] Enable fused_qknorm_rope_kernel supports partial rope (#30821) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-21 18:39:22 -08:00
Jee Jee Li 0e391e7570 [Bugfix] Fix RequestOutput miss lora_request (#30636) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-16 01:36:35 -08:00
Jee Jee Li a524d1ba0a [Bugfix] Fix deepseek_v32 tokenizer_mode (#30658) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-15 04:20:31 +00:00
Jee Jee Li 67312cad11 [Misc] Split the LoRA code (#30253) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-09 00:59:31 +08:00
Jee Jee Li 80433e225e [LoRA] Reduce the loading time of MoE LoRA (#30243) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-08 13:29:47 +00:00
Jee Jee Li b0f4866a77 [CI/Build]Temporary workaround for test_default_mm_loras timeout (#30202) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-12-07 20:27:11 +08:00