 DefTruth
|
a6481525b8
|
[misc] ignore marlin_moe_wna16 local gen codes (#16760)
Signed-off-by: DefTruth <qiustudent_r@163.com>
|
2025-04-17 17:15:14 +08:00 |
|
|
DefTruth
|
e82ee40de3
|
[Bugfix][Kernel] fix potential cuda graph broken for merge_attn_states kernel (#16693)
Signed-off-by: DefTruth <qiustudent_r@163.com>
|
2025-04-16 03:31:39 -07:00 |
|
|
DefTruth
|
280d62b8a2
|
[Kernel] Remove redundant Exp calculations (#16123)
Signed-off-by: DefTruth <qiustudent_r@163.com>
|
2025-04-15 12:58:37 +00:00 |
|
|
DefTruth
|
ce4ddd2d1a
|
[Misc] remove warning if triton>=3.2.0 (#16553)
Signed-off-by: DefTruth <qiustudent_r@163.com>
|
2025-04-14 02:39:47 -07:00 |
|
|
DefTruth
|
e9528f6dc6
|
[Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173)
Signed-off-by: DefTruth <qiustudent_r@163.com>
|
2025-04-11 06:50:50 -06:00 |
|
|
DefTruth
|
905e91e9ac
|
Revert "[Model] use AutoWeightsLoader for deepseek_v2, internlm2" (#16453)
|
2025-04-11 06:44:22 +00:00 |
|
|
DefTruth
|
6ebaf9ac71
|
[Bugfix] consider related env vars for torch.compiled cache hash (#14953)
Signed-off-by: DefTruth <31974251+DefTruth@users.noreply.github.com>
|
2025-03-23 15:53:09 +00:00 |
|
|
DefTruth
|
f90d34b498
|
[Misc] Add tuned R1 w8a8 and MoE configs for NVIDIA L20 (#15322)
Signed-off-by: DefTruth <qiustudent_r@163.com>
|
2025-03-23 01:10:10 -07:00 |
|
|
DefTruth
|
acaea3bb07
|
[Bugfix][V1] Fix flashinfer sampling (#14815)
|
2025-03-14 20:42:38 -07:00 |
|
|
DefTruth
|
40253bab44
|
[Bugfix][W8A8] fixed cutlass block fp8 binding (#14796)
|
2025-03-14 03:32:42 -07:00 |
|
|
DefTruth
|
0c4d2ad5e6
|
[VLM][Bugfix] internvl with num_scheduler_steps > 1 (#8614)
|
2024-09-25 09:35:53 -07:00 |
|
|
DefTruth
|
44874a0bf9
|
[Doc] add env docs for flashinfer backend (#6437)
|
2024-07-14 21:16:51 -07:00 |
|
|
DefTruth
|
0f9a6e3d22
|
[Bugfix][Kernel] allow non-power-of-2 for prefix prefill with alibi (#4573)
|
2024-05-08 09:19:58 -07:00 |
|
|
DefTruth
|
ce3f1eedf8
|
[Misc] remove chunk detected debug logs (#4571)
|
2024-05-03 04:48:08 +00:00 |
|
|
DefTruth
|
9c7306ac11
|
[Misc] fix typo in llm_engine init logging (#4428)
|
2024-04-28 18:58:30 +08:00 |
|
|
DefTruth
|
d87f39e9a9
|
[Bugfix] Add init_cached_hf_modules to RayWorkerWrapper (#4286)
|
2024-04-23 09:28:35 -07:00 |
|