 Yan Ma
|
e05201aa2e
|
[XPU] refine memory release for sleep mode (#61158)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-10-12 16:59:38 +08:00 |
|
|
Yan Ma
|
f147949be8
|
[XPU] limit FA kernel block size to multipleOf 64 (#57297)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-10-12 10:25:32 +08:00 |
|
|
Yan Ma
|
c17fadcfdc
|
[XPU] fix fused_input_norm for MM (#59865)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-10-09 20:16:35 +08:00 |
|
|
Yan Ma
|
4e318ac563
|
[XPU] fix online fp8_per_channel quantization (#56027)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-10-09 18:38:01 +08:00 |
|
|
Yan Ma
|
3bd7302396
|
[XPU] skip test_online_quantization_loads_real_weights (#58987)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-29 07:10:52 +08:00 |
|
|
Yan MaandKunshang Ji
|
754aa29c00
|
[XPU] use rms_norm xpu kernel for context-key normalization (#58896)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-29 07:09:58 +08:00 |
|
|
Yan MaandKunshang Ji
|
e34489a543
|
[XPU] upgrade to PyTorch 2.14 (#56013)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-23 09:18:52 +00:00 |
|
|
Yan Ma
|
d05da62e9c
|
[XPU] fix incorrect gdn kernel log for XPU path (#54871)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-20 14:00:31 +08:00 |
|
|
Yan MaandKunshang Ji
|
4991f97669
|
[XPU] sleep mode: fix KV cache release test (#57485)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-18 15:49:17 +00:00 |
|
|
Yan Ma
|
48f663c37f
|
[XPU] Fix incorrect context-key normalization for Qwen DFlash-based models (#56431)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-18 07:52:01 +08:00 |
|
|
Yan MaandKunshang Ji
|
da3c07bf7d
|
[XPU][CI] skip test_hybrid_prefix_cache_hit_rate (#57301)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-17 19:57:22 +08:00 |
|
|
Yan Ma
|
978c22f54b
|
[XPU] update triton-xpu 3.8.0 shim layer (#56014)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-10 08:44:11 +08:00 |
|
|
Yan Ma
|
10ade93979
|
[XPU] update key supported models (#53494)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-25 15:10:48 +00:00 |
|
|
Yan Ma
|
6feafb8b7d
|
[XPU] follow cuda path for mrope on XPU (#53201)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-21 10:13:27 +00:00 |
|
|
Yan MaandKunshang Ji
|
b0e9cff5e7
|
[XPU] update xpu-manager to v2.1.0 (#52569)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-18 06:27:41 +00:00 |
|
|
Yan MaandKunshang Ji
|
63344913a6
|
[XPU] update UMD to 26.27 (#50513)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-13 13:15:25 +08:00 |
|
|
Yan MaandKunshang Ji
|
b76cf758db
|
[XPU] install xpu-manager for device monitor (#50831)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-11 14:18:41 +08:00 |
|
|
Yan Ma
|
8d9b52f7c2
|
[XPU] quick fix online quantization UT break (#51365)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-07 10:25:31 +00:00 |
|
|
Yan Ma
|
24c939c47d
|
[XPU] fix collecting oneccl version info (#47104)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-04 11:53:28 +00:00 |
|
|
|
5b29c958c7
|
[XPU] upgrade to torch 2.13 (#48677)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-07-29 01:24:56 -07:00 |
|
|
Yan Ma
|
73af7a362a
|
[XPU] Add online fp8 quantization test (#44513)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-07-28 10:34:33 +08:00 |
|
|
Yan Ma
|
c2c9f7c5e2
|
remove force channels_last in Idefics3MultiModalProcessor (#48467)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-07-13 14:18:57 +00:00 |
|
|
Yan Ma
|
90ce3a09be
|
[bugfix] fix MOSS-Audio deepstack_input_embeds initialization in PP (#47607)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-07-06 17:15:50 +08:00 |
|
|
Yan MaandKunshang Ji
|
59575da46d
|
[XPU] exclude unsupported models for test_tensor_sechma.py (#47008)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-29 12:30:28 +00:00 |
|
|
Yan Ma
|
acce57d8dd
|
Deprecate old FP8 online MoE quantization class (#44514)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-06-23 11:53:38 -07:00 |
|
|
Yan Ma
|
547d2c40d7
|
Add weights padding for fp8 per-block online quantization (#44763)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-06-23 11:08:17 -04:00 |
|
|
Yan Ma
|
54c660c3a6
|
[XPU][Minor] format moe kernel name and add in kernel list (#44771)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-06-08 13:58:16 +08:00 |
|
|
Yan Ma
|
3bb46975bd
|
[XPU][Feature] transparent sleep mode support for XPU platform (#37149)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-06-07 10:45:31 +08:00 |
|
|
Yan Ma
|
7f003a1285
|
Support MiniCPMV batched preprocessing (#44609)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-06-05 15:05:31 +00:00 |
|
|
Yan Maandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
0414d75410
|
[XPU] skip unapplied UT in test_gpu_model_runner.py (#44289)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-04 08:48:17 +08:00 |
|
|
Yan MaandKunshang Ji
|
02564b4de0
|
[XPU]fallback to TRITON_ATTN for vit attn on xpu when use float32 dtype (#43759)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-03 03:20:21 -07:00 |
|
|
Yan Ma
|
f815c99954
|
[Bugfix] fix device mismatch in MiniCPM-o-4_5 resampler (#43194)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-05-26 13:12:50 +08:00 |
|
|
|
bc03f280c8
|
[XPU] keep generator state of sycl kernel align with pytorch (#41771)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-12 11:44:47 +00:00 |
|
|
Yan MaandKunshang Ji
|
4f6fa6341d
|
[XPU] update supported models on XPU (#41911)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-09 10:44:03 +08:00 |
|
|
Yan MaandKunshang Ji
|
be0dcc29dc
|
[XPU] remove q/k/v force contiguous for flash_attn (#40356)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-09 01:19:05 +00:00 |
|
|
Yan Ma
|
595562651a
|
[XPU] fix MoE triton backend in online fp8 quantization (#40109)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-04-20 11:31:39 -04:00 |
|
|
Yan Ma
|
e06de7f005
|
[XPU] enable triton attention test on XPU by removing cuda device binding (#39627)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-04-20 20:57:11 +08:00 |
|
|
Yan MaandKunshang Ji
|
3beb57a238
|
[XPU] properly handle q_descale on XPU as quant query input not supported (#39676)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-15 21:52:58 +08:00 |
|
|
Yan Ma
|
29e5d10205
|
fix online fp8 for MiniCPM models (#39862)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-04-15 09:09:20 +00:00 |
|
|
Yan Ma
|
394ff86965
|
[XPU][CT] support per-channel quantization in xpu fp8 linear method (#38316)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-04-12 02:46:28 +00:00 |
|
|
Yan MaandKunshang Ji
|
0f3ce4c74b
|
[XPU] Fix spec-decode UTs under tests/v1/spec_decode (#38491)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-11 01:31:00 +00:00 |
|
|
Yan Ma
|
ec68d53b2b
|
Add platform manual_seed_all API (#38468)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-04-10 13:43:50 +08:00 |
|
|
|
ee3cf45739
|
[XPU] Initial support for GDN attention on Qwen3-next/Qwen3.5 (#33657)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-03 08:59:11 +08:00 |
|
|
Yan Ma
|
d3fe857135
|
update doc for online fp8 quantization (#37851)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-03-23 05:19:03 +00:00 |
|
|
Yan Ma
|
894843eb25
|
replace with torch.cuda.device with with torch.accelerator.device_index (#36144)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-03-11 23:12:57 -07:00 |
|
|
Yan Ma
|
58cfe0dc44
|
Fix phi4-mm and remove cuda binding (#35964)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-03-05 01:08:05 +08:00 |
|
|
Yan Ma
|
b1b5e045df
|
[XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-02-23 05:06:44 -08:00 |
|
|
Yan Ma
|
9581185d51
|
[XPU]disable test_acceptance_length UT (#33226)
|
2026-01-28 15:24:13 +08:00 |
|
|
Yan Ma
|
f1c2c20136
|
[XPU] decrease IGC_ForceOCLSIMDWidth for speculative decoding triton-xpu kernel compilation (#30538)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-12-23 05:22:15 +00:00 |
|
|
Yan Ma
|
560ae9638c
|
[XPU] enable fp8 online streaming quantization (#30944)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-12-20 13:45:27 +00:00 |
|
|
Yan Ma
|
4f735babb7
|
[XPU] fix broken fp8 online quantization for XPU platform (#30831)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-12-17 00:28:13 -08:00 |
|
|
Yan Ma
|
3cfa63ad99
|
[XPU]fix Kimi-VL-A3B-thinking on xpu (#29309)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-11-24 21:02:21 +00:00 |
|
|
Yan Ma
|
529cea343d
|
use default CCL_ZE_IPC_EXCHANGE (#28700)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-11-14 16:55:29 +08:00 |
|
|
|
7e2729b57e
|
[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2025-11-01 04:45:02 +00:00 |
|
|
Yan Ma
|
b798e39f93
|
[XPU][bugfix] fix rope for llama4 and deepseek (#25145)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-10-30 09:43:13 +08:00 |
|
|
Yan MaandIsotr0py
|
a684c0124c
|
[bugfix] fix MHA for models like OpenGVLab/InternVL3_5-38B (#25146)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2025-09-19 08:45:06 +00:00 |
|
|
Yan Ma
|
4d7c1d531b
|
[Bugfix] Fix MRoPE dispatch on XPU (#24724)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-09-12 21:43:56 +08:00 |
|
|
Yan Ma
|
67841317d1
|
[xpu] upgrade ipex/python3.12 for xpu (#23830)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-09-08 02:07:16 +00:00 |
|
|
Yan MaandQiming Zhang
|
7be0cb8e9e
|
[XPU][Feature] fp8 online quantization support for XPU (#23148)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
|
2025-09-02 04:06:53 +00:00 |
|
|
Yan Ma
|
73e1b9b1d4
|
[xpu]support moe models on XPU platform (#21643)
Signed-off-by: yan <yan.ma@intel.com>
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2025-08-02 07:49:08 -07:00 |
|
|
Yan Ma
|
a4c23314c0
|
[xpu]feat: support multi-lora on xpu (#20616)
Signed-off-by: yan <yan.ma@intel.com>
|
2025-07-08 22:07:10 +08:00 |
|
|
Yan Ma
|
3112271f6e
|
[XPU] log clean up for XPU platform (#20553)
Signed-off-by: yan <yan.ma@intel.com>
|
2025-07-07 01:38:22 -07:00 |
|
|
Yan Ma
|
fe3462c774
|
[XPU][Bugfix] minor fix for XPU (#15591)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2025-04-22 00:02:57 +08:00 |
|
|
Yan Ma
|
ff6473980d
|
[Bugfix][Model] fix mllama multi-image (#14883)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2025-03-31 22:53:37 -07:00 |
|
|
Yan Ma
|
9b87a579aa
|
[Misc][XPU] Use None as device capacity for XPU (#14932)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2025-03-17 01:22:14 -07:00 |
|
|
Yan Ma
|
b56155e7f3
|
[XPU]fix setuptools version for xpu (#13548)
|
2025-02-22 08:05:35 -08:00 |
|
|
Yan Ma
|
30513d1cb6
|
[Bugfix] fix xpu communicator (#13368)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2025-02-17 20:59:18 +08:00 |
|
|
Yan Ma
|
78f4590b60
|
[Bugfix][XPU] fix silu_and_mul (#11823)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2025-01-09 00:11:50 +08:00 |
|
|
Yan Ma
|
f04e407e6b
|
[MISC][XPU]update ipex link for CI fix (#11278)
|
2024-12-17 22:34:23 -08:00 |
|
|
Yan Ma
|
2f2cdc745a
|
[MISC][XPU] quick fix for XPU CI (#10859)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2024-12-03 17:16:31 +00:00 |
|
|
Yan Maandyoukaichao
|
519cc6ca12
|
[Misc][XPU] Avoid torch compile for XPU platform (#10747)
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2024-12-02 17:53:55 +00:00 |
|
|
Yan Ma
|
6b2d25efc7
|
[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2024-11-18 11:18:05 -07:00 |
|
|
Yan Ma
|
f10797c0ce
|
[Bugfix][XPU] Fix xpu tp by introducing XpuCommunicator (#10144)
Signed-off-by: yan ma <yan.ma@intel.com>
|
2024-11-08 09:41:03 +00:00 |
|
|
Yan MaandKunshang Ji
|
d3859f1891
|
[Misc][XPU] Upgrade to Pytorch 2.5 for xpu backend (#9823)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2024-11-06 17:29:03 -08:00 |
|
|
Yan MaandYiSheng5
|
04a3ae0aca
|
[Bugfix] Fix multi nodes TP+PP for XPU (#8884)
Signed-off-by: YiSheng5 <syhm@mail.ustc.edu.cn>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: YiSheng5 <syhm@mail.ustc.edu.cn>
|
2024-10-29 21:34:45 -07:00 |
|
|
Yan Ma
|
2adb4409e0
|
[Bugfix] Fix ray instance detect issue (#9439)
|
2024-10-28 07:13:03 +00:00 |
|
|
|
056a68c7db
|
[XPU] avoid triton import for xpu (#9440)
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2024-10-24 05:14:00 +00:00 |
|
|
Yan Ma
|
d23679eb99
|
[Bugfix] fix docker build for xpu (#8652)
|
2024-09-22 22:54:18 -07:00 |
|