iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
40 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Chendi.XueandKunshang Ji 685bf811d6 [XPU] enable is_act_and_mul for xpu (#37481) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-05-05 01:07:39 +00:00
Chendi.Xue 65e4e46f66 update CODEOWNERS file (#39439) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2026-04-10 15:05:31 +08:00
Chendi.Xue ef5a226819 [PD][HeteroArch]Fix accuracy issue with CPU_ATTN as Decoder and Flash_ATTN as prefiller (#38935) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2026-04-09 11:19:07 +08:00
Chendi.XueandKunshang Ji 92b9afeecd [XPU] Quick fix for TritonMLA to remove cuda hardcode (#39088) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-08 00:17:58 +08:00
Chendi.XueMatthew BonanniNicolò Lucchesi
 		3b1dbaad4e [HMA]Fix corner case when hybrid page_size can not be evenly divided issue (blk_size=64,tp=4) (#37467) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
 2026-03-30 16:47:30 +00:00
Chendi.Xue d72b0be33c [XPU]Fix for Qwen-OMNI crash (#35249) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2026-02-25 07:31:07 -08:00
Chendi.Xue 2b465570e6 [CI][HPU]accelerate hpu test by skip python re-install and clean container name (#33286) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2026-01-30 21:36:29 +00:00
Chendi.Xue 8c8ebeb941 [BUGFIX][XPU] fix memory check after XPU reuse GPU_worker (#33358) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2026-01-29 09:56:30 -08:00
Chendi.Xue 94578127a4 [NIXL] refine decoder side post process for heterogeneous BlockSize and kv_layout (#30275) 2026-01-09 21:22:19 +00:00
Chendi.XueandNicolò Lucchesi 6ca74bc11a [NIXL][BUG FIX] Fix both failing issue and accuracy issue with nixl + host_buffer on CUDA (#30419) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
 2025-12-18 22:10:02 +00:00
Chendi.XueandMark McLoughlin ae2e503dda [NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
 2025-12-14 15:38:28 +00:00
Chendi.Xue 460d02a417 [NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-11-21 08:55:27 -08:00
Chendi.Xue c3e2978620 [NIXL] fix cpu PD after physical <> logical block_size PR (#28904) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-11-18 14:03:23 -05:00
Chendi.XueandNicolò Lucchesi c9e665852a [NIXL] heterogeneous block_size support (#26759) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
 2025-11-14 21:51:32 -08:00
Chendi.Xue 699d62e6cf [NIXL][BUGFIX] delay done_recving queue cleanup to bottom of get_finished (#27297) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-24 17:01:41 +00:00
Chendi.XueandNicolò Lucchesi 7c4767f1eb [NIXL] use Host buffer to support TP_ratio > 1 for XPU (#27140) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
 2025-10-22 15:28:13 +00:00
Chendi.Xue 12e21701e7 [DOC][FEATURES][CPU]update cpu feature for v1 (#27135) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-18 01:10:45 -07:00
Chendi.Xue 509cdc0370 [DOC][XPU]update feature parity with Intel GPU (#26954) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-15 20:07:10 -07:00
Chendi.Xue bfad142e25 [BUGFIX][NIXL] quick fix for 'assert self.connector_worker is not None' in get_kv_connector_stats (#26851) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-15 02:33:25 +00:00
Chendi.Xue 7e6edb1469 [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-14 09:46:05 +00:00
Chendi.Xue 9bb38130cb [Bugfix] Fix GPU_ID issue in test script (#26442) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-12 11:39:05 +00:00
Chendi.Xue 9fc983c707 [NIXL][non-cuda] Add install script for nixl with non-cuda ucx (#25959) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-10-08 14:19:53 +00:00
Chendi.XueandRoger Wang dd96465fd7 [BugFix][QWEN-VL]fix wrong apply_rotary_emb_torch selection introduced by #24642 (#26123) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2025-10-03 08:52:26 -07:00
Chendi.Xue 5774b0a1da [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-09-23 04:17:42 +00:00
Chendi.Xue 6c5f82e5aa [BUG FIX][NON-CUDA]quick fix to avoid call cudagraph_unsafe in attention (#25298) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-09-20 04:41:23 +00:00
Chendi.Xue a6149aa587 [OOT] Support sync_model_loading for OOT (#25126) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-09-19 05:41:53 +00:00
Chendi.Xue 59f3b93636 [DOC] update v1_guide with INTEL HW (#22679) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2025-08-12 01:22:49 -07:00
Chendi.Xue 08d2bd78da [BUGFIX] deepseek-v2-lite failed due to fused_qkv_a_proj name update (#21414) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2025-07-22 20:33:57 -07:00
Chendi.Xue e9534c7202 [CI][HPU] update for v0 deprecate by switching to VLLM_TARGET_DEVICE=empty (#21006) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2025-07-15 20:07:05 -07:00
Chendi.Xue a2f14dc8f9 [CI][Intel Gaudi][vllm-Plugin]Add CI for hpu-plugin-v1-test (#20196) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-07-01 04:17:07 +00:00
Chendi.Xue 5a52f389dd [BUGFIX][DEEPSEEK][MODEL_LOAD] fix w13, w2 weight not initialized assert (#20202) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-06-29 19:46:19 -07:00
Chendi.Xue dec197e3e5 Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2025-06-27 05:48:13 +00:00
Chendi.Xue 7e8977fcd4 [custom_op][vllm-plugin] update custom_op class to use op_registry (#19164) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2025-06-20 07:44:56 -07:00
Chendi.XueandMichal Adamczyk 56a735261c [INTEL-HPU][v0] Port delayed sampling to upstream (#16949) 
Signed-off-by: Michal Adamczyk <michal.adamczyk@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Michal Adamczyk <madamczyk@habana.ai>
 2025-04-22 20:14:11 -07:00
Chendi.Xue 566f10a929 [CI]Fix hpu docker and numpy version for CI (#16355) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-04-09 17:52:26 +00:00
Chendi.XueandMichael Goin 82eb5ea8f3 Benchmark serving structured output (#10880) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2024-12-04 16:28:21 -05:00
Chendi.XueandAaron Pham 381ac93bb5 [Benchmark] Benchmark structured output with datasets (#10557) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
 2024-12-03 17:21:06 -07:00
Chendi.Xue 0a71900bc9 Remove hard-dependencies of Speculative decode to CUDA workers (#10587) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2024-11-26 17:57:11 -08:00
Chendi.Xue 905d0f0af4 [CI/Build] Fix IDC hpu [Device not found] issue (#10384) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2024-11-17 14:58:22 +08:00
Chendi.Xue 8e1529dc57 [CI/Build] Add run-hpu-test.sh script (#10167) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2024-11-09 06:26:52 +00:00