iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
20,845 Commits 3 Branches 0 Tags
78300cdabffbaaffe7625ed34412ec2aec75535c
Commit Graph
297 Commits
Author SHA1 Message Date
Jensen ChenandClaude Opus 5 39eba6ac36 [Misc] Use VLLMValidationError in offline inference input validation (#53432) 
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 08:43:51 -07:00
linitra24andJee Jee Li 9b5f3454f2 [LoRA] Avoid false target matches for unsupported module types (#52313) 
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-08-19 16:48:11 +00:00
wang.yuqi eac636a7fa [Frontend] Move api_server.py out openai folder (#52131) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-08-19 09:43:46 +00:00
stefankoncarevic 83ded8d839 [Test][LoRA] Speed up the LoRA test job (#52331) 
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
 2026-08-14 12:08:41 -05:00
linitra24Jee Jee Lilinitra24
 		95c9144424 [LoRA][Gemma4] Support vision tower LoRA (#42662) 
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <joy25810@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: linitra24 <joy25810@gmail.com>
 2026-08-13 22:07:43 +08:00
Andreas KaratzasandOpenAI Codex 1ab2801dde [ROCm] Remove stale SDPA and skinny GEMM workarounds (#50907) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-11 14:19:16 -04:00
Silen NaihinDakai AnJiangyun Zhu
 		b50fdebce0 [Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935) 
Signed-off-by: Silen Naihin <silen.naihin@gmail.com>
Co-authored-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
 2026-08-06 09:13:10 +08:00
bnellnmandHarry Mellor 6e311c6e20 [MoE Refactor] Rename FusedMoE to FusedMoEFactory (#44941) 
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-31 11:28:18 +01:00
Andreas Karatzas 0bb548b60e [CI][ROCm] Stabilize Qwen2-VL LoRA test (#50161) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-29 04:27:45 +00:00
Harry MellorandAndreas Karatzas ca0defa343 Make bare hugging_face imports forbidden (#49726) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-25 04:18:39 -07:00
Aarushi JainAndreas KaratzasAndreas KaratzasOpenAI Codex
 		0ba2aa35a8 Stabilize GPU memory teardown between ROCm CI tests (#49242) 
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-25 04:21:36 +00:00
Chaojun Zhangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 0231dd5467 [BugFix][LoRA] Skip marlin-backend gpt-oss LoRA tests on XPU (#49385) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-24 09:16:00 +08:00
Nicolò Lucchesi 7a98c7a392 [Misc] Remove old now unsupported max_num_partial_prefills and max_long_partial_prefills (#49244) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-21 08:52:52 +00:00
ErenAta16 59b964f37d fix(lora): validate LoRA rank is positive in PEFTHelper (#48437) 
Signed-off-by: ErenAta16 <erena6466@gmail.com>
 2026-07-16 05:22:52 +00:00
qli88 7746961277 [CI] Fix flaky lora test (#47375) 
Signed-off-by: Qiang Li <qiang.li2@amd.com>
Signed-off-by: qli88 <qiang.li2@amd.com>
 2026-07-16 02:23:03 +00:00
Karthik KothuriandClaude 4f7fffb92f [Core][LoRA] Support fp32 lm_head (head_dtype) on the LoRA path (#48525) 
Signed-off-by: Karthik Kothuri <karthikkothuri2009@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-15 09:51:09 +08:00
Micah WilliamsonAndreas Karatzasfxmarty-amdAndreas Karatzas
 		6e073440b1 [ROCm][CI] Remove mxfp4 test skips after amd-quark 0.12 release (#47330) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-15 01:25:05 +00:00
Alejandro Paredes La Torre 9a48eef89a [Bugfix][LoRA] Support ark_linear base layer in _get_lora_device (#47690) 
Signed-off-by: AlejandroParedesLT <alejandroparedeslatorre@gmail.com>
 2026-07-12 00:13:50 +00:00
Ameen PatelClaudemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		392d1b4d2e [BugFix][LoRA] Refresh punica metadata when LoRA slots are reassigned under an unchanged mapping (#47725) 
Signed-off-by: AmeenP <ameenp360@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-07 08:53:55 -07:00
Chaojun Zhang 6569df6a3e [Test][LoRA] Use lightweight CPU reference and skip heavy cleanup in punica ops tests (#47534) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
 2026-07-06 11:29:59 +08:00
Harry Mellor f1445f6dbd [CI] Bump huggingface-hub from v1.10.2 to v1.22.0 (#47551) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-04 07:45:45 -07:00
Jee Jee Li 8f82be5705 [CI/Build] Fix LoRA testing (#47242) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-07-01 15:36:13 +08:00
Micah Williamson c3b1f9e827 [ROCm][CI] Enable LoRA TP Distributed Test Group In AMD CI (#47193) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-30 23:24:32 -07:00
Matt 9036c89ee4 [Hardware][AMD][CI] Patch Whisper multi LoRA test to use TRITON_ATTN for now (#46928) 
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-06-27 17:30:49 -05:00
Jee Jee Li 9f6f296428 [CI/Build] Remove BaiChuanForCausalLM from the LoRA test (#46494) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-23 22:09:48 +08:00
Martin Hickey ccd49f6821 [MyPy] Fix mypy for vllm/lora (#41722) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
 2026-06-22 10:57:09 -04:00
nv-nedelman-1Jee Jee LiJee Jee Li
 		9ea3a4015b [Bugfix] Fix corrupt outputs in MoE FP8 LoRA responses and MoE base model responses when LoRAs are loaded (#42120) 
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-06-18 18:26:09 -07:00
qli88 25faa1f4cc [CI]Enable mxfp4 lora test for ROCm platform (#43802) 
Signed-off-by: Qiang Li <qiang.li2@amd.com>
 2026-06-18 16:59:09 +00:00
Jee Jee LiNick HillWoosuk Kwon
 		eacff17c8d [Model Runner V2][Bugfix] Fix MRV2 LoRA warmup (#35536) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
 2026-06-15 13:17:23 -07:00
Harry Mellor 03878d1c22 Deprecations for v0.23 and v0.24 (#44992) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-11 14:35:38 +00:00
bnellnm dc68bd8c41 [MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184) 
Signed-off-by: Bill Nell <bnell@redhat.com>
 2026-06-08 10:42:58 -04:00
王金旭guanwei-wuCursor
 		0bdfd5eb84 [Bugfix] Vendor MiniCPMV/MiniCPMO processors to unblock Transformers v5 (#44282) 
Signed-off-by: guanwei-wu <b08901019@ntu.edu.tw>
Signed-off-by: wjinxu <1299461899@qq.com>
Co-authored-by: guanwei-wu <b08901019@ntu.edu.tw>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-06-02 07:14:38 -07:00
LucainandClaude Opus 4.6 11dfa3169d Add vLLM library info to Hugging Face Hub requests (#43857) 
Signed-off-by: Wauplin <lucainp@gmail.com>
Signed-off-by: Lucain Pouget <lucain@huggingface.co>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-05-29 14:04:58 +00:00
Jee Jee Li ec5de7fa7d [LoRA] Add one shot triton kernel For MoE LoRA (#42290) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-05-25 19:47:04 -07:00
Jee Jee Li 15f7cd33dc [LoRA] Reduce memory of 2D weights when EP is set (#42737) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-22 06:41:56 -07:00
Jee Jee Ligemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Roger Wang
 		7d5b033782 [LoRA] Support 2D and 3D MoE LoRA adapter at the same time (#42242) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-05-18 15:22:26 +08:00
Nguyễn Thế DuyJee Jee LiJee Jee Li
 		e3aeee5ff8 [Bugfix] moe lora align kernel grid (#40131) 
Signed-off-by: TheDuyIT <nduy250299@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: dtnguyen <dtnguyen@nvidia.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-05-18 00:17:53 -07:00
Jee Jee Li 32b7177909 [LoRA][Bugfix] Dedup LoRA wrapping for modules referenced from multiple attribute paths (MoE gate) (#42757) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-05-16 11:22:35 +08:00
Jee Jee Li 05d610e5cd [CI/Build] Reduce LoRA model tests. (#42266) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-11 14:49:08 +08:00
Jee Jee Li ecd0b60aad [LoRA] Initial EP support for LoRA (#40867) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-09 00:31:23 -07:00
wang.yuqiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 1d694e78c9 [Examples][last/6] Resettle examples. (#41084) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-07 19:42:12 -07:00
Chaojun Zhang 805e9f7b77 [XPU] Fix lora bugs & enable UTs under tests/lora (#38206) 
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
 2026-05-07 05:58:00 -07:00
danisereb d1a75e303d Fix timeout when using LoRA adapters with Nemotron Super (#40916) 
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
 2026-04-30 01:39:49 +08:00
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Jee Jee Li
 		a250f1bd5f [Bugfix] LoRA for DeepSeek V3.2 (#35077) 
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-22 19:33:50 +08:00
Harry MellorkhluuCyrus Leungjiang1.li
 		03f8d3a548 Update to transformers v5 (#30566) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
 2026-04-15 16:29:15 -07:00
Jee Jee Li 715681c127 [LoRA] Support dual CUDA streams-Linear Layer (#35721) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-13 10:57:07 +08:00
ShubyM 92feb9991d [Gemma4][Bugfix]: Enable Gemma4ForCasualLM to load lora adapters correctly (#38844) 
Signed-off-by: ShubyM <shubymishra20@gmail.com>
 2026-04-11 09:06:49 +00:00
wliao2 32e0c0bfa2 refactor hard coded device string in test files under tests/v1 and tests/lora (#37566) 
Signed-off-by: Liao, Wei <wei.liao@intel.com>
 2026-04-03 11:21:47 +08:00
Andreas Karatzas 679c6a3ecc [Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-25 08:17:33 +08:00
Jee Jee Li 1f0d210641 [CI/Build][LoRA] Update Qwen35 LoRA testing (#37816) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-23 12:55:49 +08:00