Cyrus Leung
dbf4b89cf2
[Misc] Remove unnecessary Transformers version guards ( #57556 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-09-18 15:01:35 +00:00
44dd18fe0b
[Model][Gemma4] Load Weights with AutoWeightsLoader ( #55911 )
...
Signed-off-by: Josephasafg <ajgard7@gmail.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-18 12:07:30 +00:00
Harry Mellor and Claude Opus 5
651a88c09a
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings ( #57212 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 10:57:24 -07:00
Harry Mellor and Claude Opus 5
8c1557a79c
Add pydocstyle to the ruff rules ( #52136 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Harry Mellor <hej.mellor@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 16:44:29 +00:00
linitra24 and Jee Jee Li
c81eb3e69c
[LoRA] Support modules_to_save for sequence classification ( #53555 )
...
Signed-off-by: linitra24 <Joy25810@foxmail.com >
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-09-16 07:15:42 -07:00
03dc26e639
[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization ( #53793 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Signed-off-by: ElizaWszola <ewszola@redhat.com >
Signed-off-by: snordmann <snordmann@nvidia.com >
Co-authored-by: mgoin <mgoin64@gmail.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
Co-authored-by: ElizaWszola <ewszola@redhat.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-14 10:26:15 -07:00
Kushal
b5d4186300
[Bugfix][LoRA] Use stored rsLoRA scaling factor in MoE expert packing ( #55548 )
...
Signed-off-by: Kushal <72650064+kushaldabbe@users.noreply.github.com >
2026-09-11 03:52:33 +00:00
Roderick Wu and mgoin
2c9d68f80b
[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering ( #54809 )
...
Signed-off-by: Roderick-Wu <roderickwu2003@gmail.com >
Signed-off-by: Roderick Wu <roderickwu2003@gmail.com >
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: mgoin <mgoin64@gmail.com >
2026-09-08 12:45:12 -07:00
Jensen Chen and Claude Opus 5
39eba6ac36
[Misc] Use VLLMValidationError in offline inference input validation ( #53432 )
...
Signed-off-by: Jensen Chen <a1043904820@gmail.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 08:43:51 -07:00
linitra24 and Jee Jee Li
9b5f3454f2
[LoRA] Avoid false target matches for unsupported module types ( #52313 )
...
Signed-off-by: linitra24 <Joy25810@foxmail.com >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-08-19 16:48:11 +00:00
wang.yuqi
eac636a7fa
[Frontend] Move api_server.py out openai folder ( #52131 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-08-19 09:43:46 +00:00
stefankoncarevic
83ded8d839
[Test][LoRA] Speed up the LoRA test job ( #52331 )
...
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com >
2026-08-14 12:08:41 -05:00
95c9144424
[LoRA][Gemma4] Support vision tower LoRA ( #42662 )
...
Signed-off-by: bk-201 <joy25810@foxmail.com >
Signed-off-by: linitra24 <Joy25810@foxmail.com >
Signed-off-by: linitra24 <joy25810@gmail.com >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
Co-authored-by: linitra24 <joy25810@gmail.com >
2026-08-13 22:07:43 +08:00
Andreas Karatzas and OpenAI Codex
1ab2801dde
[ROCm] Remove stale SDPA and skinny GEMM workarounds ( #50907 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-11 14:19:16 -04:00
b50fdebce0
[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True ( #39935 )
...
Signed-off-by: Silen Naihin <silen.naihin@gmail.com >
Co-authored-by: Dakai An <dakaian108@gmail.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-08-06 09:13:10 +08:00
bnellnm and Harry Mellor
6e311c6e20
[MoE Refactor] Rename FusedMoE to FusedMoEFactory ( #44941 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-31 11:28:18 +01:00
Andreas Karatzas
0bb548b60e
[CI][ROCm] Stabilize Qwen2-VL LoRA test ( #50161 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-07-29 04:27:45 +00:00
Harry Mellor and Andreas Karatzas
ca0defa343
Make bare hugging_face imports forbidden ( #49726 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-07-25 04:18:39 -07:00
0ba2aa35a8
Stabilize GPU memory teardown between ROCm CI tests ( #49242 )
...
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com >
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-07-25 04:21:36 +00:00
Chaojun Zhang and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
0231dd5467
[BugFix][LoRA] Skip marlin-backend gpt-oss LoRA tests on XPU ( #49385 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-07-24 09:16:00 +08:00
Nicolò Lucchesi
7a98c7a392
[Misc] Remove old now unsupported max_num_partial_prefills and max_long_partial_prefills ( #49244 )
...
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai >
2026-07-21 08:52:52 +00:00
ErenAta16
59b964f37d
fix(lora): validate LoRA rank is positive in PEFTHelper ( #48437 )
...
Signed-off-by: ErenAta16 <erena6466@gmail.com >
2026-07-16 05:22:52 +00:00
qli88
7746961277
[CI] Fix flaky lora test ( #47375 )
...
Signed-off-by: Qiang Li <qiang.li2@amd.com >
Signed-off-by: qli88 <qiang.li2@amd.com >
2026-07-16 02:23:03 +00:00
Karthik Kothuri and Claude
4f7fffb92f
[Core][LoRA] Support fp32 lm_head (head_dtype) on the LoRA path ( #48525 )
...
Signed-off-by: Karthik Kothuri <karthikkothuri2009@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-07-15 09:51:09 +08:00
6e073440b1
[ROCm][CI] Remove mxfp4 test skips after amd-quark 0.12 release ( #47330 )
...
Signed-off-by: Micah Williamson <micah.williamson@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Co-authored-by: fxmarty-amd <felmarty@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-07-15 01:25:05 +00:00
Alejandro Paredes La Torre
9a48eef89a
[Bugfix][LoRA] Support ark_linear base layer in _get_lora_device ( #47690 )
...
Signed-off-by: AlejandroParedesLT <alejandroparedeslatorre@gmail.com >
2026-07-12 00:13:50 +00:00
392d1b4d2e
[BugFix][LoRA] Refresh punica metadata when LoRA slots are reassigned under an unchanged mapping ( #47725 )
...
Signed-off-by: AmeenP <ameenp360@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-07-07 08:53:55 -07:00
Chaojun Zhang
6569df6a3e
[Test][LoRA] Use lightweight CPU reference and skip heavy cleanup in punica ops tests ( #47534 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
2026-07-06 11:29:59 +08:00
Harry Mellor
f1445f6dbd
[CI] Bump huggingface-hub from v1.10.2 to v1.22.0 ( #47551 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-04 07:45:45 -07:00
Jee Jee Li
8f82be5705
[CI/Build] Fix LoRA testing ( #47242 )
...
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
2026-07-01 15:36:13 +08:00
Micah Williamson
c3b1f9e827
[ROCm][CI] Enable LoRA TP Distributed Test Group In AMD CI ( #47193 )
...
Signed-off-by: Micah Williamson <micah.williamson@amd.com >
2026-06-30 23:24:32 -07:00
Matt
9036c89ee4
[Hardware][AMD][CI] Patch Whisper multi LoRA test to use TRITON_ATTN for now ( #46928 )
...
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com >
2026-06-27 17:30:49 -05:00
Jee Jee Li
9f6f296428
[CI/Build] Remove BaiChuanForCausalLM from the LoRA test ( #46494 )
...
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
2026-06-23 22:09:48 +08:00
Martin Hickey
ccd49f6821
[MyPy] Fix mypy for vllm/lora ( #41722 )
...
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
2026-06-22 10:57:09 -04:00
9ea3a4015b
[Bugfix] Fix corrupt outputs in MoE FP8 LoRA responses and MoE base model responses when LoRAs are loaded ( #42120 )
...
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-06-18 18:26:09 -07:00
qli88
25faa1f4cc
[CI]Enable mxfp4 lora test for ROCm platform ( #43802 )
...
Signed-off-by: Qiang Li <qiang.li2@amd.com >
2026-06-18 16:59:09 +00:00
eacff17c8d
[Model Runner V2][Bugfix] Fix MRV2 LoRA warmup ( #35536 )
...
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai >
2026-06-15 13:17:23 -07:00
Harry Mellor
03878d1c22
Deprecations for v0.23 and v0.24 ( #44992 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-06-11 14:35:38 +00:00
bnellnm
dc68bd8c41
[MoE Refactor] FusedMoE/MoERunner inversion refactor ( #41184 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
2026-06-08 10:42:58 -04:00
0bdfd5eb84
[Bugfix] Vendor MiniCPMV/MiniCPMO processors to unblock Transformers v5 ( #44282 )
...
Signed-off-by: guanwei-wu <b08901019@ntu.edu.tw >
Signed-off-by: wjinxu <1299461899@qq.com >
Co-authored-by: guanwei-wu <b08901019@ntu.edu.tw >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-02 07:14:38 -07:00
Lucain and Claude Opus 4.6
11dfa3169d
Add vLLM library info to Hugging Face Hub requests ( #43857 )
...
Signed-off-by: Wauplin <lucainp@gmail.com >
Signed-off-by: Lucain Pouget <lucain@huggingface.co >
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
2026-05-29 14:04:58 +00:00
Jee Jee Li
ec5de7fa7d
[LoRA] Add one shot triton kernel For MoE LoRA ( #42290 )
...
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
2026-05-25 19:47:04 -07:00
Jee Jee Li
15f7cd33dc
[LoRA] Reduce memory of 2D weights when EP is set ( #42737 )
...
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
2026-05-22 06:41:56 -07:00
7d5b033782
[LoRA] Support 2D and 3D MoE LoRA adapter at the same time ( #42242 )
...
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io >
2026-05-18 15:22:26 +08:00
e3aeee5ff8
[Bugfix] moe lora align kernel grid ( #40131 )
...
Signed-off-by: TheDuyIT <nduy250299@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Signed-off-by: dtnguyen <dtnguyen@nvidia.com >
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-05-18 00:17:53 -07:00
Jee Jee Li
32b7177909
[LoRA][Bugfix] Dedup LoRA wrapping for modules referenced from multiple attribute paths (MoE gate) ( #42757 )
...
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
2026-05-16 11:22:35 +08:00
Jee Jee Li
05d610e5cd
[CI/Build] Reduce LoRA model tests. ( #42266 )
...
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
2026-05-11 14:49:08 +08:00
Jee Jee Li
ecd0b60aad
[LoRA] Initial EP support for LoRA ( #40867 )
...
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
2026-05-09 00:31:23 -07:00
wang.yuqi and gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1d694e78c9
[Examples][last/6] Resettle examples. ( #41084 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: wang.yuqi <noooop@126.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-05-07 19:42:12 -07:00
Chaojun Zhang
805e9f7b77
[XPU] Fix lora bugs & enable UTs under tests/lora ( #38206 )
...
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com >
2026-05-07 05:58:00 -07:00
Cyrus Leung