iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
7,999 Commits 3 Branches 0 Tags
7728dd77bb802e1876012eb264df4d2fa2fc6f3c
Commit Graph
1181 Commits
Author SHA1 Message Date
Farzad AbdolhosseiniandPatrick Li 62965de5fe [Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) 
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>
 2025-07-25 18:12:31 -07:00
mgazzandCyrus Leung e189b50f53 Add support for Prithvi in Online serving mode (#21518) 
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-25 07:01:27 -07:00
bigshanedogg 29c6fbe58c [MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931) 
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
 2025-07-25 06:05:42 -07:00
xyxinyangandzhouchong c72f049cb4 [Model] Fix Ernie4.5MoE e_score_correction_bias parameter (#21586) 
Signed-off-by: zhouchong <zhouchong03@baidu.com>
Co-authored-by: zhouchong <zhouchong03@baidu.com>
 2025-07-25 06:02:53 -07:00
Cyrus Leung 46d81d6951 [V1] Get supported tasks from model runner instead of model config (#21585) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-25 05:36:45 -07:00
Jee Jee Li 5c3f2628d5 [Quantization] Enable BNB support for more MoE models (#21370) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-25 03:57:34 -07:00
hfan fde60ee775 [Model] Fix a check for None but the return value was empty list in Gemma3 MM vision_embeddings (#21479) 
Signed-off-by: Hongmin Fan <fanhongmin@google.com>
 2025-07-25 13:46:06 +08:00
Jason Gu b38bc652ac [Model] Support tensor parallel for timm ViT in Deepseek_vl2 (#21494) 
Signed-off-by: wzqd <1057337859@qq.com>
 2025-07-24 22:45:16 -07:00
Benji Beck 965bc71b04 Integrate TensorSchema with shape validation for Phi3VImagePixelInputs (#21232) 
Signed-off-by: Benji Beck <benjibeck@meta.com>
 2025-07-24 21:43:52 -07:00
Yuxuan Zhang 2ce90e5b01 Fix GLM-4 PP Missing Layer When using with PP. (#21531) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
 2025-07-24 20:07:38 -07:00
Harry Mellor 13abd0eaf9 [Model] Officially support Emu3 with Transformers backend (#21319) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-24 03:22:12 -07:00
Yuxuan Zhang 85bda9e7d0 remove GLM-4.5 quantization wrong Code (#21435) 2025-07-24 01:52:43 -07:00
Harry Mellor dde295a934 Deduplicate Transformers backend code using inheritance (#21461) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-24 00:16:23 -07:00
Christian Pinto 8560a5b258 [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) 
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
 2025-07-23 11:00:23 -07:00
Asher 2671334d45 [Model] add Hunyuan V1 Dense Model support. (#21368) 
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
 2025-07-23 03:54:08 -07:00
youkaichao 2f5c14de6a add clear messages for deprecated models (#21424) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-07-23 00:03:16 -07:00
Isotr0py 4ecedd1806 [Bugfix] Fix nightly transformers CI failure (#21427) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-23 00:01:01 -07:00
Chendi.Xue 08d2bd78da [BUGFIX] deepseek-v2-lite failed due to fused_qkv_a_proj name update (#21414) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2025-07-22 20:33:57 -07:00
Harry Mellor f154bb9ff0 Simplify weight loading in Transformers backend (#21382) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-22 20:29:43 -07:00
Aritra Roy Gosthipaty 2226d5bd85 [Bugfix] Decode Tokenized IDs to Strings for hf_processor in llm.chat() with model_impl=transformers (#21353) 
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>
 2025-07-22 08:27:28 -07:00
Raushan Turganbay f38ee34a0a [feat] Enable mm caching for transformers backend (#21358) 
Signed-off-by: raushan <raushan@huggingface.co>
 2025-07-22 08:18:46 -07:00
Mickaël Seznecandmgoin 4fb56914c5 [perf] Add fused MLA QKV + strided layernorm (#21116) 
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2025-07-22 07:07:44 -07:00
Raghav RavishankarandJee Jee Li 82b8027be6 Add arcee model (#21296) 
Signed-off-by: alyosha-swamy <raghav@arcee.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-22 00:57:43 -07:00
Cyrus Leung 042af0c8d3 [Model][1/N] Support multiple poolers at model level (#21227) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-21 02:22:21 -07:00
Raushan TurganbayIsotr0pyIsotr0pyCyrus Leung
 		9499e26e2a [Model] Support VLMs with transformers backend (#20543) 
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-20 13:25:50 +00:00
Calvin Chen 51ba839555 [Model] use AutoWeightsLoader for bart (#18299) 
Signed-off-by: calvin chen <120380290@qq.com>
 2025-07-20 08:15:50 +00:00
Yuxuan ZhangIsotr0pyLu Fang
 		10eb24cc91 GLM-4 Update (#20736) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>
 2025-07-19 22:40:31 +00:00
Woosuk Kwon 752c6ade2e [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-19 13:53:17 -07:00
Thomas Parnell 881e3cbe3b [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-07-19 19:27:21 +00:00
김종곤 3e04107d97 [Model] EXAONE 4.0 model support (#21060) 
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
 2025-07-19 14:25:44 +08:00
Woosuk Kwon dd572c0ab3 [V0 Deprecation] Remove V0 Spec Decode workers (#21152) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-18 21:47:50 -07:00
Jee Jee Li 466e878f2a [Quantization] Enable BNB support for more MoE models (#21100) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-18 17:52:02 -07:00
Rui Qiao 217937221b Elastic Expert Parallel Initial Support (#20775) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-18 17:46:09 -07:00
Thomas Parnell ed8cbfedf8 Let GraniteMoeAttention use YaRN (#21174) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-07-18 05:52:52 -07:00
Cyrus Leung 45badd05d0 [Core] Set pooling params based on task and model (#21128) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-18 05:41:17 -07:00
wang.yuqi ca4eb82bcb [Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-18 07:15:07 +00:00
Jee Jee Li a3a6c695f4 [Misc] Qwen MoE model supports LoRA (#20932) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-17 18:32:52 +00:00
Cyrus Leung 90bd2ab6e3 [Model] Update pooling model interface (#21058) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-17 16:05:40 +00:00
kYLeandCyrus Leung 4ef00b5cac [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) 
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-17 03:07:55 -07:00
Jee Jee Li c5b8b5953a [Misc] Fix PhiMoE expert mapping (#21085) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-17 05:47:49 +00:00
Cyrus Leung ac2bf41e53 [Model] Remove model sampler (#21059) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-16 19:03:37 +00:00
Avshalom Manevich a0f8a79646 [fix] fix qwen image_embeds input (#21049) 
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
 2025-07-16 15:17:20 +00:00
Cyrus Leung 1c3198b6c4 [Model] Consolidate pooler implementations (#20927) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-16 13:39:13 +00:00
zhiweizandqizixi c11013db8b [Meta] Llama4 EAGLE Support (#20591) 
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>
 2025-07-15 21:14:15 -07:00
Peter Pan 1eb2b9c102 [CI] update typos config for CI pre-commit and fix some spells (#20919) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
 2025-07-15 21:12:40 -07:00
Michael Goin f46098335b [Bugfix] Fix Mistral3 support on SM100/SM120 (#20998) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-15 20:08:41 -07:00
Brayden Zhong 75a99b98bf [Chore] Remove outdated transformers check (#20989) 
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-07-15 19:42:40 -07:00
Thomas Parnell 6cbc4d4bea [Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-07-15 19:19:10 -07:00
Patrick von PlatenandCyrus Leung e7e3e6d263 Voxtral (#20970) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-15 07:35:30 -07:00
Thomas Parnell 3534c39a20 [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-07-15 04:04:35 -07:00