iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
8,621 Commits 3 Branches 0 Tags
070da660c1bf9e7a7be8b9efeff4b06f91c7342f
Commit Graph
314 Commits
Author SHA1 Message Date
Jiangyun Zhu 625ccd1c4d [Bugfix] Replace custom Encoding class with BatchEncoding in MistralTokenizer (#22786) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2025-08-14 08:09:27 -07:00
Harry Mellor f4efda821d Remove Phi 4 Flash configuration workaround (#22723) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-14 04:03:49 -07:00
22quinn 807d21b80d [BugFix] [Spec Decode] Remove LlamaForCausalLMEagle3 to fix CI (#22611) 
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
 2025-08-11 10:31:36 -07:00
Isotr0py 8e13d9fe6d [Misc] Further clean up some redundant config definitions (#22649) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-08-11 09:22:25 -07:00
danielafrimi 14a5d903ab [Model] NemotronH Support (#22349) 
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
 2025-08-11 04:09:24 -07:00
Harry Mellor c49848396d Refactor sliding window configuration to Transformers best practice (#21927) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-09 20:50:48 -07:00
Le Chen 3d7363e61c [Config] add "qwen" as a native eagle3 target supported model (#22333) 
Signed-off-by: lechen <lecself@163.com>
Signed-off-by: LeChen <lecself@163.com>
 2025-08-09 20:21:05 -07:00
Yuxuan ZhangandIsotr0py a6022e6fbc GLM-4.5V with new class name at transformers (#22520) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-08-09 00:50:21 -07:00
Harry MellorDarkLight1337Isotr0pyIsotr0pyWoosuk Kwon
 		796bae07c5 Update transformers to v4.55 (#21931) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-05 22:56:14 -07:00
Po-Han Huang (NVIDIA) bdcb42e45d [NVIDIA] Auto detect modelopt quant and fix DSR1-FP4 weight loading (#22073) 2025-08-04 21:02:55 -04:00
Isotr0py fed5849d3f [Bugfix] Fix failing GGUF models test (#22174) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-08-04 01:27:02 -07:00
Jee Jee Li a7b8788d2c [Misc] Modify the organization of GLM series (#22171) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-08-03 23:51:20 -07:00
Isotr0py 3dddbf1f25 [Misc] Add tensor schema test coverage for multimodal models (#21754) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-08-03 00:52:14 -07:00
Vadim Gimpelson 58eee5f2e0 [PERF] Use faster way of decode in tokenizer: avoid useless list-to-list conversion (#20000) 
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
 2025-08-02 01:43:52 -07:00
Dipika Sikka dfbc1f8880 [Speculative Decoding] Add speculators config support (#21345) 2025-08-01 08:25:18 -04:00
Cyrus Leung 82de9b9d46 [Misc] Automatically resolve HF processor init kwargs (#22005) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-31 22:44:10 -07:00
Songandoliveryuan 9484641616 [Model] Add step3 vl (#21998) 
Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>
 2025-07-31 23:19:06 +08:00
Cyrus Leung 004203e953 [CI/Build] Fix registry tests (#21934) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-30 09:10:41 -07:00
Cyrus Leung 2ca5f82c2a [Misc] Remove redundant config definitions (#21891) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-29 23:54:18 -07:00
Michard Hugo 25708d317a [Bugfix] Mistral crashes on tool with no description (#21167) 
Signed-off-by: HugoMichard <hugo@harfanglab.fr>
 2025-07-28 08:03:35 -07:00
Cyrus LeungandHarry Mellor 86ae693f20 [Deprecation][2/N] Replace --task with --runner and --convert (#21470) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-27 19:42:40 -07:00
Isotr0py eed2f463b2 [VLM] Support HF format Phi-4-MM model (#17121) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-26 20:07:57 -07:00
Reid 05c1126f29 [Misc] remove unused try-except in pooling config check (#21618) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-26 12:20:03 +00:00
Farzad AbdolhosseiniandPatrick Li 62965de5fe [Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) 
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>
 2025-07-25 18:12:31 -07:00
Kebe 7311f74468 [Bugfix] GGUF: fix AttributeError: 'PosixPath' object has no attribute 'startswith' (#21579) 
Signed-off-by: Kebe <mail@kebe7jun.com>
 2025-07-25 03:42:23 -07:00
Julien Denize 6d8d0a24c0 Add think chunk (#21333) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
 2025-07-23 21:51:32 -07:00
Isotr0py 4ecedd1806 [Bugfix] Fix nightly transformers CI failure (#21427) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-23 00:01:01 -07:00
Cyrus Leung 378d33c392 [Bugfix] Fix missing placeholder in logger debug (#21280) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-20 22:50:06 -07:00
김종곤 3e04107d97 [Model] EXAONE 4.0 model support (#21060) 
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
 2025-07-19 14:25:44 +08:00
Woosuk Kwon dd572c0ab3 [V0 Deprecation] Remove V0 Spec Decode workers (#21152) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-18 21:47:50 -07:00
wang.yuqi 5895afd780 [Bugfix] The special_tokens in tokenizer should also be controlled by do_lower_case in encoder_config. (#20750) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-18 09:10:47 +00:00
kYLeandCyrus Leung 4ef00b5cac [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) 
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-17 03:07:55 -07:00
Harry Mellor a931b4cdcf Remove Qwen Omni workaround that's no longer necessary (#21057) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-16 16:25:23 +00:00
Cyrus Leung 1c3198b6c4 [Model] Consolidate pooler implementations (#20927) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-16 13:39:13 +00:00
Patrick von PlatenandCyrus Leung e7e3e6d263 Voxtral (#20970) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-15 07:35:30 -07:00
Isotr0py 3fc964433a [Misc] Clean up Aimv2 config registration in Ovis config (#20921) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-14 15:36:43 +00:00
Chauncey a4851cfe68 [Bugfix]: Fix messy code when using logprobs (#20910) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-14 11:06:45 +00:00
Wang Siyuan 247102f07f [Bugfix] Fix: add patch_rope_scaling after hf override (#20857) 
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
 2025-07-13 00:13:25 -07:00
Harry Mellor 3482fd7e4e [Doc] Add engine args back in to the docs (#20674) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-10 08:02:40 -07:00
Chauncey 93b9d9f499 [Bugfix]: Fix messy code when using logprobs (#19209) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-08 11:02:15 +08:00
Patrick von Platen 14601f5fba [Config] Refactor mistral configs (#20570) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2025-07-07 15:25:10 -07:00
Cyrus Leung c18b3b8e8b [Bugfix] Add use_cross_encoder flag to use correct activation in ClassifierPooler (#20527) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-06 14:01:48 -07:00
Jee Jee Li 1caca5a589 [Misc] Add SPDX-FileCopyrightText (#20428) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-04 07:40:42 +00:00
Seiji Eicher 8d1096e7db [Bugfix] Register reducer even if transformers_modules not available (#19510) 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
 2025-07-03 22:08:12 +00:00
Isotr0py 71d6de3a26 [Misc] Clean up InternVL family config registration (#19992) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-03 20:01:47 +00:00
rongfu.leng 139508a418 [Misc] add handler HF_TOKEN is emptry string (#20369) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-07-02 09:14:31 -07:00
Ning Xie 2f1c19b245 [CI] change spell checker from codespell to typos (#18711) 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
 2025-06-11 19:57:10 -07:00
Li WangandJee Jee Li 1efef71645 [Bugfix] Fix modelscope token passed in (#19389) 
Signed-off-by: wangli <wangli858794774@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-06-10 13:39:37 +08:00
wang.yuqi 2ffb9b6e07 [Bugfix] model_max_length should consider max_model_len in tokenizer_config (#19201) 2025-06-08 07:17:53 -07:00
Luis VegaandLuis Vega cb6d572e85 [Model] NemotronH support (#18863) 
Signed-off-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
Co-authored-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
 2025-06-05 21:29:28 +00:00