iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
14,683 Commits 3 Branches 0 Tags
42fadebecb79290ad722f33f3094de23b121f33d
Commit Graph
522 Commits
Author SHA1 Message Date
tunglinwood 42fadebecb [Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) 
Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>
 2026-03-10 21:24:48 -07:00
Harry Mellor f83b933b84 [CI] Bump mypy version to 1.19.1 (#36104) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-10 09:18:28 -07:00
AllenDouandzixiao aefc59f088 FunASR model bugfix (#36633) 
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
 2026-03-10 08:14:21 -07:00
Harry Mellor d88f28da05 Fix hf_override_fn when it modifies model_type (#35200) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-10 15:03:18 +00:00
Raushan TurganbayandHarry Mellor 8850738b70 [Bugfix] Fix processor signature (#36630) 
Signed-off-by: raushan <raushan@huggingface.co>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-10 06:20:47 -07:00
Cyrus Leung d62856b928 [Misc] Move processors to transformers_utils (#35953) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-09 11:31:39 +08:00
Nick Hill c7f32e08c2 [BugFix] Avoid ignored trust_remote_code warnings (#36290) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-03-07 01:24:18 +00:00
Isotr0pyandRoger Wang 1d0c0d209c [Misc] Lazy import registered processors (#36024) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-03-06 06:06:45 -08:00
Yanhong Li a911f4dd20 [Model] Add support for OLMo Hybrid (#32550) 2026-03-05 14:51:06 -05:00
Jiayi YanandHarry Mellor 6a895197fa [Bugfix][CI] fix typos (#34934) 
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-05 17:05:46 +00:00
AllenDouzixiaoIsotr0py
 		3ee68590c7 refactor funasr model. (#36108) 
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-03-05 08:07:37 -08:00
Ajay AnuboluandClaude Opus 4.6 ed81d5edd1 [Bugfix] Fix RunAI streamer crash with S3-hosted model paths (#35976) 
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-05 12:14:20 +00:00
Cyrus Leung ead7bde1ab [Bugfix] Make kaldi_native_fbank optional (#35996) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-04 06:47:32 -08:00
Cyrus Leung e379396167 [Refactor] Clean up processor kwargs extraction (#35872) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-03 19:53:53 -08:00
AllenDouzixiaoIsotr0py
 		c1d963403c [model] support FireRedASR2 (#35727) 
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-03-03 19:41:30 -08:00
Fynn Schmitt-Ulms 9433acb8df [Spec Decode] Add hidden states extraction system (#33736) 
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
 2026-03-02 14:29:09 -05:00
Netanel HaberandRoger Wang c8aca0c9e1 Support parakeet as audio encoder for nemotron-nano-vl (#35100) 
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-02-27 11:07:38 -07:00
fort726Sungwan Kimgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>TJian
 		905d76b51d [Model] Add huggingface skt/A.X-K1 model (#32407) 
Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2026-02-27 09:26:02 -08:00
Harry Mellor fbe3f0120a Revert "Add GlmOcrConfig for GLM-OCR model type recognition" (#35512) 2026-02-27 06:13:27 -08:00
Daniel Huang 1a8c71674e [BugFix] Repo utils debug print patch (#35434) 
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
 2026-02-27 03:50:56 +00:00
hujia177 ec8f943db1 Add GlmOcrConfig for GLM-OCR model type recognition (#34982) 2026-02-26 17:04:42 +00:00
Jiangyun Zhu ab87f85231 [Model] Ring 2.5 (#35102) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-02-26 02:17:11 -08:00
Harry Mellor 90fc7f9109 Fix custom processors that use deleted behaviour for Transformers v5 (#35107) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-25 02:36:21 -08:00
Harry Mellor f7967577f5 Remove requirement to use --hf-overrides for DeepseekVLV2ForCausalLM (#35203) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-24 22:00:06 -08:00
Benjamin ChislettShahar MorRoi KorenLucas Wilkinson
 		f5972a872f [Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726) 
Signed-off-by: Shahar Mor <smor@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-02-24 09:49:56 -08:00
Isotr0py d12d201409 [Bugfix] Fix failing FunASR processor test (#35111) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-24 04:13:45 -08:00
Harry Mellor 864167d376 Fix custom processors that use deleted import for Transformers v5 (#35101) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-23 08:38:00 -08:00
Athrael Soju 970861ac0c [New Model] Add ColModernVBERT (#34558) 
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Signed-off-by: athrael-soju <athrael-soju@users.noreply.github.com>
 2026-02-22 12:23:41 +08:00
Kata Coder 5719a4e4e6 [Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574) 
Signed-off-by: craftsangjae <craftsangjae@gmail.com>
 2026-02-20 20:01:40 -08:00
Roger Wang b5475d0534 Revert "[Misc] fix qwen3.5 config" (#34610) 2026-02-16 01:06:05 -08:00
JJJYmmm 9521002f0a [Misc] fix qwen3.5 config (#34604) 2026-02-16 00:25:38 -08:00
Roger Wang 2f186635cb [Bugfix] Fix Qwen3.5 config loading (#34554) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2026-02-14 03:56:11 -08:00
Kata Coder d1ea65d0a1 [new model] add COLQwen3 code & Inference (#34398) 
Signed-off-by: craftsangjae <craftsangjae@gmail.com>
Signed-off-by: katacoder <craftsangjae@gmail.com>
 2026-02-14 12:15:19 +08:00
Christian S. PeroneandCyrus Leung 0ef5b9147b fix: use __annotations__ instead of get_type_hints() for dynamic kwargs detection (#34527) 
Signed-off-by: Christian S. Perone <christian.perone@gmail.com>
Signed-off-by: Christian S. Perone <perone@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-02-13 20:03:37 -08:00
Roger Wang 5885e330ef [Misc] Port Qwen3.5 Configs (#34512) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2026-02-13 05:24:25 -08:00
Ilya Boytsov 071d863e20 Extend ColBERT support to non-standard BERT backbones (#34170) 
Signed-off-by: Ilya Boytsov <ilya.boytsov@aleph-alpha.com>
 2026-02-13 09:53:09 +00:00
myselvess bcf0731aa0 [New Model] support new model ovis2.6 (#34426) 
Signed-off-by: myselvess <23743269+myselvess@users.noreply.github.com>
 2026-02-13 00:12:45 -08:00
baonudesifeizhai f5897613fb Fix Mistral config remap to accept compressed-tensors quantization #34028 (#34104) 
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
 2026-02-12 08:22:06 +00:00
AllenDouandzixiao 21dfb842d7 [model] support FunASR model (#33247) 
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
 2026-02-11 07:37:09 +00:00
JJJYmmmwulipcywang96Isotr0pyIsotr0pyRoger Wang
 		9562912cea [MODEL] Adding Support for Qwen3.5 Models (#34110) 
Signed-off-by: JJJYmmm <1650675829@qq.com>
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wulipc <wulipc@users.noreply.github.com>
Co-authored-by: ywang96 <ywang96@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-02-09 21:12:58 +08:00
Jee Jee Li 978a37c823 [Model] GLM adaptation (#34124) 2026-02-09 17:32:52 +08:00
Jiang Wu 860981d8d8 Make directory exist ok for ray spinning up multiple replicas on a single instance (#33604) 
Signed-off-by: Jiang Wu <jwu@cclgroup.com>
 2026-02-07 05:30:49 -08:00
Raushan TurganbayCyrus LeungHarry Mellor
 		85ee1d962b [Bugfix] Fix models and tests for transformers v5 (#33977) 
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Raushan Turganbay <raushan.turganbay@alumni.nu.edu.kz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-06 21:47:41 +08:00
Isotr0py 87d0d17ab5 [Models] Consolidate Deepseek-OCR2 processor (#33909) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-05 18:29:20 +00:00
Harry Mellor 61e632aea1 Turn @config into a dataclass_transform (#31541) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-03 17:40:59 +00:00
Harry Mellor be8168ff88 Fix Gemma3 GGUF for Transformers v5 (#33683) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-03 12:36:53 +00:00
Lucas Hänke de Cansino dad2d6a590 [Bugfix][Model] Fix DeepSeek-OCR-2 chat template to include BOS token (#33642) 
Signed-off-by: l4b4r4b4b4 <lucas.cansino@mail.de>
 2026-02-03 00:35:58 -08:00
Patrick von Platenandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 5019c59dd2 [Voxtral Realtime] Introduce global log mel max (#33574) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-02 17:01:47 -05:00
REDliuliIsotr0py
 		808dd87b30 [Model] Support DeepSeek-OCR-2 (#33165) 
Signed-off-by: liuli <ll407707@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-02 06:24:10 +00:00
Andy Lo beb8899482 Fix mistral sliding window parsing (#33521) 
Signed-off-by: Andy Lo <andy@mistral.ai>
 2026-02-02 05:08:04 +00:00