455 Commits
Author SHA1 Message Date
Rémi Delhaye 3c13653738 [Frontend] Score with the chat template declared by Sentence Transformers CrossEncoders (#60877)
Signed-off-by: rdlhio <contact@rdlh.io>
2026-10-18 11:30:12 +00:00
alpandmottopanikeiku 4ab99ff136 [Bugfix][Frontend] Honor the constructor chat template in offline scoring (#61990)
Signed-off-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
Co-authored-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
2026-10-16 10:20:46 +00:00
Xunzhuo 766c837bd5 [Model] Support every Decision 3.0 size (d3-flash, d3-mini, d3-nano, d3-lite, d3-edge) (#61778)
Signed-off-by: Xunzhuo Liu <xunzhuo.liu@amd.com>
2026-10-15 13:29:24 +00:00
TimofeyandCodex 716c5225ae [Model] Add AliceAI support (#57963)
Signed-off-by: timka <timka.byzov@yandex.ru>
Co-authored-by: Codex <noreply@openai.com>
2026-10-15 10:15:03 +00:00
Misha GoinandClaude Opus 5.5 1c4c319792 [Frontend] Advertise --enable-x/--disable-x for boolean CLI flags (#61479)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 01:08:02 -07:00
Haiyu ZuoandKevin H. Luu ff5a91a456 [Feature][Model Loader] Apply model-owned MTP shard selection to RunAI ModelStreamer (#60759)
Signed-off-by: 浩韵 <zuohaiyu.zhy@alibaba-inc.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
2026-10-15 12:23:11 +08:00
Xunzhuo 89cab55086 [Model] Support Decision 3.0 decision models (vllm-sr/d3) (#61565)
Signed-off-by: Xunzhuo Liu <xunzhuo.liu@amd.com>
2026-10-14 17:10:55 +00:00
Lazurite 23fbc2ec2f [Model] Support precomputed image embeddings for LightOnOCR (#61585)
Signed-off-by: Rapisurazurite <43494437+Rapisurazurite@users.noreply.github.com>
2026-10-14 10:54:09 +00:00
wang.yuqi 6ecb39eaa7 [Docs] Update structured decisions docs. (#61588)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
2026-10-14 10:28:22 +00:00
698e79f3bd [Model] Kolibri 1 via the Transformers modeling backend (#60827)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-10-13 22:17:52 +01:00
Linze Shi e6e84f350c [Feature][Pooling] Add offline fixed-length late chunking (#60164)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
2026-10-13 11:16:21 +00:00
Hoai VoandClaude Opus 5.5 f3cb10b690 [Model][LoRA] Enable LoRA support for BERT and RoBERTa embedding models (#61033)
Signed-off-by: hoaivoke <vokehoai@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 14:09:53 +00:00
tc-mbandCyrus Leung c85616efc6 [Model] Support MiniCPM-V 4.7 (#58674)
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-10-11 10:21:10 +00:00
wang.yuqi c1692c85f1 [Misc] mv chat_utils.py to renderers. (#60522)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
2026-10-10 06:50:34 +00:00
Abhijit Roy 970dc63478 [Docs] Add Giga-Embeddings bidirectional Qwen3 usage to embed docs (#60854)
Signed-off-by: Abhijit <abroy@redhat.com>
2026-10-09 14:41:38 +00:00
Rémi Delhaye a1cd0ec650 [Model] Add zerank-2 reranker (#60415)
Signed-off-by: rdlhio <contact@rdlh.io>
2026-10-09 03:01:51 +00:00
Sohaib Ahmed 64cb683842 [Model] Add Nemotron 3.5 ASR transcription support (#59827)
Signed-off-by: Sohaib-Ahmed21 <sohaibahmed1919@gmail.com>
2026-10-05 16:28:09 +00:00
Jee Jee Li f9c9e8ac24 [LoRA] Remove tensorizer (#60024)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-10-05 07:01:56 -07:00
34051ad714 feat: Add video support for the Transformers backend (#57441)
pre-commit / pre-run-check (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-10-05 00:51:15 -07:00
Harry MellorandClaude Opus 5.5 6e4efafc6e [Model] Migrate GPT-NeoX, Phi, Seed-OSS and Jais2 to the Transformers modeling backend (#59701)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-02 11:18:35 +00:00
Harry MellorandClaude Opus 5.5 8faacd707f [Model] Migrate Glm, Arcee, CWM and Mellum to the Transformers modeling backend (#59679)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-02 03:15:14 +00:00
Louie Tsai ccfd1cea75 [CPU] Include vLLM Recipes tooling in release image to deploy models using vLLM Recipes (#58796)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
2026-09-28 16:46:53 +08:00
jz-yoloandjz-yolo 4a190dc518 [Model] Enable LoRA support for RobertaForSequenceClassification (#58884)
Signed-off-by: jz-yolo <jz-yolo@users.noreply.github.com>
Signed-off-by: Jane Zhu <jane.zhu@slack-corp.com>
Co-authored-by: jz-yolo <jz-yolo@users.noreply.github.com>
2026-09-28 03:50:12 +00:00
Harry MellorandClaude Opus 5.5 d881812500 [Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-24 14:14:10 +00:00
CBPandMisha Goin f9ad9dd6b4 Doc: add DiffusionGemma to supported models (#46466)
Signed-off-by: Bruce <Bruce798858117@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
2026-09-23 17:14:30 +00:00
LucainandClaude Opus 5 6b858751f6 [docs] Fix legacy hf CLI references (vllm) (#57958)
Signed-off-by: Wauplin <lucainp@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-21 15:32:27 +00:00
linitra24 ca542ee154 [Model][LoRA] Enable LoRA support for ModernBertModel (#57148)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
2026-09-16 14:16:09 +00:00
danisereb a31ec3a68b [LoRA][Nemotron] Add LoRA support for Nemotron VL models (for the language model only) (#56231)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
2026-09-15 21:20:28 -07:00
b3124a8237 [Model] Add support for Nanbeige4.2 (transformers backend) (#56071)
Signed-off-by: zqlcode <lizongqiang@kanzhun.com>
Signed-off-by: zql <37731799+zqlcode@users.noreply.github.com>
Co-authored-by: zqlcode <lizongqiang@kanzhun.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-14 15:06:01 +00:00
linitra24 dd4c841070 [LoRA] Add LoRA support for DeepSeek-V4 Flash Vision (#55897)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
2026-09-13 07:10:54 -07:00
zexplorerhjCodexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
fe26c705f7 [Model] Add Bailing V3 VL support (#55921)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-10 02:46:56 -07:00
e473e9036f [Docs][Models] Use the official FunASR Nano vLLM checkpoint (#54944)
Signed-off-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
Co-authored-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-05 00:29:49 -07:00
Thomas OrtnerandHarry Mellor 8ad2076c4a [Transformers backend] Find attention with a fuser and attach vLLM's layer to it (#54941)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-04 16:26:01 +00:00
Bowen Tan 1f76efaa21 [Model] Add K2-Horizon model support (#55063) 2026-09-03 01:17:08 -07:00
Isotr0py 1356635d83 [New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support (#54566)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-02 11:09:09 -07:00
Eli Nabro Yeongmin OhandCodex cdefd9d499 [Bugfix] Support Sentence Transformers 5.4+ serialized configs (#54533)
Signed-off-by: maireneu <maireneu@gmail.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-01 15:53:38 +00:00
b2f685834a [Hy4] support Hy4-preview model (#54160)
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: russellfeng <russellfeng@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-08-29 12:07:28 +08:00
Louie Tsai 79651d6085 [Tools][Recipes] Improve sweep recommendations and short-alias parsing (#53946)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
2026-08-27 06:58:23 +00:00
Yan Ma 10ade93979 [XPU] update key supported models (#53494)
Signed-off-by: Yan Ma <yan.ma@intel.com>
2026-08-25 15:10:48 +00:00
48d7132962 [Model] Migrate FlexOlmo, Olmo3 and Hunyuan V1/VL to the Transformers modeling backend (#53615)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-08-24 22:39:05 -07:00
7ca336929c [Model] Remove ten deprecated model architectures (#53608)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 17:06:00 -07:00
Louie Tsai cc40c3673b [Xeon][doc]add Xeon recipes into table (#53226)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
2026-08-24 06:42:28 +00:00
Kevin H. LuuandAndreas Karatzas e3f6026503 Revert "Remove native Hunyuan V1 and VL implementations" (#53296)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-21 13:39:58 -07:00
Tiezhen WANGandOpenAI Codex d53b1c2efc Remove native Hunyuan V1 and VL implementations (#53272)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-21 09:07:10 -07:00
3130573630 [Model] Add GraniteSWA and GraniteMoeSWA via existing Granite (#52706)
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-18 20:32:46 -07:00
karthik 241ff8c443 [Model] Enable LoRA support for tower and connector in LlavaNextForConditionalGeneration (#49788)
Signed-off-by: gangula-karthik <gkarthik923@gmail.com>
2026-08-18 15:53:49 +00:00
OlaandOpenAI Codex 95901ce70a fix(pooling): validate BGE-M3 combined task ownership (#51823)
Signed-off-by: Zhe Li <2843409461@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-17 10:30:35 +00:00
Yiting Jiang 502af5ed00 [Doc] Add MatrixHub as a model loading source (#50492)
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
2026-08-17 02:32:23 +00:00
Jee Jee Li 69e0e58da1 [Doc] Update model support information (#52289)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-08-14 09:47:30 +00:00
95c9144424 [LoRA][Gemma4] Support vision tower LoRA (#42662)
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <joy25810@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: linitra24 <joy25810@gmail.com>
2026-08-13 22:07:43 +08:00