MOVZX and Hinata
e61dcb9143
[Mini-vLLM] SM86-only cut: models, backends, Rust, tests
...
- Keep only Qwen3.5, Qwen3.5-MTP and Qwen4Exp model paths; trim the model registry to 41 entries
- Delete idle attention backends (MLA, FlashInfer, ROCm-only, quant backends) and dead GDN CuTeDSL kernels
- Remove inc/quark quant loaders; keep compressed-tensors and Marlin
- Drop the Rust frontend, pooling entrypoints, and idle test suites
- Rebuild kernels for sm_80;sm_86 and strip the extensions
- Verified: full import sweep clean (optional deps only) and a dummy-load Qwen3.5 engine run on RTX 3090 via the Triton GDN path
Co-authored-by: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-10-18 19:19:56 +07:00
Vadim Gimpelson and Claude
ec8b20fbf0
[Bugfix] Fix Gemma 4 encoder CUDA graph capture OOM at startup ( #61365 )
...
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-10-17 11:04:49 +00:00
b965ee564d
[Chore] Use upstream Transformers DeepseekV4Config ( #61392 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com >
2026-10-15 01:08:08 -07:00
d1d8e6c096
[Perf][Nemotron-Parse] Do image rescale/normalize on the device ( #60500 )
...
Signed-off-by: DiegoCao <DiegoCao@users.noreply.github.com >
Co-authored-by: DiegoCao <DiegoCao@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-14 18:33:22 +00:00
Lazurite
23fbc2ec2f
[Model] Support precomputed image embeddings for LightOnOCR ( #61585 )
...
Signed-off-by: Rapisurazurite <43494437+Rapisurazurite@users.noreply.github.com >
2026-10-14 10:54:09 +00:00
wang.yuqi
669f85e686
[Misc] Break chat_utils into more maintainable modules. ( #60972 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-10-13 15:08:07 +00:00
092c35dd15
[Model] Support Cloudflare/clef-omni on /v1/systemone ( #61064 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-10-12 21:27:34 +08:00
MatthewCYM
f7a3a7265f
[Bugfix][Multimodal] Fix Qwen3-ASR audio preprocessing parity ( #57146 )
...
Signed-off-by: MatthewCYM <chenyiming0v0@gmail.com >
2026-10-12 10:42:51 +00:00
Bruno Volpato and Codex
61f084b5f3
[Bugfix][Multimodal] Fix per-video cache option reuse ( #55203 )
...
Signed-off-by: bvolpato <brunocvcunha@gmail.com >
Co-authored-by: Codex <noreply@openai.com >
2026-10-11 06:21:55 +00:00
wang.yuqi
c1692c85f1
[Misc] mv chat_utils.py to renderers. ( #60522 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-10-10 06:50:34 +00:00
Harry Mellor and Claude Opus 5.5
2c99ee9333
[Chore] Remove vendored code made redundant by Transformers 5.16.1 ( #60623 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 09:29:03 +00:00
cjackal
0e468adb43
[Model] Extend device-side mm normalization to Kimi K2.5 / K3 ( #59278 )
...
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com >
2026-10-05 21:28:13 +08:00
34051ad714
feat: Add video support for the Transformers backend ( #57441 )
...
pre-commit / pre-run-check (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-10-05 00:51:15 -07:00
Harry Mellor and Claude Opus 5.5
5d20979fc9
[Misc] Remove code paths for Transformers < 5.16.1 ( #59762 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-02 11:17:24 +00:00
5688a4dd4a
[Bugfix][GLM-5.3] Size the image encoder cache from the exact token ceiling ( #59565 )
...
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com >
Co-authored-by: Kimi Code <kimi-code@moonshot.cn >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-10-02 10:43:29 +00:00
Juan Pérez de Algaba
c15672cfb4
[Security] Accept zero-sum DeepSeek-OCR pixel tensors ( #59417 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
2026-10-02 09:17:12 +00:00
Harry Mellor and Claude Opus 5
e3cae8d2ac
[Model] Use upstream GLM-5.3 and Qwen4-Exp configs and processor ( #57387 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-10-02 02:25:18 +00:00
Harry Mellor and Claude Opus 5.5
fc2c801ad9
Disable mypy arg-type and assignment checks in tests ( #59428 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 15:18:50 +00:00
Yida Weng and Grok
17e9295dd5
[BugFix][Multimodal] Pick worst-case DeepSeek-V4 VL dummy image size ( #59271 ) ( #59373 )
...
Signed-off-by: Yida Weng <84164537+YidaWeng@users.noreply.github.com >
Co-authored-by: Grok <grok@x.ai >
2026-09-30 15:09:11 +00:00
cjackal
0a30bc3f9a
[Model] Extend device-side mm normalization to GLM4V/GLM5Next ( #55389 )
...
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com >
2026-09-30 15:44:46 +08:00
d86cf91240
[MM][Mistral3] Image preprocessing optimization ( #57531 )
...
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-29 06:53:38 +00:00
65ed0a2642
[Bugfix][GLM-5.3-Flash] Take video placeholder timestamps from the pixel path's frame sampler ( #55647 )
...
Signed-off-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-29 06:45:29 +00:00
Daniel M. García-Ocaña Hernández
295a0b8d64
[Bugfix][Multimodal] Fix flat/scoped mm_processor_kwargs merge and resolution ( #56372 )
...
Signed-off-by: Daniel M. García-Ocaña Hernández <danielgarciaocana@gmail.com >
2026-09-29 03:58:39 +00:00
8a269919f4
[MM] Add Triton kernel for mm_input_normal. ( #56798 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: wang.yuqi <noooop@126.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Isotr0py <2037008807@qq.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-25 04:31:20 +00:00
5b3f280a6d
[Bugfix] Count unsplit Idefics3 image patches ( #48760 )
...
Signed-off-by: nightcityblade <nightcityblade@gmail.com >
Co-authored-by: nightcityblade <nightcityblade@gmail.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-09-24 11:36:26 -07:00
Harry Mellor and Claude Opus 5.5
d881812500
[Chore] Use Transformers v5 names and drop redundant processor use_fast ( #58550 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-09-24 14:14:10 +00:00
Tianyu Guo and Cyrus Leung
3ee2906f47
[EPD] Support metadata-only audio inputs ( #57887 )
...
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-09-23 09:03:50 +08:00
Ting SUN and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
a33b3bac5d
[Bugfix][Qwen2.5-VL] Honor video fps for temporal M-RoPE ( #47736 )
...
Signed-off-by: Ting Sun <suntcrick@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-22 05:56:12 +00:00
Cyrus Leung
7853700d4c
[MM] Move get_dummy_processor_inputs into MM processor ( #57967 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-09-21 09:39:20 -07:00
Cyrus Leung
c8824a1e42
[MM] Move supports_multimodal_inputs and cache out of registry ( #57913 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-09-21 07:43:07 -07:00
Oliver Holworthy and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
9598487bc1
[Bugfix][Model] Mistral3: align placeholder grid with public processor ( #53758 )
...
Signed-off-by: Oliver Holworthy <1216955+oliverholworthy@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-21 06:36:59 +00:00
Tianyao Wu
59f1527280
[Bugfix] Fix Whisper engine crash on audio clips longer than 30s ( #57769 )
...
Signed-off-by: Tianyao Wu <rayroy31@gmail.com >
2026-09-21 05:44:40 +00:00
Isotr0py
27757dde02
[DSV4.1] Add encoder cuda graph support for deepseek-v4.1-flash ( #56625 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-09-20 21:51:13 +08:00
Cyrus Leung
751f6807d9
[Refactor] Use dynamic MM cache in processor ( #57674 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-09-19 15:38:00 +00:00
Harry Mellor and Claude Opus 5
8a5cf54387
[Multimodal] Type dummy options per modality ( #57576 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-18 17:29:11 +01:00
Cyrus Leung
dbf4b89cf2
[Misc] Remove unnecessary Transformers version guards ( #57556 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-09-18 15:01:35 +00:00
Harry Mellor and Claude Opus 5
651a88c09a
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings ( #57212 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 10:57:24 -07:00
Harry Mellor and Claude Opus 5
8c1557a79c
Add pydocstyle to the ruff rules ( #52136 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Harry Mellor <hej.mellor@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 16:44:29 +00:00
Abhinav Verma and Claude Opus 5
1e47ec00d2
[Bugfix][Gemma 4] Don't read fft_length when profiling unified audio ( #56721 )
...
Signed-off-by: Abhinav Verma <verma.abhinav275@gmail.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-09-15 14:57:32 +00:00
linitra24
9d4d9aa5bc
[LoRA][Refactor] Unify multimodal LoRA token count hooks ( #55071 )
...
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io >
2026-09-14 13:19:15 +00:00
Ylean and Codex
a987777755
[Bugfix][Gemma4] Keep image kwargs out of video preprocessing ( #56652 )
...
Signed-off-by: Ylean <61880605+Woolgathererer@users.noreply.github.com >
Co-authored-by: Codex <noreply@openai.com >
2026-09-13 09:07:12 +00:00
Andreas Karatzas and OpenAI Codex
9dd969da09
[Model][ROCm] Enable DeepSeek V4 Vision ( #55107 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-11 09:17:30 -07:00
fe26c705f7
[Model] Add Bailing V3 VL support ( #55921 )
...
Signed-off-by: zexplorerhj <zhjoneson@163.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-10 02:46:56 -07:00
Li, Jiang
c3ccc0e957
[Model] Add DeepSeek-V4 CPU backend ( #55355 )
...
Signed-off-by: jiang1.li <jiang1.li@intel.com >
2026-09-10 14:14:48 +08:00
Qiming Zhang
29af8bd672
[XPU][UT] skip GLM-5.3-Flash test on XPU ( #55266 )
...
Signed-off-by: mayuyuace <qiming1.zhang@intel.com >
2026-09-04 14:45:06 +08:00
Isotr0py
1356635d83
[New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support ( #54566 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-09-02 11:09:09 -07:00
Andreas Karatzas
399247cc88
[Bugfix][MM] Fix MiniCPM-o image processor reuse on Transformers v5 ( #54501 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
2026-08-31 17:07:52 +08:00
Prudhvi Vuda
7292ee2791
[Bugfix][Multimodal] Honor modality-scoped mm_processor_kwargs ( #53808 )
...
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com >
2026-08-31 06:37:12 +00:00
Isotr0py
555ea65e8c
[Frontend] Add video embeds input support ( #54242 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-08-31 03:20:47 +00:00
Devon Krisman and Claude Fable 5
4f78a8fdd0
[Model] Honor cap_pixels_per_frame in Qwen3-VL memory profiling ( #54380 )
...
Signed-off-by: Devon Krisman <git@krisman.dev >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-08-30 08:07:29 +00:00
MOVZXandHinata
