3 people 9f1c642254 [Bugfix] fix Qwen2.5-Omni processor output mapping (#23058) ...

Signed-off-by: double7 <33449816+DoubleVII@users.noreply.github.com>
Co-authored-by: 杨森 <yangsen.double7@bytedance.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2025-08-17 22:09:11 -07:00

..

__init__.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

adapters.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

aimv2.py

[Misc] Use config definitions from Transformers library (#21913)

2025-08-08 23:10:51 -07:00

arcee.py

Fix Arcee model weight loading: Add custom load_weights (#21725)

2025-08-04 04:09:56 -07:00

arctic.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

aria.py

Migrate AriaImagePixelInputs to TensorSchema for shape validation (#21620)

2025-07-26 06:08:15 -07:00

aya_vision.py

[Misc] Move jsontree to utils (#22622)

2025-08-11 03:49:32 -07:00

baichuan.py

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

bailing_moe.py

support torch.compile for bailing moe (#21664)

2025-07-26 23:54:32 +00:00

bamba.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

bart.py

[New Model]mBART model (#22883)

2025-08-16 12:16:58 +00:00

bert_with_rope.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

bert.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

blip2.py

Migrate Blip2ImagePixelInputs and Blip2ImageEmbeddingInputs to TensorSchema (#21656)

2025-07-27 10:33:52 +08:00

blip.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

bloom.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

chameleon.py

Migrate ChameleonImagePixelInputs to TensorSchema (#21657)

2025-07-26 19:34:25 -07:00

chatglm.py

[Misc] Modify the organization of GLM series (#22171)

2025-08-03 23:51:20 -07:00

clip.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

cohere2_vision.py

[New Model] Support Command-A-Vision (#22660)

2025-08-12 01:39:54 -07:00

commandr.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

config.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

constant_size_cache.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

dbrx.py

[Misc] Use config definitions from Transformers library (#21913)

2025-08-08 23:10:51 -07:00

deepseek_mtp.py

[Bugfix] Fix DeepSeek MTP (#22934)

2025-08-16 01:25:06 +00:00

deepseek_v2.py

[Misc] Use config definitions from Transformers library (#21913)

2025-08-08 23:10:51 -07:00

deepseek_vl2.py

[Misc] Add tensor schema test coverage for multimodal models (#21754)

2025-08-03 00:52:14 -07:00

deepseek.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

dots1.py

[Misc] Use config definitions from Transformers library (#21913)

2025-08-08 23:10:51 -07:00

ernie45_moe.py

[Bugfix] Fix Ernie4_5_MoeForCausalLM shared experts (#21717)

2025-07-28 11:02:25 +00:00

ernie45.py

[Ernie 4.5] Name Change for Base 0.3B Model (#21735)

2025-07-28 12:22:32 +00:00

exaone4.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

exaone.py

[Misc] Remove redundant config definitions (#21891)

2025-07-29 23:54:18 -07:00

fairseq2_llama.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

falcon_h1.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

falcon.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

florence2.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

fuyu.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

gemma2.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

gemma3_mm.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

gemma3.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

gemma3n_mm.py

[Model] Gemma3n MM (#20495)

2025-08-09 09:56:25 -07:00

gemma3n.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

gemma.py

[Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103)

2025-07-18 07:15:07 +00:00

glm4_1v.py

[Model] Add missing prefix to glm4_1v (#22716)

2025-08-13 01:23:33 -07:00

glm4_moe_mtp.py

[Bugfix] Fix DeepSeek MTP (#22934)

2025-08-16 01:25:06 +00:00

glm4_moe.py

[Model] Modify the gate implementation of glm4_moe (#22832)

2025-08-14 05:28:50 -07:00

glm4.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

glm4v.py

[Misc] Modify the organization of GLM series (#22171)

2025-08-03 23:51:20 -07:00

glm.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gpt2.py

[Model][1/N] Support multiple poolers at model level (#21227)

2025-07-21 02:22:21 -07:00

gpt_bigcode.py

Fix loading of quantized BigCode models (#22463)

2025-08-08 23:12:12 -07:00

gpt_j.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gpt_neox.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gpt_oss.py

[Kernel] Add cuda kernel for gpt_oss activation (#22951)

2025-08-17 05:03:24 +00:00

granite_speech.py

[Bugfix] Fix granite speech shape validation (#21762)

2025-07-28 14:19:21 -04:00

granite.py

[Bugfix] Fix Tensor Parallelism Padding Consistency in Granite Models (#20843)

2025-07-12 06:11:30 -07:00

granitemoe.py

Let GraniteMoeAttention use YaRN (#21174)

2025-07-18 05:52:52 -07:00

granitemoehybrid.py

[Model] Granite-4 support loading quantized checkpoint (#22925)

2025-08-15 18:47:56 +00:00

granitemoeshared.py

Let GraniteMoeAttention use YaRN (#21174)

2025-07-18 05:52:52 -07:00

gritlm.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

grok1.py

[Quantization] Enable BNB support for more MoE models (#21100)

2025-07-18 17:52:02 -07:00

h2ovl.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

hunyuan_v1.py

[Model] add Hunyuan V1 Dense Model support. (#21368)

2025-07-23 03:54:08 -07:00

hyperclovax_vision.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

idefics2_vision_model.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

idefics3.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

interfaces_base.py

Update transformers to v4.55 (#21931)

2025-08-05 22:56:14 -07:00

interfaces.py

Add: SupportsEagle3 interface for explicit EAGLE3 support (#22642)

2025-08-12 09:24:52 -07:00

intern_vit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

internlm2_ve.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

internlm2.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

interns1_vit.py

Support Intern-S1 (#21628)

2025-07-26 19:14:04 +08:00

interns1.py

[Bugfix] Fix wrong method name in Intern-S1 image processor (#22417)

2025-08-06 20:05:20 -07:00

internvl.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

jais.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

jamba.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

jina_vl.py

[Model] Pooling model activation supports per request control by PoolingParams (#20538)

2025-08-05 00:37:00 -07:00

keye.py

[Multimodal] Update Tensor schema test to cover arbitrary shape mm inputs (#22867)

2025-08-16 00:44:50 -07:00

kimi_vl.py

Migrate KimiVLImagePixelInputs to TensorSchema (#21769)

2025-08-05 02:36:18 -07:00

llama4_eagle.py

[Meta] Official Eagle mm support, first enablement on llama4 (#20788)

2025-07-31 10:35:07 -07:00

llama4.py

Fix cuda illegal mem access with Llama4 TP8 + rms_norm custom op (#22701)

2025-08-12 21:21:50 -07:00

llama_eagle3.py

[Speculative Decoding] Add speculators config support (#21345)

2025-08-01 08:25:18 -04:00

llama_eagle.py

[Meta] Official Eagle mm support, first enablement on llama4 (#20788)

2025-07-31 10:35:07 -07:00

llama.py

Add: SupportsEagle3 interface for explicit EAGLE3 support (#22642)

2025-08-12 09:24:52 -07:00

llava_next_video.py

Migrate LlavaNextVideoPixelInputs to TensorSchema (#21843)

2025-08-10 19:29:16 -07:00

llava_next.py

Migrate LlavaNextImageInputs to TensorSchema (#21774)

2025-08-10 09:05:21 -07:00

llava_onevision.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

llava.py

[Bugfix] Fix PixtralHFImagePixelInputs dynamic shape check (#22827)

2025-08-14 02:35:43 -07:00

mamba2.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

mamba_cache.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

mamba.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

medusa.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

mimo_mtp.py

[Bugfix] Fix DeepSeek MTP (#22934)

2025-08-16 01:25:06 +00:00

mimo.py

[Model] Remove model sampler (#21059)

2025-07-16 19:03:37 +00:00

minicpm3.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

minicpm_eagle.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

minicpm.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

minicpmo.py

Remove redundant row_indices unsqueeze operation in MiniCPMO (#22528)

2025-08-10 09:20:00 -07:00

minicpmv.py

[CI/Build] Update VLM common tests (#22841)

2025-08-13 10:03:05 -07:00

minimax_cache.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

minimax_text_01.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

minimax_vl_01.py

[Misc] Move jsontree to utils (#22622)

2025-08-11 03:49:32 -07:00

mistral3.py

Implicit language-model-only mode via limit-mm-per-prompt (#22299)

2025-08-08 22:21:40 -07:00

mixtral_quant.py

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

mixtral.py

[Quantization] add BNB for MixtralForCausalLM (#20893)

2025-07-14 07:34:34 +00:00

mllama4.py

Implicit language-model-only mode via limit-mm-per-prompt (#22299)

2025-08-08 22:21:40 -07:00

mllama.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

mlp_speculator.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

modernbert.py

[Bugfix] Fix ModernBert load & Enable sliding window attention for bidirectional attention. (#22637)

2025-08-12 00:23:17 -07:00

module_mapping.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

molmo.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

moonvit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

mpt.py

[CI/Build] Fix registry tests (#21934)

2025-07-30 09:10:41 -07:00

nemotron_h.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

nemotron_nas.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

nemotron_vl.py

[Bugfix] Fix Nemotron VL image processing (#22739)

2025-08-13 03:11:36 -07:00

nemotron.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

nvlm_d.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

olmo2.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

olmo.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

olmoe.py

[Misc] Use config definitions from Transformers library (#21913)

2025-08-08 23:10:51 -07:00

opt.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

orion.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

ovis.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

paligemma.py

[CI/Build] Ensure compatability with Transformers v4.53 (#20541)

2025-07-11 20:53:07 -07:00

persimmon.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

phi3.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

phi3v.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

phi4_multimodal.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

phi4flash.py

[BugFix] Fix regression caused by mamba state dtype PR (#22998)

2025-08-15 22:55:26 +00:00

phi4mm_audio.py

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

phi4mm_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

phi4mm.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

phi.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

phimoe.py

[Misc] Fix PhiMoE expert mapping (#21085)

2025-07-17 05:47:49 +00:00

pixtral.py

Remove xformers requirement for Mistral-format Pixtral and Mistral3 (#21154)

2025-07-26 17:20:29 -06:00

plamo2.py

[BugFix] Fix regression caused by mamba state dtype PR (#22998)

2025-08-15 22:55:26 +00:00

prithvi_geospatial_mae.py

[Refactor] Defer tensor data construction in MultiModalKwargs (#23030)

2025-08-16 21:05:50 -07:00

qwen2_5_omni_thinker.py

[Bugfix] fix Qwen2.5-Omni processor output mapping (#23058)

2025-08-17 22:09:11 -07:00

qwen2_5_vl.py

Remove unnecessary CUDA sync of qwen image and video preprocess (#22792)

2025-08-13 06:07:28 -07:00

qwen2_audio.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

qwen2_moe.py

[Misc] Use config definitions from Transformers library (#21913)

2025-08-08 23:10:51 -07:00

qwen2_rm.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

qwen2_vl.py

[Misc] Remove dead return (#23061)

2025-08-17 10:36:46 -07:00

qwen2.py

Refactor sliding window configuration to Transformers best practice (#21927)

2025-08-09 20:50:48 -07:00

qwen3_moe.py

Fix GGUF loader for Qwen3 MoE. (#22785)

2025-08-13 06:08:23 -07:00

qwen3.py

Add: SupportsEagle3 interface for explicit EAGLE3 support (#22642)

2025-08-12 09:24:52 -07:00

qwen_vl.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

qwen.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

registry.py

[New Model]mBART model (#22883)

2025-08-16 12:16:58 +00:00

roberta.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

siglip.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

skyworkr1v.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

smolvlm.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

solar.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

stablelm.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

starcoder2.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

step3_text.py

[Model] Add step3 vl (#21998)

2025-07-31 23:19:06 +08:00

step3_vl.py

[Model] Add option to run Step3VisionEncoder in DP (#22697)

2025-08-13 00:09:13 -07:00

tarsier.py

[Misc] Move jsontree to utils (#22622)

2025-08-11 03:49:32 -07:00

telechat2.py

[CI/Build] Fix registry tests (#21934)

2025-07-30 09:10:41 -07:00

teleflm.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

transformers.py

[Bugfix] should use stack instead of concat (#22972)

2025-08-17 08:46:36 +00:00

ultravox.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

utils.py

Improve fast_topk function with type hints and documentation (#22530)

2025-08-09 20:25:42 -07:00

vision.py

[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL models on ROCm platform. (#22069)

2025-08-01 23:53:18 -07:00

voxtral.py

[Bugfix] Relax lang pin for voxtral (#21833)

2025-07-30 20:38:52 -07:00

whisper.py

[Misc] Automatically resolve HF processor init kwargs (#22005)

2025-07-31 22:44:10 -07:00

zamba2.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00