Sky Leeandlisiqi23 f4937a51c1 [Model] vLLM v1 supports Medusa (#17956) ...

Signed-off-by: lisiqi23 <lisiqi23@xiaomi.com>
Signed-off-by: skylee-01 <497627264@qq.com>
Co-authored-by: lisiqi23 <lisiqi23@xiaomi.com>

2025-05-15 21:05:31 -07:00

..

__init__.py

[V1]SupportsV0Only protocol for model definitions (#13959)

2025-02-27 20:02:15 -05:00

adapters.py

[Bugfix] Fix missing return value in load_weights method of adapters.py (#15542)

2025-03-31 06:56:42 -07:00

aimv2.py

[Model] Broadcast Ovis2 implementation to fit Ovis1.6 (#17861)

2025-05-11 17:56:30 -07:00

arctic.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

aria.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

aya_vision.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

baichuan.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

bamba.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

bart.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

bert_with_rope.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

bert.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

blip2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

blip.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

bloom.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

chameleon.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

chatglm.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

clip.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

commandr.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

constant_size_cache.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

dbrx.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

deepseek_mtp.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

deepseek_v2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

deepseek_vl2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

deepseek.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

eagle.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

exaone.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

fairseq2_llama.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

falcon.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

florence2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

fuyu.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gemma2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gemma3_mm.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gemma3.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gemma.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

glm4.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

glm4v.py

[VLM] Avoid unnecessary dummy multimodal data during processing (#16416)

2025-04-10 19:32:14 +00:00

glm.py

[Bugfix] Fix GLM rotary_dim issue and support v1 (#16912)

2025-04-21 14:26:34 +00:00

gpt2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gpt_bigcode.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gpt_j.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gpt_neox.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

granite_speech.py

fix: typos (#18151)

2025-05-15 02:16:15 -07:00

granite.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

granitemoe.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

granitemoehybrid.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

granitemoeshared.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

gritlm.py

[Model] GritLM supports other attention backends (#18109)

2025-05-14 03:33:19 -07:00

grok1.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

h2ovl.py

[Optim] Compute multimodal hash only once per item (#17314)

2025-04-29 09:40:35 +08:00

idefics2_vision_model.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

idefics3.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

interfaces_base.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

interfaces.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

intern_vit.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

internlm2_ve.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

internlm2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

internvl.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

jais.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

jamba.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

kimi_vl.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llama4.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llama_eagle3.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llama_eagle.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llama.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llava_next_video.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llava_next.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llava_onevision.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

llava.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mamba2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mamba_cache.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mamba.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

medusa.py

[Model] vLLM v1 supports Medusa (#17956)

2025-05-15 21:05:31 -07:00

mimo_mtp.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mimo.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

minicpm3.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

minicpm.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

minicpmo.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

minicpmv.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

minimax_cache.py

[Model][MiniMaxText01] Support MiniMaxText01 model inference (#13454)

2025-04-01 16:23:55 -04:00

minimax_text_01.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

minimax_vl_01.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mistral3.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mixtral_quant.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mixtral.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mllama4.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mllama.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mlp_speculator.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

modernbert.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

module_mapping.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

molmo.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

moonvit.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

mpt.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

nemotron_nas.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

nemotron.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

nvlm_d.py

[VLM] Avoid unnecessary dummy multimodal data during processing (#16416)

2025-04-10 19:32:14 +00:00

olmo2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

olmo.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

olmoe.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

opt.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

orion.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

ovis.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

paligemma.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

persimmon.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

phi3_small.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

phi3.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

phi3v.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

phi4mm_audio.py

fix: typos (#18151)

2025-05-15 02:16:15 -07:00

phi4mm_utils.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

phi4mm.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

phi.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

phimoe.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

pixtral.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

plamo2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

prithvi_geospatial_mae.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen2_5_omni_thinker.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen2_5_vl.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen2_audio.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen2_moe.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen2_rm.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen2_vl.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen2.py

[Model] Allow the use of sliding window in Qwen2 (#17772)

2025-05-14 22:29:38 -07:00

qwen3_moe.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen3.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen_vl.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

qwen.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

registry.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

roberta.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

siglip.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

skyworkr1v.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

smolvlm.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

solar.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

stablelm.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

starcoder2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

telechat2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

teleflm.py

Upstream Llama4 Support to Main (#16113)

2025-04-07 08:06:27 -07:00

transformers.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

ultravox.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

utils.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

vision.py

Fix PixtralHF missing spatial_merge_size (#17571)

2025-05-01 22:14:09 -07:00

whisper.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00

zamba2.py

Update deprecated type hinting in models (#18132)

2025-05-14 22:06:50 -07:00