iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Merge branch 'main' into patches

Browse Source
This commit is contained in:
MOVZX
2026-10-05 08:21:46 +00:00
parent f83ecfac16 34051ad714
commit 4a3ebc6b5b
23 changed files with 1102 additions and 247 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/models/supported_models.md
+1 -3
View File
@@ -19,12 +19,10 @@ vLLM also supports model implementations that are available in Transformers. We
Currently, the Transformers modeling backend works for the following:
- Modalities: embedding models, language models, vision-language models* and audio-language models
- Modalities: embedding models, language models, vision-language models and audio-language models
- Architectures: encoder-only, decoder-only, mixture-of-experts
- Attention types: full attention and/or sliding attention
_*Vision-language models currently accept only image inputs. Support for video inputs will be added in a future release._
If the Transformers model implementation follows all the steps in [writing a custom model](#writing-custom-models) then, when used with the Transformers modeling backend, it will be compatible with the following features of vLLM:
- All the features listed in the [compatibility matrix](../features/README.md#feature-x-feature)