iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
15,614 Commits 3 Branches 0 Tags
8332078cfdbd5e44e527893b695e79052d008172
Commit Graph
562 Commits
Author SHA1 Message Date
Harry MellorandJulien Denize edcc37a8ce Fix Mistral yarn warning in Transformers v5 (#37292) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
 2026-04-07 13:23:33 +00:00
Aaron Batilo 9a528260ef [Bugfix][Spec Decode] Fix extract_hidden_states for VLM models (#38987) 
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
 2026-04-05 02:41:54 -07:00
Netanel Haber fa9e68022d Fix Nano Nemotron VL regressions (#38655) 
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
 2026-04-03 15:22:06 +08:00
Isotr0py 5506435419 [Misc] Clean up Gemma4 implementation (#38872) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-04-03 05:47:02 +00:00
Luciano MartinsLuciano MartinsIsotr0py
 		08ed2b9688 feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal, Reasoning, Tool-Use) (#38826) 
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Luciano Martins <lucianomartins@google.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2026-04-02 11:13:28 -07:00
bsliu c0817e4d39 [Model] Add support for Cheers multimodal model (#38788) 
Signed-off-by: bsliu <1187291748@qq.com>
Signed-off-by: 吴炳贤 <wubingxian24@mails.ucas.ac.cn>
 2026-04-02 21:01:40 +08:00
Benjamin Chislett 494636b29d [Feat][Spec Decode] DFlash (#36847) 
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
 2026-03-30 15:03:15 -04:00
allgather 8c0b6267d7 [Transformers v5] fix missing pixtral/voxtral multimodal dispatch (#38410) 
Signed-off-by: allgather <all2allops@gmail.com>
 2026-03-29 09:59:06 +00:00
Shubhra Pandit 5b8c30d62b [Spec Decode, BugFix] Propagate norm_before_fc from Eagle3 speculator (#38111) 
Signed-off-by: Shubhra Pandit <shubhra.pandit@gmail.com>
 2026-03-29 00:42:06 +00:00
haosdent d39b8daf5f [Feature] Add Qwen3-ForcedAligner support via token classification pooling (#35367) 
Signed-off-by: haosdent <haosdent@gmail.com>
 2026-03-29 00:27:52 +00:00
Harry Mellor f73bcb1c51 Various Transformers v5 config fixes (#38247) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-26 23:06:59 +00:00
Cyrus Leung 502c41a8f6 [Model] Use helper function to run MM processors with token inputs (where applicable) (#38018) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-26 16:44:04 +08:00
Harry Mellor 3c3c084240 Various Transformers v5 fixes (#38127) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-26 00:10:08 +00:00
Harry Mellor d215d1efca [Mypy] Better fixes for the mypy issues in vllm/config (#37902) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-25 06:14:43 -07:00
Netanel Haber a0d487b2e1 nano_nemotron_vl: suppress readonly torch.from_numpy() warning in image and video resize paths (#37903) 
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
 2026-03-24 23:25:56 +00:00
Javier De Jesus 54b0578ada [Bugfix] Pass hf_token through config loading paths for gated model support (#37920) 
Signed-off-by: javierdejesusda <javier.dejesusj9@gmail.com>
 2026-03-24 15:22:05 -04:00
Isotr0py c7f98b4d0a [Frontend] Remove librosa from audio dependency (#37058) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-03-21 11:36:15 +08:00
Cyrus Leung 37aadf6237 [Model] Update Kimi-K25 and Isaac processors to fit HF-style (#37693) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-20 18:30:22 +00:00
Harry Mellor 6ade4bc5a5 Fix various config related issues for Transformers v5 (#37681) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-20 16:30:12 +00:00
Cyrus Leung 30108fc8b0 [Model] Refactor Step3-VL processor to HF style (#37579) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-20 06:05:08 +00:00
Harry Mellor e5d96dc8fc Fix SpeculatorsConfig now that PreTrainedConfig is a dataclass in Transformers (#37574) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-19 18:04:40 +00:00
Cyrus Leung 657855ab41 [Misc] Cleanup more configs and processors (#37560) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-19 15:45:23 +00:00
Harry Mellor 4426447bba Don't log exc_info when vLLM tries to doenload a file that doesn't exist (#37458) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-19 10:38:29 +00:00
Collin McCarthy 0b6d52629f Support temporal compression for Nemotron-3-VL videos (#36808) 
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
 2026-03-19 08:02:19 +00:00
Netanel Haber 6ae4c8d6fc chunk parakeet into 30s clips to prevent OOMs on long audios (#36671) 
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
 2026-03-18 14:22:24 -07:00
Harry Mellor 5ce2d10e4a Fix models which use layer_type_validation for Transformers v5 (#37398) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-18 18:41:51 +00:00
Cyrus Leung 7476d148db [Model] Remove unnecessary processor definition for Nemotron Parse (#37456) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-18 18:25:13 +00:00
Cyrus Leung 99267c23ca [2/3] Refactor InternVL-based processors (#37324) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-18 22:22:19 +08:00
Ekagra Ranjan b5ca9c3557 [Models] Cohere ASR (#35809) 
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
 2026-03-17 21:04:17 +00:00
Cyrus Leung c781fbbab3 [Bugfix] Standardize custom HF Processor init (#37289) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-17 15:38:55 +00:00
Anton VlasjukandHarry Mellor 2ff0ad9694 [UltraVox] Fix output type (#37224) 
Signed-off-by: vasqu <antonprogamer@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-17 14:51:17 +00:00
Cyrus Leung f340324335 [1/2] Move InternVL-based processors (#37260) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-17 21:50:56 +08:00
Julien Denize ffbc2e5bdb Patch Mistral config (#37104) 
Signed-off-by: juliendenize <julien.denize@mistral.ai>
 2026-03-16 12:22:18 +00:00
bigshanedogg 2390d44209 [Model] Add HyperCLOVAX-SEED-Think-14B language model support (#37107) 
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
 2026-03-16 06:40:05 +00:00
Hari a3e2e250f0 [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) 
Signed-off-by: hasethuraman <hsethuraman@microsoft.com>
 2026-03-15 19:38:21 +08:00
NikitaandCyrus Leung 10f08dedfa [Model] Add ColPali late interaction model for multi-modal retrieval (#36818) 
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-03-13 02:18:57 +00:00
Cyrus Leung 196802dfa6 [Misc] Clean up renderers (#36770) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-11 16:39:29 +00:00
Julien Denizeandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> afebeffbfb Add support to Mistral large 3 eagle with dense layers (#36163) 
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-11 15:42:56 +00:00
Jhao-Ting ChenandIzzy Putterman 5573894737 Kimi k2.5 MLA based eagle3 (#36361) 
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
 2026-03-11 11:36:11 -04:00
Isotr0py e568cf88bc [UX] Infer dtype for local checkpoint (#36218) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-03-11 08:50:04 +00:00
tunglinwood 42fadebecb [Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) 
Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>
 2026-03-10 21:24:48 -07:00
Harry Mellor f83b933b84 [CI] Bump mypy version to 1.19.1 (#36104) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-10 09:18:28 -07:00
AllenDouandzixiao aefc59f088 FunASR model bugfix (#36633) 
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
 2026-03-10 08:14:21 -07:00
Harry Mellor d88f28da05 Fix hf_override_fn when it modifies model_type (#35200) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-10 15:03:18 +00:00
Raushan TurganbayandHarry Mellor 8850738b70 [Bugfix] Fix processor signature (#36630) 
Signed-off-by: raushan <raushan@huggingface.co>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-10 06:20:47 -07:00
Cyrus Leung d62856b928 [Misc] Move processors to transformers_utils (#35953) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-09 11:31:39 +08:00
Nick Hill c7f32e08c2 [BugFix] Avoid ignored trust_remote_code warnings (#36290) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-03-07 01:24:18 +00:00
Isotr0pyandRoger Wang 1d0c0d209c [Misc] Lazy import registered processors (#36024) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-03-06 06:06:45 -08:00
Yanhong Li a911f4dd20 [Model] Add support for OLMo Hybrid (#32550) 2026-03-05 14:51:06 -05:00
Jiayi YanandHarry Mellor 6a895197fa [Bugfix][CI] fix typos (#34934) 
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-05 17:05:46 +00:00