iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
21,132 Commits 3 Branches 0 Tags
360f33f61ce02bda04bcb7ea876f1d2e5af8d06d
Commit Graph
3 Commits
Author SHA1 Message Date
Thomas OrtnerandHarry Mellor e509d32b5a [Transformers backend] Enable QKV-Fuser for Gemma4 (#55690) 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Ortner <bohnstinglthomas@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-09 14:46:31 +01:00
Thomas OrtnerandHarry Mellor 8ad2076c4a [Transformers backend] Find attention with a fuser and attach vLLM's layer to it (#54941) 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-04 16:26:01 +00:00
Harry Mellor 59b2fdfc4e Support MLA properly in the Transformers modeling backend (#48250) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-04 13:24:11 +01:00