MOVZX and Hinata
81074e94a3
[Mini-vLLM] Cut dead subsystems: models, entrypoints, backends, utils, tests
...
- Drop dead model modules, keeping files live imports require
- Remove anthropic, cohere, codegen entrypoints and batch STT modes
- Delete unused attention backends, MoE experts, and NPU/XPU util leaves
- Strip dead third_party trees and ROCm leaves with no CUDA path
- Remove mooncake EC connectors: dependency missing since branch base
- Re-audit verified by full import sweep and Qwen3.5 smoke test
Co-authored-by: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-10-19 00:20:48 +07:00
698e79f3bd
[Model] Kolibri 1 via the Transformers modeling backend ( #60827 )
...
Signed-off-by: Luca Motz <luca.motz@icloud.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-10-13 22:17:52 +01:00
Harry Mellor and Claude Opus 5
6f11c220b5
[Transformers backend] Fuse MoE routers that score after the top-k ( #57410 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-10-13 08:41:23 +00:00
Thomas Ortner and Harry Mellor
8b84e15066
[transformer] RMSNorm matching for alternative rsqrt ( #54461 )
...
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-24 16:33:06 +00:00
Taneem Ibrahim and Harry Mellor
e960ead0aa
[Mypy] Fix mypy typing for Transformers models ( #54320 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-17 12:11:31 -04:00
Harry Mellor and Claude Opus 5
651a88c09a
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings ( #57212 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 10:57:24 -07:00
Harry Mellor and Claude Opus 5
8c1557a79c
Add pydocstyle to the ruff rules ( #52136 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Harry Mellor <hej.mellor@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 16:44:29 +00:00
djramic
cce50657b7
[ROCm][CI] Use a platform-independent GEMM in the merged-column fuser test ( #56130 )
...
Signed-off-by: Djordje Ramic <djoramic@amd.com >
2026-09-09 15:08:39 -05:00
Thomas Ortner and Harry Mellor
e509d32b5a
[Transformers backend] Enable QKV-Fuser for Gemma4 ( #55690 )
...
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com >
Signed-off-by: Thomas Ortner <bohnstinglthomas@gmail.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-09 14:46:31 +01:00
c0d8d5413e
[Transformers] Generalize merged-column linear fusion ( #55301 )
...
Signed-off-by: BANANASJIM <bananasjim1@gmail.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-08 23:49:37 +00:00
Thomas Ortner and Harry Mellor
8ad2076c4a
[Transformers backend] Find attention with a fuser and attach vLLM's layer to it ( #54941 )
...
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-04 16:26:01 +00:00
Harry Mellor
2dd17225c6
Fix Transformers modelling backend RMSNormFuser.fuse performance ( #52766 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-20 15:21:23 +00:00
Harry Mellor
70b84f0bcb
Fix Gemma 4 for upcoming Transformers version ( #49797 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-10 07:48:26 +00:00
166f4e2dc3
fix: fuse weightless RMSNorms at their declared width ( #50867 )
...
Signed-off-by: Anuj Bolewar <anujbolewar@gmail.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Anuj Bolewar <anujbolewar@gmail.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-04 16:03:09 +00:00
Harry Mellor
59b2fdfc4e
Support MLA properly in the Transformers modeling backend ( #48250 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-04 13:24:11 +01:00
Miłosz Grunwald and Harry Mellor
ebcef33766
Fix MQA with tensor parallelism on transformers modeling backend ( #49987 )
...
Signed-off-by: microslaw <milosz.grunwald@intel.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-27 22:51:17 +00:00
Harry Mellor and Claude Opus 5
99de48e98f
Fix MLA padding and grouped topk routing in the Transformers modelling backend ( #49982 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-07-27 18:32:32 +00:00
Harry Mellor
92e8518d37
Improve Transformers modelling backend fx tracer ( #49957 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-27 12:51:16 +01:00
Harry Mellor
0ed05b6f82
[CI] Fix Transformers modeling backend LoRA test ( #47832 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-07 11:40:00 +00:00
Harry Mellor and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
5bce653e09
Make the Transformers modeling backend as fast as native vLLM ( #47187 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-07-06 16:59:14 +01:00
MOVZXandHinata
