iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Harry MellorandClaude Opus 5.5 f8112704d5 [Chore] Use upstream Transformers InklingProcessor (#61883) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-17 01:04:54 +00:00
Harry MellorClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Kevin H. Luu
 		b965ee564d [Chore] Use upstream Transformers DeepseekV4Config (#61392) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-10-15 01:08:08 -07:00
Harry MellorandClaude Opus 5.5 3e851a7803 [Bugfix][Attention] Make the query contiguous for TRTLLM ragged MLA prefill (#61634) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-14 16:38:52 +00:00
Harry MellorandClaude Opus 5 6f11c220b5 [Transformers backend] Fuse MoE routers that score after the top-k (#57410) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-10-13 08:41:23 +00:00
Harry MellorClaude Opus 5.5Kevin H. Luu
 		3facf822b7 [Performance] Load HF tokenizers and processors from a local snapshot (#60825) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-10-12 13:45:54 +00:00
Harry MellorandClaude Opus 5.5 2c99ee9333 [Chore] Remove vendored code made redundant by Transformers 5.16.1 (#60623) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-09 09:29:03 +00:00
Harry MellorandClaude Opus 5.5 21d9758459 Remove Python 3.10 support now that it is EOL (#60402) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-08 02:30:52 -07:00
Harry MellorandClaude Opus 5.5 a8260cbc5c [CI] Bump Transformers version to 5.19.0 (#60381) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-07 10:01:41 -07:00
Harry MellorandClaude Opus 5.5 d61081dc3d [CI] Bump peft to satisfy transformers 5.18 minimum (#59932) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-04 10:53:07 +00:00
Harry Mellor 9e0b6fcf77 [CI] Bump Transformers version to 5.18.0 (#59621) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-10-04 00:42:35 +00:00
Harry MellorandClaude Opus 5.5 6e4efafc6e [Model] Migrate GPT-NeoX, Phi, Seed-OSS and Jais2 to the Transformers modeling backend (#59701) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-02 11:18:35 +00:00
Harry MellorandClaude Opus 5.5 5d20979fc9 [Misc] Remove code paths for Transformers < 5.16.1 (#59762) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-02 11:17:24 +00:00
Harry MellorandClaude Opus 5.5 8faacd707f [Model] Migrate Glm, Arcee, CWM and Mellum to the Transformers modeling backend (#59679) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-02 03:15:14 +00:00
Harry MellorandClaude Opus 5 e3cae8d2ac [Model] Use upstream GLM-5.3 and Qwen4-Exp configs and processor (#57387) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-10-02 02:25:18 +00:00
Harry MellorandClaude Opus 5.5 7b44aad5db [MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-01 19:32:27 +00:00
Harry MellorandClaude Opus 5.5 fc2c801ad9 Disable mypy arg-type and assignment checks in tests (#59428) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 15:18:50 +00:00
Harry MellorandClaude Opus 5.5 b22494cc0c [Docs] Reinstate docs build gate for PRs (#59411) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 13:41:53 +01:00
Harry MellorandClaude Opus 5.5 998490cd9f [Docs] Speed up docs build ~5x (#58705) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-29 12:16:33 +01:00
Harry MellorandClaude Opus 5.5 afea5c20c7 [Docs] Add return annotation to fused_mm_input_norm_triton (#58687) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-25 10:01:11 +00:00
Harry MellorandClaude Opus 5.5 d636456b1f [Frontend] Remove the slow tokenizer mode (#58545) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 08:48:28 -07:00
Harry MellorandClaude Opus 5.5 d881812500 [Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 14:14:10 +00:00
Harry MellorandClaude Opus 5.5 cccf7e1376 Remove .gemini/ and CLAUDE.md (#58541) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 12:57:23 +00:00
Harry MellorandClaude Opus 5 8a5cf54387 [Multimodal] Type dummy options per modality (#57576) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-18 17:29:11 +01:00
Harry MellorandClaude Opus 5 0ef8366ba3 [Frontend] Only show the summary line of config docstrings in --help (#57357) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-17 12:53:11 +00:00
Harry MellorandClaude Opus 5 651a88c09a [CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 10:57:24 -07:00
Harry MellorandClaude Opus 5 8c1557a79c Add pydocstyle to the ruff rules (#52136) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 16:44:29 +00:00
Harry Mellormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 5
 		ec4a3a5370 [CI] Bump Transformers version to 5.17.0 (#56108) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-16 06:34:16 -07:00
Harry MellorandClaude Opus 5 5f203baedb [Docs] Split slash-combined docstring parameters (#57141) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 02:16:32 -07:00
Harry MellorandClaude Opus 5 c191787a68 [Bugfix] Align vLLM YaRN with Transformers and stop re-scaling max_model_len (#56446) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-11 13:01:38 +00:00
Harry MellorandClaude Opus 5 364679feab [CI] Enable ruff INP to require __init__.py under vllm/ (#56264) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-10 13:49:17 +00:00
Harry MellorandClaude Opus 5 42d76ee35a [Docs] Fix griffe docstring indentation warning in SupportsMRoPE (#56112) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-09 10:11:40 -07:00
Harry MellorandClaude Opus 5 719284fe15 [Core][Model] Unify XD-RoPE into M-RoPE and derive the channel count (#56078) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-09 09:23:30 -07:00
Harry Mellor 5e729d84eb [CI] Only run GitHub Actions on the main repo (#55349) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-05 00:09:49 +08:00
Harry MellorandClaude Opus 5 78300cdabf [Bugfix][Docs] Package glm5next nvidia subtree and fix its docstrings (#55214) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-03 21:25:26 -07:00
Harry Mellor e6eb9074e9 [CI] Bump Transformers version to 5.16.1 (#53905) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-03 02:12:43 -07:00
Harry MellorandClaude Opus 5 d539de1c5d [Docs] Add missing return annotations flagged by griffe (#54980) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-02 09:56:07 -07:00
Harry MellorandClaude Opus 5 f1e5fdd7f2 [Transformers backend] Replace vocab embeddings in recursive_replace (#54760) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-01 15:35:24 +00:00
Harry MellorandClaude Opus 5 488b6da105 [Doc] Fix griffe warnings in HYV4 tool parser (#54412) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-30 13:21:22 +00:00
Harry MellorXianbao QIANClaude Opus 5Cyrus Leung
 		48d7132962 [Model] Migrate FlexOlmo, Olmo3 and Hunyuan V1/VL to the Transformers modeling backend (#53615) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-08-24 22:39:05 -07:00
Harry MellorandClaude Opus 5 b2dd9ce73d [Docs] Fix docstring continuation indentation in routed_experts.py (#53604) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-25 02:27:16 +00:00
Harry MellorXianbao QIANClaude Opus 5
 		7ca336929c [Model] Remove ten deprecated model architectures (#53608) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-24 17:06:00 -07:00
Harry Mellor 1fe3a1571a Reduce AutoWeightsLoader kwargs (#53106) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-20 15:40:11 +00:00
Harry Mellor 2dd17225c6 Fix Transformers modelling backend RMSNormFuser.fuse performance (#52766) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-20 15:21:23 +00:00
Harry Mellor f0c14b4f77 Fix weight tying (#51665) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-20 10:31:55 +00:00
Harry Mellor 6e85feb1b7 [3/N] Harden Transformers modelling backend multi-modal path (#51827) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-20 10:24:41 +00:00
Harry Mellor 2f54100a59 [CI] Fix docs build (#52937) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-19 05:25:46 -07:00
Harry Mellor b245d8e73f Apply logit softcapping in Transformers modelling backend (#52173) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-13 16:21:55 +00:00
Harry MellorandClaude Opus 5 80d6d557f3 Standardise weight tying on ParallelLMHead.tie_weights (#52147) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-13 15:10:09 +00:00
Harry Mellor 903da602f3 [Docs] Fix WhisperEncoderLayer.forward docstring in dots3_note (#52134) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-13 02:32:14 -07:00
Harry MellorandAndreas Karatzas b2ab096017 [Docs] Fix broken autorefs cross-reference in TurboQuant v2 docstring (#51857) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-11 12:22:56 -07:00
Harry Mellor 9cc347ae42 Enable MiniCPMV for vLLM in CI (#45042) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-11 16:30:39 +00:00
Harry Mellor c65aa2ee6c Bump Transformers version to 5.15.0 (#51668) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-11 09:00:51 -07:00
Harry Mellor be2e274ef5 Fix docs on main (#51773) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-10 23:52:04 -07:00
Harry Mellor cf8f3a3bb2 [2/N] Harden Transformers modelling backend multi-modal path (#51657) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-10 12:57:12 +00:00
Harry Mellor 70b84f0bcb Fix Gemma 4 for upcoming Transformers version (#49797) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-10 07:48:26 +00:00
Harry Mellor 83ad767eed [CI] fix docs on main (#51539) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-09 09:46:12 +00:00
Harry Mellor 45273b8dcb [1/N] Harden Transformers modelling backend multi-modal path (#51408) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-07 17:30:43 +00:00
Harry Mellor e7b8d59460 Fully generalise input embedding handling in Transformers modelling backend (#51247) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-06 16:21:24 +00:00
Harry MellorandClaude Opus 5 1eb3694521 [Docs] Fix two docs build warnings (#51014) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-04 05:29:04 -07:00
Harry Mellor 59b2fdfc4e Support MLA properly in the Transformers modeling backend (#48250) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-04 13:24:11 +01:00
Harry MellorClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		94e9ef0768 [Bugfix] Don't transpose fused MoE quantization scales in RoutedExperts.load_weights (#50137) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-31 08:46:52 -07:00
Harry Mellor 62d8db7c05 [Bugfix] Add missing vllm/models/kimi_k3/__init__.py (#50131) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-28 13:47:04 +00:00
Harry MellorandClaude Opus 5 99de48e98f Fix MLA padding and grouped topk routing in the Transformers modelling backend (#49982) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-07-27 18:32:32 +00:00
Harry Mellor 92e8518d37 Improve Transformers modelling backend fx tracer (#49957) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-27 12:51:16 +01:00
Harry MellorandClaude Opus 5 9321aff536 [Bugfix] Wait for the linear bias before layerwise online processing (#49805) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-07-25 17:56:32 +00:00
Harry Mellor 26d725c334 [Model] Add VaultGemma via Transformers modeling backend (#49803) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-25 16:54:15 +00:00
Harry Mellor 2e0da24150 Mergify message not on cancelled (#45117) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-25 16:20:24 +00:00
Harry Mellor 3e74c60b9c [Docs] Use gen-files for generated docs content (#49587) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-25 14:43:21 +00:00
Harry Mellor 9a50464698 [CI] Stop flaky test from downloading model every time (#49800) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-25 13:29:36 +00:00
Harry MellorandAndreas Karatzas ca0defa343 Make bare hugging_face imports forbidden (#49726) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-25 04:18:39 -07:00
Harry MellorandClaude Opus 5 0b1a8bb1f6 [Bugfix][CI] Fix stale Mooncake lookup expectation broken by a merge race (#49802) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-07-25 03:10:26 -07:00
Harry MellorandClaude Opus 5 dbcc1cdd0a [Model] Remove Ouro (#49786) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-07-25 02:50:08 -07:00
Harry Mellor 89f6aa3a9e [KV Offload][CI] Fall back to buffered I/O without O_DIRECT; fix flaky api-server test (#49734) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-24 13:56:57 -07:00
Harry Mellor 84d26b9ee3 [Model] Remove Plamo2 (#49729) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-24 13:54:24 -07:00
Harry Mellor 0d77325b10 Bump Transformers version to 5.14.1 (#49223) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-23 21:16:49 -07:00
Harry Mellor c233d90aa8 Remove even more unnecessary load_weights methods (#48496) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-18 08:40:27 +00:00
Harry Mellor 1bd8f80a64 [CI] Point CI at Transformers release rather than release branch (#48328) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-11 02:31:14 -07:00
Harry Mellor 4a6440acef Bump Transformers version to 5.13.0 (#47867) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-11 00:56:14 -07:00
Harry Mellor b83be00cdd Migrate Olmo and Olmo2 to the Transformers modeling backend (#48100) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-09 05:00:23 -07:00
Harry Mellor 56da398dac Fix embed scaling + CUDA graphs in Transformers modelling backend (#48010) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-09 00:14:33 +01:00
Harry Mellor dd94484577 Bump Transformers version to 5.10.4 (#41359) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-07 05:13:28 -07:00
Harry Mellor 0ed05b6f82 [CI] Fix Transformers modeling backend LoRA test (#47832) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-07 11:40:00 +00:00
Harry Mellor ae098abe3f [CI] Fix some errors on main (#47726) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-06 19:40:23 +00:00
Harry Mellorandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 5bce653e09 Make the Transformers modeling backend as fast as native vLLM (#47187) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-06 16:59:14 +01:00
Harry Mellor 51ee564e56 [CI] Skip test for checkpoint that was deleted (#47748) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-06 07:24:09 -07:00
Harry Mellor f1445f6dbd [CI] Bump huggingface-hub from v1.10.2 to v1.22.0 (#47551) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-04 07:45:45 -07:00
Harry Mellor e24d1b24fe Fix Transformers modeling backend usage stats (#47472) 2026-07-02 12:51:23 -07:00
Harry Mellor a78c15616f Migrate GPTBigCode and Starcoder2 to the Transformers modeling backend (#30966) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-01 13:41:36 +00:00
Harry Mellor a22e0dfc69 [Model] Remove AyaVision, MusicFlamingo (#47263) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-01 10:39:33 +00:00
Harry Mellor e7d0fcbc09 [CI] Fix various failures on main (#47197) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-01 10:35:34 +01:00
Harry Mellor 1ab9522935 Remove more unnecessary load_weights methods (#47058) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-30 15:22:16 +01:00
Harry Mellor 62c7d8009f Forward fix nightly errors from #44589 (#47151) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-30 14:02:34 +00:00
Harry Mellor 5dc36a4fa5 [Model] Remove Tarsier, Tarsier2 (#47143) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-30 13:20:33 +00:00
Harry Mellor 5316638a5e Fix transient dependency issues caused by requirements/common.txt (#47015) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-29 14:20:33 -07:00
Harry Mellor 5051698e41 Remove unnecessary load_weights methods (#44589) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-29 01:52:23 -07:00
Harry Mellor f6bb8682ee Fix docs on main (#47009) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-29 15:50:57 +08:00
Harry Mellor 311ad689ad Remove boilerplate missed by #46820 (#46956) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-29 08:11:17 +08:00
Harry Mellor 3f67477497 [CI] Don't try and download files that we already know don't exist (#46854) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-26 23:56:39 +00:00
Harry Mellor d8eb734d94 Fix Transformers backend FP8 MoE and remove some boilerplate (#46820) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-27 00:16:05 +01:00
Harry Mellor 0a49fb2b13 Fix dead link in docs (#46181) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-19 18:16:09 +00:00