MOVZX and Hinata
5f3c7bd8ab
[Mini-VLLM] Remove the ROCm device path, debug routes and arch-gated tests
...
- Delete csrc/rocm, hipify, the _rocm_C extension and the setup.py rocm
target path; drop the rocm requirement files
- Delete the aiter, rdna3, skinny-gemm and ROCm fused-MoE kernel modules
and retarget the linear kernel registries away from them
- Reduce platforms/rocm.py to the GCN architecture predicates that live
code still imports, and delete the RocmPlatform class and plugin
- Drop the VLLM_SERVER_DEV_MODE debug surface: reset, collective_rpc,
server_info and sleep routes plus the log_error_stack flag
- Delete lm-format-enforcer, lark and otel-semantic-conventions-ai pins;
the live server process maps none of them
- Delete tests that only build architectures this fork no longer
registers, and test directories left without any test file
- Restore the tests/v1/kv_connector mock helpers that scheduler tests
import at module level
Co-authored-by: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-10-19 19:31:07 +07:00
MOVZX and Hinata
2066d3143f
[Mini-VLLM] Cut non-OpenAI surfaces, dead kernels, Mistral stack
...
- Remove Anthropic, Cohere, SageMaker, decisions, structured-decisions,
rl, render-launcher and batch entrypoints; keep scale-out token routes
- Drop the Swagger static bundle and the /docs, /redoc routes
- Delete device-keyed tuning configs for fused_moe, quant utils, mamba
select-state and helion; no sm86 entry ever existed for any of them
- Remove ten unused rope variants plus the fbgemm_fp8 and fp_quant
quantizers and their config, metrics and loader plumbing
- Cut the CPU device build: csrc/cpu, cpu_extension.cmake, cpu
requirements and the setup.py cpu target path
- Delete 29 environment variables nothing reads and 14 chat-template
fallbacks for models this fork no longer registers
- Remove nine dead CUDA ops (deepseek_v4, kimi_k3, minimax, muse_spark,
dsv3 gemm) with their kernels, bindings, wrappers and CMake entries
- Delete the connector test suites that targeted removed connectors
- Cut the Mistral tokenizer and parser stack, its tests, and the
mistral_common and ijson dependency pins
- Restore the Qwen4Exp registry rows and nvidia/mtp.py that an earlier
cut deleted while keeping the model tree
Co-authored-by: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-10-19 17:10:56 +07:00
Woosuk Kwon and Claude Opus 5.5
4a89316efa
[Core] Drop the Ray driver-node GPU pin left over from the legacy executor ( #61713 )
...
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-15 16:00:18 -07:00
13dbf96093
[Model Loader] Apply EP weight filtering in InstantTensor ( #61167 )
...
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
Co-authored-by: Misha Goin <mgoin64@gmail.com >
2026-10-14 09:10:10 -07:00
30e79c3a76
[Core] Update PyTorch to 2.14.0, torchvision to 0.29.0, triton to 3.8.0 (release channel) ( #52183 )
...
Signed-off-by: Andrey Talman <atalman@users.noreply.github.com >
Signed-off-by: Andrey Talman <atalman@fb.com >
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-14 00:17:59 -07:00
Harry Mellor and Claude Opus 5.5
a8260cbc5c
[CI] Bump Transformers version to 5.19.0 ( #60381 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-07 10:01:41 -07:00
Harry Mellor and Claude Opus 5.5
d61081dc3d
[CI] Bump peft to satisfy transformers 5.18 minimum ( #59932 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-04 10:53:07 +00:00
Harry Mellor
9e0b6fcf77
[CI] Bump Transformers version to 5.18.0 ( #59621 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-10-04 00:42:35 +00:00
djramic
8882b83b34
[Bugfix] Bump tokenizers to 0.23.2 for duplicate-pattern support ( #59796 )
...
Signed-off-by: Djordje Ramic <djoramic@amd.com >
2026-10-02 18:33:50 +00:00
Juan Pérez de Algaba and Cursor
eef8b15d7c
[Security] Bump pyjwt and rand for remaining GHSAs ( #59427 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-09-30 14:26:16 +00:00
Juan Pérez de Algaba and Cursor
a4c4bb418e
[Security] Bump remaining Dependabot packages (excl. ignored) ( #59315 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-09-30 05:16:31 -07:00
Juan Pérez de Algaba and Cursor
eec2a86b1e
[Security] Bump nltk, aiohttp, pillow, and datamodel-code-generator ( #59249 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-09-29 16:00:36 -07:00
dfc8e0f3e2
[Frontend] Support strict MiMo-V2.6 tool calling ( #58019 )
...
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Signed-off-by: Ubospica <ubospica@gmail.com >
Signed-off-by: yuchuan <yuchuan.7streams@gmail.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-29 12:47:47 +00:00
73859fec58
[Frontend] Switch Python Harmony dependency to oss-harmony ( #55128 )
...
Signed-off-by: Anton Peganov <apeganov@nvidia.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-28 00:43:56 +04:00
Ziyang Ma
cfd5c20286
[XPU][UT] Align HF and vLLM inputs for Qwen2 embedding test by preventing Sentence Transformers from applying chat template ( #58117 )
...
Signed-off-by: RyanMa29 <ziyang.ma@intel.com >
2026-09-24 10:07:37 +00:00
Yan Ma and Kunshang Ji
e34489a543
[XPU] upgrade to PyTorch 2.14 ( #56013 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-09-23 09:18:52 +00:00
c58532c86b
[Frontend] Upgrade XGrammar to 0.2.7 and Rust structural tags to 0.3.0 ( #57272 )
...
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-18 11:44:05 +00:00
ec4a3a5370
[CI] Bump Transformers version to 5.17.0 ( #56108 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-09-16 06:34:16 -07:00
liuzhenwei
a08dffe215
[XPU][CI] update gpt-oss package version ( #56783 )
...
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com >
2026-09-15 10:23:14 +08:00
liuzhenwei
fe49665eb3
[XPU][CI] update test requirements ( #56704 )
...
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com >
2026-09-14 02:01:50 +00:00
Kunshang Ji
bde4feb061
[XPU][CI] Remove pip install dependency in test yaml files ( #55171 )
...
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com >
2026-09-12 20:03:12 +08:00
Walter Beller-Morales and Flora Feng
756794a9a7
[Frontend] create unified Cohere parser ( #56392 )
...
Signed-off-by: walterbm <walter.beller.morales@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-09-12 04:04:46 -04:00
Lucain and Claude Opus 5
b87339888d
[httpx migration] Import httpx from huggingface_hub ( #56460 )
...
Signed-off-by: Lucain Pouget <lucain@huggingface.co >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-11 16:29:31 +01:00
Tony Lin
e6821ceac9
[XPU][CI] Add decord to test requirements ( #56355 )
...
Signed-off-by: Tony Lin <tony.lin@intel.com >
2026-09-11 08:58:27 +00:00
Harry Mellor
e6eb9074e9
[CI] Bump Transformers version to 5.16.1 ( #53905 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-09-03 02:12:43 -07:00
Chauncey
339e16cbb6
[Bugfix] Support MCP SDK 2.x tool input schemas ( #53870 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-09-01 11:02:39 -04:00
rasmith and Andreas Karatzas
3593c964de
[ROCm] Add TheRock preview docker updates, Keep Python 3.12 and Ubuntu 22.04 ( #49925 )
...
Signed-off-by: Randall Smith <Randall.Smith@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-08-31 11:09:46 -05:00
7ca336929c
[Model] Remove ten deprecated model architectures ( #53608 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 17:06:00 -07:00
Aaron Hao
6cd9713463
[RL] P2P RDT weight sync ( #43375 )
2026-08-23 09:42:22 -07:00
Misha Goin and OpenAI Codex
2d7f42b4f3
[Build] Add InstantTensor to CUDA dependencies ( #52801 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-19 10:55:09 -04:00
Qiming Zhang
93eea4f665
[XPU][CI] downgrade sentencepiece ( #52904 )
...
Signed-off-by: mayuyuace <qiming1.zhang@intel.com >
2026-08-19 09:01:12 +00:00
Qiming Zhang
03b87dc42f
[XPU] upgrade requirements/test/xpu.txt ( #52672 )
...
Signed-off-by: mayuyuace <qiming1.zhang@intel.com >
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com >
2026-08-19 10:47:37 +08:00
Andreas Karatzas and OpenAI Codex
90984ddbed
[CI] Upgrade huggingface-hub to 1.28.0 ( #52797 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-18 13:35:44 -05:00
JasonCohere
5fee0a872d
chore: Upstream Cohere parser fixes + tests ( #51998 )
...
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com >
2026-08-13 05:05:36 -07:00
Kunshang Ji
7aa248fcfe
[XPU][CI/Release][2/N] add triton shim in xpu requirements ( #51935 )
...
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
2026-08-12 20:10:10 +08:00
Harry Mellor
c65aa2ee6c
Bump Transformers version to 5.15.0 ( #51668 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-11 09:00:51 -07:00
74c94b9f29
[CI] Upgrade huggingface-hub to 1.27.0 ( #51422 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-10 08:59:15 +01:00
Isotr0py
073c510c91
[Migration] Migrate bitsandbytes support to OOT plugin ( #43529 )
...
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-08-09 10:27:31 +08:00
a07086e403
[Misc] Upgrade fastsafetensors version, fix metadata is null ( #50827 )
...
Signed-off-by: lengrongfu <lenronfu@gmail.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-06 14:48:56 -07:00
397094da17
Resolve revision to commit_hash once per model load, via huggingface_hub's resolve_revision ( #49990 )
...
Signed-off-by: Wauplin <lucainp@gmail.com >
Signed-off-by: Lucain <lucainp@gmail.com >
Signed-off-by: Lucain Pouget <lucain@huggingface.co >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-08-05 13:49:56 +00:00
andrewbcohere and Cyrus Leung
9c110fa522
[Frontend] Cohere chat v2 api support ( #47189 )
...
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-07-31 22:53:54 -07:00
Julien Denize
1a20d23dab
[PARSER][Mistral] unified engine-based parser for reasoning and tool calls ( #48947 )
2026-07-30 15:38:00 +02:00
+13
aeeb36b1f1
[New model] Kimi K3 ( #50000 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai >
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com >
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com >
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
Co-authored-by: Isotr0py <mozf@inferact.ai >
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com >
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai >
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: Summer Yang <girasoleyang@gmail.com >
Co-authored-by: Kevin H. Luu <khluu000@gmail.com >
Co-authored-by: Bowen Wang <abmfy@icloud.com >
Co-authored-by: gnovack <novackgm@gmail.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai >
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com >
Co-authored-by: Roy Wang <yasong.wang@inferact.ai >
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com >
Co-authored-by: Codex <codex@openai.com >
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com >
2026-07-30 03:49:58 -07:00
Andreas Karatzas
435c4dad97
[ROCm][CI] Avoid Ray worker startup env race ( #50311 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
2026-07-29 17:30:29 -04:00
5b29c958c7
[XPU] upgrade to torch 2.13 ( #48677 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-07-29 01:24:56 -07:00
Chris Leonard and Shengqi Chen
247470f23a
[CI] Add PyTorch stable ABI audit check ( #48164 )
...
Signed-off-by: Chris Leonard <chleonar@redhat.com >
Co-authored-by: Shengqi Chen <harry-chen@outlook.com >
2026-07-28 02:37:01 -07:00
Harry Mellor
0d77325b10
Bump Transformers version to 5.14.1 ( #49223 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-23 21:16:49 -07:00
75ccdf3145
[Core] Update PyTorch to 2.13.0, torchvision to 0.28.0, triton to 3.7.1 ( #48155 )
...
Signed-off-by: Andrey Talman <atalman@users.noreply.github.com >
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-07-23 11:09:36 -07:00
Michael Goin and OpenAI Codex
cc25f028b7
[Loader] Improve InstantTensor loading ( #46868 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-07-17 16:30:02 -04:00
Artem Perevedentsev and Matthew Bonanni
7cd1d57b74
[CI/Build][Docker] Bump nvidia-cutlass-dsl to 4.6.0 and drop packaging workarounds ( #47442 )
...
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com >
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com >
2026-07-16 13:51:41 +00:00