616 Commits
Author SHA1 Message Date
Jiangyun ZhuandCodex ec6b0494fe [CI] Bump CUTLASS DSL to 4.7 (#54927)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <codex@openai.com>
2026-09-11 20:11:29 -07:00
Lyle Lai dffb863c97 Upgrade tpu-inference to v0.29.0 (#56388)
Signed-off-by: Lyle Lai <lyle.lai@cienet.com>
2026-09-11 12:32:47 -07:00
LucainandClaude Opus 5 b87339888d [httpx migration] Import httpx from huggingface_hub (#56460)
Signed-off-by: Lucain Pouget <lucain@huggingface.co>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-11 16:29:31 +01:00
Tony Lin e6821ceac9 [XPU][CI] Add decord to test requirements (#56355)
Signed-off-by: Tony Lin <tony.lin@intel.com>
2026-09-11 08:58:27 +00:00
Wei ZhaoandOpenAI Codex 8c87c333b8 [Perf] Fix TRTLLM ragged prefill perf regression (#55499)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-09 20:38:20 +00:00
385dce36bc [CI/Build][Hardware][NVIDIA] Add public CUDA 13.4 Rubin build path (#54640)
Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com>
Signed-off-by: meena-at-work <80416898+meena-at-work@users.noreply.github.com>
Signed-off-by: Shang Wang <shangw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
2026-09-09 04:53:12 +00:00
cjackalmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Flora Feng
bf339618d1 [Misc] Bump openai to >=2.25.0 to support namespace tools types (#49104)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-09-08 14:11:12 -07:00
Harry Mellor e6eb9074e9 [CI] Bump Transformers version to 5.16.1 (#53905)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-09-03 02:12:43 -07:00
Giuseppe GrossiandAndreas Karatzas e47356c63e [ROCm][Installation] Add mooncake package to image using public wheels (#55002)
Signed-off-by: Giuseppe Grossi <ggrossi@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-09-02 21:48:36 -05:00
Chauncey 339e16cbb6 [Bugfix] Support MCP SDK 2.x tool input schemas (#53870)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
2026-09-01 11:02:39 -04:00
Zhenzhong Xu e29af0a2af [XPU] bump up auto-round-lib to 0.15.0 (#54515)
Signed-off-by: Zhenzhong1 <zhenzhong.xu@intel.com>
2026-09-01 08:24:28 +08:00
rasmithandAndreas Karatzas 3593c964de [ROCm] Add TheRock preview docker updates, Keep Python 3.12 and Ubuntu 22.04 (#49925)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-31 11:09:46 -05:00
7ab2923489 [Flashinfer] Upgrade Flashinfer version to 0.6.18 (#54313)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
2026-08-30 16:01:05 -07:00
Xinyu Chen 94a54f581e [XPU]bump up vllm_xpu_kernels to 0.1.14.1 (#54203)
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
2026-08-28 07:12:17 -07:00
Dennis Yeh d262964e8c Upgrade tpu-inference to v0.28.0 (#54020)
Signed-off-by: dennis yeh <dennis.yeh@cienet.com>
2026-08-27 14:25:00 -07:00
7ca336929c [Model] Remove ten deprecated model architectures (#53608)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 17:06:00 -07:00
Aaron Hao 6cd9713463 [RL] P2P RDT weight sync (#43375) 2026-08-23 09:42:22 -07:00
Cyrus Leung 0b19ebcacd [MM] Simplify _apply_hf_processor_main (#53275)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-22 01:49:37 -07:00
Dennis Yeh ae25628995 upgrade tpu-inference to v0.27.0 (#53088) 2026-08-20 16:21:39 +00:00
Misha GoinandOpenAI Codex 2d7f42b4f3 [Build] Add InstantTensor to CUDA dependencies (#52801)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-19 10:55:09 -04:00
Qiming Zhang 93eea4f665 [XPU][CI] downgrade sentencepiece (#52904)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
2026-08-19 09:01:12 +00:00
Qiming Zhang 03b87dc42f [XPU] upgrade requirements/test/xpu.txt (#52672)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
2026-08-19 10:47:37 +08:00
Andreas KaratzasandOpenAI Codex 90984ddbed [CI] Upgrade huggingface-hub to 1.28.0 (#52797)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-18 13:35:44 -05:00
Wei Zhao 689be2bcd3 Upgrade Flashinfer version to 0.6.17 (#52681)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
2026-08-18 23:04:36 +08:00
c89d692cb5 [Build] Propagate vLLM version to Rust binaries (#52593)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-17 23:37:37 -07:00
9633933dd8 Relax CuPy constraint to only exclude 14.1.0 (#44284)
Signed-off-by: khluu <kevin@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: khluu <kevin@inferact.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-08-17 19:41:09 +00:00
Kunshang Ji 624999aae5 [XPU]bump up vllm_xpu_kernels to 0.1.13.2 (#52138)
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-14 17:01:37 +08:00
JasonCohere 5fee0a872d chore: Upstream Cohere parser fixes + tests (#51998)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
2026-08-13 05:05:36 -07:00
ovidiusm 5658391af7 Remove NIXL reinstall step (#51882)
Signed-off-by: Ovidiu Mara <ovidium@nvidia.com>
2026-08-12 22:44:05 -07:00
Kunshang Ji 7aa248fcfe [XPU][CI/Release][2/N] add triton shim in xpu requirements (#51935)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-12 20:10:10 +08:00
Harry Mellor c65aa2ee6c Bump Transformers version to 5.15.0 (#51668)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-11 09:00:51 -07:00
Lucas Wilkinson 789c4f905e [CI] Bump CUTLASS DSL to 4.6.2 (#51566) 2026-08-10 09:06:08 -04:00
Kunshang Ji d89ba6481b [XPU] bump up xpu kernel to v0.1.12.3 (#50441)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-10 16:09:23 +08:00
74c94b9f29 [CI] Upgrade huggingface-hub to 1.27.0 (#51422)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-10 08:59:15 +01:00
f18e10a7e1 Bump Flashinfer version to 0.6.16.post3 (#50892)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
2026-08-09 00:54:07 -07:00
Isotr0py 073c510c91 [Migration] Migrate bitsandbytes support to OOT plugin (#43529)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-08-09 10:27:31 +08:00
Jiangyun Zhu 27d7303802 [CI] Fix Batch Invariance (B200) (#51417)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
2026-08-07 13:45:29 -07:00
Jinzhen LinandOpenAI Codex fcde8e1460 [Refactor] refactor humming linear and moe backends to use explicit layer configs (#49610)
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-07 10:03:19 -07:00
rongfu.lengNick Hillmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
a07086e403 [Misc] Upgrade fastsafetensors version, fix metadata is null (#50827)
Signed-off-by: lengrongfu <lenronfu@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-06 14:48:56 -07:00
397094da17 Resolve revision to commit_hash once per model load, via huggingface_hub's resolve_revision (#49990)
Signed-off-by: Wauplin <lucainp@gmail.com>
Signed-off-by: Lucain <lucainp@gmail.com>
Signed-off-by: Lucain Pouget <lucain@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-05 13:49:56 +00:00
Nicolò Lucchesi 8ba87e0181 [CI] Mooncake PD integration tests (#46844)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
2026-08-03 06:55:51 -07:00
andrewbcohereandCyrus Leung 9c110fa522 [Frontend] Cohere chat v2 api support (#47189)
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-07-31 22:53:54 -07:00
Dennis Yeh 7c08664f5c Upgrade tpu-inference to v0.26.0 (#50522) 2026-07-31 16:22:42 +00:00
ylangtsouandYlang Tsou 10ad649d6c Update torch version to 2.13.0+cpu (#50412)
Signed-off-by: Ylang Tsou <ylangt@google.com>
Co-authored-by: Ylang Tsou <ylangt@google.com>
2026-07-31 15:57:16 +00:00
Julien Denize 1a20d23dab [PARSER][Mistral] unified engine-based parser for reasoning and tool calls (#48947) 2026-07-30 15:38:00 +02:00
+13 aeeb36b1f1 [New model] Kimi K3 (#50000)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gnovack <novackgm@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
2026-07-30 03:49:58 -07:00
Andreas Karatzas 435c4dad97 [ROCm][CI] Avoid Ray worker startup env race (#50311)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-07-29 17:30:29 -04:00
5b29c958c7 [XPU] upgrade to torch 2.13 (#48677)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-07-29 01:24:56 -07:00
Chris LeonardandShengqi Chen 247470f23a [CI] Add PyTorch stable ABI audit check (#48164)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
2026-07-28 02:37:01 -07:00
Harry Mellor 0d77325b10 Bump Transformers version to 5.14.1 (#49223)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-07-23 21:16:49 -07:00