Commit Graph
17504 Commits
Author SHA1 Message Date
x41lakazam 3508cb78d4 [Bugfix] Fix broken profile_modular_kernel.py (#43300) 2026-06-11 12:17:23 +01:00
Harry Mellor 432905d5d6 Only enable PR docs builds manually (#45262)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-06-11 03:14:29 -07:00
Ting SUNandBugen Zhao 1f9dd7900d [Bugfix][Rust Frontend] Validate out-of-vocab token ids in request params (#44680)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
2026-06-11 03:14:11 -07:00
Juan Pérez de Algabaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 9492362972 [Security] Apply sanitize_message to Anthropic and STT error paths (#45119)
Signed-off-by: jperezde <jperezde@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-11 10:05:34 +00:00
7852e50e4d [docs] Document --scheduler-cls base class requirement (extend AsyncScheduler, not Scheduler) (#43724)
Signed-off-by: Georgii Kliukovkin <kliukovkin@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-06-11 10:49:51 +01:00
Reid 0d657e44dc [Rust Frontend] Fix DeepSeek V3.2 continue_final_message rendering (#45155)
Signed-off-by: reidliu41 <reid201711@gmail.com>
2026-06-11 09:34:19 +00:00
王金旭andCursor aa1df36c53 Fix/minicpmv46 missing version (#44980)
Signed-off-by: wjinxu <1299461899@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-11 09:20:45 +00:00
wcyandlyd1992 f06aefb4e3 [CPU] Add missing scalar fallback for CPU W4A8 INT4 GEMM (#44523)
Signed-off-by: wcy <233313160abc@gmail.com>
Co-authored-by: lyd1992 <liuyudong@iscas.ac.cn>
2026-06-11 08:52:01 +00:00
Julien Denize 1c3a72b8b2 [Bugfix] Add fetch_images to MistralCommonImageProcessor (#45180)
Signed-off-by: juliendenize <julien.denize@mistral.ai>
2026-06-11 16:13:01 +08:00
Juan Pérez de Algaba d598d23973 [Security] Reject non-finite temperature and repetition_penalty values (#45116)
Signed-off-by: jperezde <jperezde@redhat.com>
2026-06-11 01:12:14 -07:00
Juan Pérez de Algaba f219788f91 [Security] Fix info disclosure via int32 truncation in GGUF dequantize kernels (#44971)
Signed-off-by: jperezde <jperezde@redhat.com>
2026-06-11 08:05:14 +00:00
Chris LeonardandShengqi Chen 6e64c1bab1 [10c/n] Migrate MoE kernels to torch stable ABI (#44565)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
2026-06-10 23:02:26 -07:00
Kevin H. Luu 2f2c5cf4f1 [release] Always block release images to dockerhub (#45236)
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
2026-06-10 22:53:04 -07:00
Mohammad Miadh Angkad 40e065e86a [Docker] Fix CUTLASS DSL cu13 install order in Dockerfile (#45204)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-11 05:19:36 +00:00
Yuanyuan ChenandLi, Jiang <jiang1.li@intel.com> 0b995f8609 Use std::bit_cast for type punning in CPU kernels (#45089)
Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
2026-06-10 22:07:44 -07:00
Bugen Zhao 43914dd743 [Rust Frontend] Add Python bridge for Rust tool parsers (#44624)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-06-11 04:51:06 +00:00
Prajjwal ChittoriandShengqi Chen 3501324957 [Build] fix self-contradictory precompiled-flag orthogonality test (#44942)
Signed-off-by: pjdurden <prajjwalchittori1@gmail.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
2026-06-11 12:49:08 +08:00
Flora Feng 3a04061701 [Refactor][Parser] Unify Response API to use parser.parse() like Chat Completion API (#45190)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-06-11 04:37:51 +00:00
Yifan Qiao f272dfdce1 [KV Connector] Mooncake store: prefix-cache retention interval for sparse attention (#44774) 2026-06-10 21:36:34 -07:00
velonica0 f31bc2ea60 [CPU][RISC-V] Enable oneDNN W8A8 INT8 to run on RISC-V (#44478)
Signed-off-by: velonica0 <like@mail.nankai.edu.cn>
2026-06-11 04:09:05 +00:00
ankrovvandFlora Feng 248e33c40d [Bugfix][Responses API] Set id on function_call item in streaming done event (#44608)
Signed-off-by: Aniruddh Krovvidi <aniruddh.krovvidi@oracle.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-06-11 03:52:42 +00:00
Bugen Zhao 5d5591d99b [Rust Frontend] Populate cached_token_count in responses (#44887)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-06-10 20:50:05 -07:00
Wentao Ye 85a0ffae42 [CI Bug] Remove qwen test ValueError: No example model defined for Qwen/Qwen-7B-Chat (#45194)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-06-10 20:11:00 -07:00
Harry Mellor 18d87a87dc Deprecate Transformers v4 support (#45161)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-06-11 11:04:01 +08:00
Flora Feng b038a2f73b [CI][Bugfix] Update Dockerfile dependency graph PNG (#45209)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
2026-06-10 19:40:25 -07:00
Ting SUN 2d481f8a94 [Bugfix][Rust Frontend] Stop unescaping XML-style tool-call parameter values (#45025)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
2026-06-10 19:05:23 -07:00
Rohan PotdarandAndreas Karatzas 7920ccb97c [Bugfix]: Fix Quark gpt-oss weight loading broken by FusedMoe refactor (#45067)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-06-10 18:17:46 -07:00
Wentao Ye 86111c00c7 [Chore] Add Github notification for MRv2 for @yewentao256 (#45191)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2026-06-11 09:01:49 +08:00
qizixi e2db0222e9 [Perf][Attention] Pin MLA chunked-context metadata tensors so H2D copies are truly non-blocking (#45074)
Signed-off-by: zixi-qi <zixi@inferact.ai>
2026-06-10 15:56:49 -07:00
Dan BlanaruWentao Yemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
82d6b59f04 [CI/Build] Skip test_use_trtllm_attention on non-CUDA platforms (#44687)
Signed-off-by: Dan Blanaru <48605845+DanBlanaru@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-10 18:18:42 -04:00
Andreas Karatzas 16282a9c4e [ROCm][CI] Moving MI300 tests to MI325 until cluster is stabilized (#45170)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-06-10 20:26:17 +00:00
Rohan PotdarandAndreas Karatzas 5b6b536fdc [ROCm][Bugfix] Make intermediate_pad TP-aware in rocm_aiter_fused_experts (#44679)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-06-10 15:10:50 -05:00
Nathan PriceCursorCyrus Leungmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
12f3f19c19 feat(qwen3-asr): support prompt parameter in v1/audio/transcriptions (#35415)
Signed-off-by: Nathan Price <nathan@abridge.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-10 19:54:59 +00:00
Ilya Markov 6471ec75bd [EPLB] Reject NCCL-based EPLB communicators with async EPLB (#44978)
Signed-off-by: Markov Ilya <markovilya197@gmail.com>
2026-06-10 19:51:27 +00:00
3d300aecb1 [Doc] Switch K8S examples to default MP mode (#39400)
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
2026-06-10 18:17:11 +00:00
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> ffce72c041 [Model Runner V2] Fix v2 AttributeError: 'CohereASRDecoder' object has no attribute 'embed_input_ids' (#44568)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-10 11:06:01 -07:00
TJian bfe1001ab6 [Bugfix] [DSV4] [ROCm] Pin apache-tvm-ffi version to 0.1.10 (#45169)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
2026-06-10 17:41:15 +00:00
Tyler Michael SmithandClaude Opus 4.6 fa8c868a3c [Bugfix] Fix Llama4 weight loading (#45047)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-06-10 13:40:45 -04:00
Ben Browning d1bcb4b44c [Bugfix] Fix tool parsing crash with non-function tool types (e.g. WebSearchTool) (#45147)
Signed-off-by: Ben Browning <bbrownin@redhat.com>
2026-06-10 17:17:16 +00:00
bnellnm 29026682cb [Bugfix] Fix nemotron accuracy drop introduced by #41184 (#45037)
Signed-off-by: Bill Nell <bnell@redhat.com>
2026-06-10 13:16:25 -04:00
Stan Wozniak dc66e01a70 [Hybrid] Marconi-style admission policy for hybrid cache (#37898)
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
2026-06-10 10:03:13 -07:00
Yongye Zhu 2ba68d9bf7 [Test] Fix one-sided MNNVL alltoall test workspace under-reservation (#44946)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
2026-06-11 00:43:12 +08:00
Julien Denize 2131b597b1 [CI] Ping Mistral team for ministral/voxtral/mixtral/pixtral changes (#45153)
Signed-off-by: juliendenize <julien.denize@mistral.ai>
2026-06-10 08:48:00 -07:00
Benjamin ChislettandGiancarlo Delfin 0bae1d3848 [MRV2][Spec Decode] DFlash (#44586)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
2026-06-10 08:47:46 -07:00
Yufeng He 4673ca1d78 fix: prefix DeepSeek V4 MTP projections (#44821)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
2026-06-10 08:47:04 -07:00
Angela Yi de900fa7e5 fix: AOT compile cache collision for dataclass-based HF configs (#45059)
Signed-off-by: Angela Yi <yiangela7@gmail.com>
2026-06-10 08:05:29 -07:00
Divakar Verma 166d14e9bf [bugfix] skip conch kernel for g_idx reordering (#45072)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
2026-06-10 23:04:19 +08:00
Effi OferandOr Ozeri af65e08fc5 KV-Cache multi-tier offloading async batched lookup (#44193)
Signed-off-by: Effi Ofer <effi.ofer@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-06-10 14:59:30 +00:00
Harry Mellor 3cc9fecd58 Deprecated 1st generation Qwen and QwenVL models (#45131)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-06-10 14:55:33 +00:00
Jongsu Liam KimandClaude ccc05de038 [Bugfix] Fix missing sequence_lengths in EXAONE-4.5 vision encoder (#45073)
Signed-off-by: Jongsu Liam Kim <jongsukim8@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-06-10 15:44:34 +01:00