 Roberto L. Castroandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
d7192cfccf
|
[CI Bugfix] Lazily import Qwen warmup dependencies (#47539)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-03 23:10:49 +08:00 |
|
|
AgenticSpark
|
978de83353
|
[Bugfix][CPU] Ship examples/ in the CPU release image (#47447)
Signed-off-by: liejiang <jianglie2023@gmail.com>
|
2026-07-03 11:46:24 +00:00 |
|
|
wang.yuqi
|
a14f57a3ac
|
[Frontend] Refine the entrypoint class's inheritance hierarchy. (#47498)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-03 10:50:06 +00:00 |
|
|
David FengandClaude
|
18f658bb31
|
[Bugfix][Frontend] Fix batch chat endpoint corrupting logprobs when return_token_ids is set (#47384)
Signed-off-by: David Feng <fenghourun@meta.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-03 03:01:34 -07:00 |
|
|
Isotr0py
|
400a9c386d
|
[Rust Frontend] Bump llm-multimodal version (#47530)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-03 09:48:36 +00:00 |
|
|
Max de Bayser
|
bbdcbe4686
|
Move Roberta remaining nn.Embedding to VocabParallelEmbedding (#47452)
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
|
2026-07-03 09:47:50 +00:00 |
|
|
Kalyanam Dewri
|
4875b4456b
|
[Doc] Fix VLM2Vec benchmark chat template path (#47517)
Signed-off-by: kalyanamdewri <kalyanampriyam@gmail.com>
|
2026-07-03 08:24:45 +00:00 |
|
|
Dakai An
|
1f486d96a1
|
Add Triton Backend for Unlimited-OCR R-SWA (#47102)
Signed-off-by: Dakai An <dakaian108@gmail.com>
|
2026-07-03 00:11:50 -07:00 |
|
|
Bugen Zhao
|
b790c84cde
|
[CI] Enable sccache for Rust build under CUDA/ROCm (#45246)
|
2026-07-02 23:45:41 -07:00 |
|
|
yangyang-cs95andBugen Zhao
|
6429d5f527
|
[Rust Frontend] add repetition_detection support to sampling params (#46684)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 14:06:23 +08:00 |
|
|
Chris Leonard
|
fbc9ba6d30
|
New stable abi cleanup (#46656)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
|
2026-07-03 14:02:26 +08:00 |
|
|
xiangdong
|
2dfaae752b
|
[XPU][CI]Fix dependency typo in Intel GPU CI (#47510)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-07-03 04:11:47 +00:00 |
|
|
Evgeny Parshutin
|
bd8d9021ce
|
[CPU][Build] Enable oneDNN ITT task collection by default for CPU primitive-level profiling (#47467)
Signed-off-by: Evgeny Parshutin <eugeny.parshutin@intel.com>
|
2026-07-03 04:00:19 +00:00 |
|
|
xiangdong
|
3f0b773b30
|
[XPU][CI]Mv huggingface cache to larger disk in Intel GPU CI (#47405)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-07-03 11:56:17 +08:00 |
|
|
Reid
|
9b8e76589d
|
[Rust Frontend] Recover buffered text from incomplete tool calls at EOS (#47289)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-03 03:45:03 +00:00 |
|
|
Ting SUNandBugen Zhao
|
1aeabec355
|
[Bugfix][Rust Frontend] Tolerate out-of-vocab prompt ids in detokenizer (#44682)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 03:41:53 +00:00 |
|
|
Luciano MartinsandLuciano Martins
|
979f5511d7
|
[Bugfix][Gemma4] Keep image bidirectional attention within the sliding window (#47217)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-07-02 19:57:41 -07:00 |
|
|
Michael GoinandClaude Fable 5
|
41de1380c2
|
[BugFix] Derive FlashInfer Q dtype from resolved per-group builder state (#47485)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-02 19:33:28 -07:00 |
|
|
Nick Hill
|
d85601c20f
|
[CI] Pin modelscope version to fix test breakage (#47465)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 19:33:08 -07:00 |
|
|
Nick Hill
|
276b837dc4
|
[ModelRunner V2][BugFix] Free all model refs on shutdown (#47483)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 19:32:48 -07:00 |
|
|
wenjun liuandzengxian
|
34bf7b45a0
|
[CI] intel CI: add quantization and awq case for xpu (#46456)
Signed-off-by: wenjun.liu <wenjun.liu@intel.com>
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Co-authored-by: zengxian <xiangdong.zeng@intel.com>
|
2026-07-03 09:51:56 +08:00 |
|
|
adamkbaranowski
|
4c3c64fcf7
|
Add Laguna XS.2.1 DFlash drafter support (#46853)
Signed-off-by: Adam Baranowski <adam.baranowski@poolside.ai>
|
2026-07-02 18:09:27 -07:00 |
|
|
Andreas Karatzas
|
442ccc6098
|
[ROCm][CI] Adding extract hs 2gpu (#47482)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-02 17:59:38 -07:00 |
|
|
Andreas Karatzas
|
6768fbc76f
|
[ROCm][CI] Adding qwen3 dp4 eplb (#47480)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-02 17:58:56 -07:00 |
|
|
Andreas Karatzas
|
407f406300
|
[ROCm][CI] Adding metadata (#47477)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-02 17:45:23 -07:00 |
|
|
Harry Mellor
|
e24d1b24fe
|
Fix Transformers modeling backend usage stats (#47472)
|
2026-07-02 12:51:23 -07:00 |
|
|
Dan BlanaruandMatthew Bonanni
|
d29125c085
|
Xqa decode kernels (#43232)
Signed-off-by: Dan Blanaru <48605845+DanBlanaru@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-02 12:32:05 -07:00 |
|
|
Michael Goin
|
d715b3aa1e
|
Delete PagedAttention (#47361)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-02 12:31:26 -07:00 |
|
|
Joe Rowell
|
258f8de91f
|
[Bugfix][Tool Parser] poolside_v1: accept tool calls without newline after function name (#47311)
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
|
2026-07-02 12:08:37 -07:00 |
|
|
Nick Hill
|
e392bf7a68
|
[BugFix][MRV2] Ensure all req slots are accounted for when scheduling (#46974)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 10:19:24 -07:00 |
|
|
Nick Hill
|
443e68cfa6
|
[Bugfix] Fix pooled Whisper encoder sliding-window kernel size (#47437)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 10:19:11 -07:00 |
|
|
Chauncey
|
320ee285c9
|
[Model Runner V2][Perf] Warm up GLM-5.2 DSA indexer prefill metadata kernel (#47285)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-07-02 16:31:31 +00:00 |
|
|
Bugen Zhao
|
ec0ffaacc8
|
[Rust Frontend] Improve scheduler stats logging parity (#47435)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-02 15:55:25 +01:00 |
|
|
Yuxuan Zhang
|
178fd56094
|
support GLM-5.2 gate use FP32 (#47410)
Signed-off-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk>
|
2026-07-02 22:45:39 +08:00 |
|
|
Woosuk KwonandClaude Fable 5
|
a47f38f825
|
[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in block verification kernels (#47383)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-02 07:32:38 -07:00 |
|
|
Nick Hill
|
3e158ae62d
|
[ModelRunner V2] Fix Mamba2 crash on non-spec-decode (#47428)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 07:05:16 -07:00 |
|
|
Wentao YeandNick Hill
|
a2f713002d
|
[ModelRunner V2] Enable by default for all dense models (#44443)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 18:48:57 +08:00 |
|
|
TJian
|
de2a8fc042
|
[ROCm] [PyTorch] Move to stable abi since ROCm upgraded to torch 2.11 (#47128)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-07-02 18:34:07 +08:00 |
|
|
Michael Goin
|
84b9c2762f
|
Update DeepGEMM tag to point to latest nv-dev branch for sm120 support (#47304)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-02 18:33:44 +08:00 |
|
|
Bugen Zhao
|
25fcb65d51
|
[Rust Frontend] Use enum-backed domain types for engine outputs and structured outputs (#47283)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-02 10:41:46 +01:00 |
|
|
Pranav ThakurandBugen Zhao
|
08a8a4af3f
|
feat(rust): expose profiler control routes in Rust frontend (#46306)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-02 08:46:07 +00:00 |
|
|
|
b0b8a286dd
|
[Model] Add LLaVA-OneVision-2 (LlavaOnevision2ForConditionalGeneration) (#44785)
Signed-off-by: chengzheng345 <209475443+chengzheng345@users.noreply.github.com>
Co-authored-by: chengzheng345 <209475443+chengzheng345@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-02 16:41:49 +08:00 |
|
|
|
3af8789559
|
[Feature] Universal speculative decoding for heterogeneous vocabularies (TLI) (#38174)
Signed-off-by: wan-danfeng <wandanfeng0802@gmail.com>
Signed-off-by: Wonderful <wandanfeng0802@gmail.com>
Co-authored-by: Wan_DF <wonderful199082@126.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-07-02 01:34:20 -07:00 |
|
|
Chaojun Zhang
|
8357226f4f
|
[XPU][CI] Split test_punica_ops into separate pytest invocations for stability (#47376)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-07-02 07:50:55 +00:00 |
|
|
Hiki
|
2665ed704b
|
[Bugfix][Kernel] Correct FlashInfer CUTLASS MoE tuning token bound (#46838)
Signed-off-by: Haobin Guo <haobing@nvidia.com>
|
2026-07-02 05:11:00 +00:00 |
|
|
xaguilar-amd
|
09663abde0
|
[ROCm][MLA] Fuse MLA q/kv RMSNorm + FP8 per-token quant in the FP8 attention path (#44977)
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
Signed-off-by: Xavier Aguilar <Xavier.AguilarFruto@amd.com>
|
2026-07-02 13:00:41 +08:00 |
|
|
Giancarlo Delfin
|
d63c8e9444
|
[BugFix][Spec Decode] Compact shared topk indices buffer after first MTP draft step (#47238)
|
2026-07-01 21:38:51 -07:00 |
|
|
Jee Jee Li
|
1360c42fe6
|
[UX] Include NVTX in cuda.txt (#47319)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-07-01 19:38:50 -07:00 |
|
|
Jee Jee Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
d0a2584773
|
[Misc] Use functions instead of PTX for the PDL instruction (#46984)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-01 19:38:35 -07:00 |
|
|
peizhang56andClaude
|
7fe7fa9cda
|
[CI][Bugfix] Rerun test_engine_log_metrics_ray on Ray GCS startup timeout (#47208)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 21:32:09 -05:00 |
|