 Nick HillandClaude Opus 4.8
|
5aab491bc9
|
[CI] Wire tests/models/inkling into a B200 job (#49325)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 15:43:20 +01:00 |
|
|
Stefano CastagnettaandBenjamin Chislett
|
5812e1a66b
|
[Test] Add DeepSeek MTP parallel-load tests (#41653)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-07-21 10:38:20 -04:00 |
|
|
|
8950394e0a
|
[Bugfix] Prefix-cache metrics double-counted when a KV connector defers requests (#48860)
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Lixi Zhang <muxixibbb@gmail.com>
Co-authored-by: harjothkhara <harjoth.khara@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-21 15:02:03 +01:00 |
|
|
Roberto L. Castro
|
7bb49be4d1
|
[Bugfix] Handle MLA fallback during FA4 JIT warmup (#49306)
|
2026-07-21 13:58:05 +00:00 |
|
|
Avery MiaoandKunshang Ji
|
c67650f04b
|
[XPU][DeepSeekV4]Add DeepSeek-V4 fuse_index_q SYCL kernel path (#45991)
Signed-off-by: Avery Miao <avery.miao@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-21 21:22:34 +08:00 |
|
|
Ilya MarkovandMarkov Ilya
|
f890e1dbe2
|
[BugFix] Set graph_pool_id before FULL CUDA graph capture in ModelRunner V2 (#48843)
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>
|
2026-07-21 08:59:26 -04:00 |
|
|
Umut Polat
|
040cbf95cc
|
[Misc] Use VLLMValidationError in chat completion tool and batch validators (#49214)
Signed-off-by: Umut Polat <52835619+umut-polat@users.noreply.github.com>
|
2026-07-21 11:38:20 +00:00 |
|
|
SyaandLi, Jiang <jiang1.li@intel.com>
|
5b3762a7f0
|
[Bugfix][CPU] Fix Clang OpenMP build on macOS (#49021)
Signed-off-by: markyangcc <mmdou3@163.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-07-21 09:58:52 +00:00 |
|
|
bastefaniak
|
4d30c510ce
|
[bugfix] Fix Cosmos3 Edge checkpoint weights filtering, video loading, prompt expansion (#49190)
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
|
2026-07-21 17:18:36 +08:00 |
|
|
|
6700813f86
|
[3/N][KV-Cache Layout Refactor] Standardize Mamba cache; drop get_transfer_cache_regions (#44456)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-21 09:16:15 +00:00 |
|
|
Bugen Zhao
|
eb44b3aaa4
|
[Rust][Benchmark] Use async HTTP clients (#49295)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-21 16:53:57 +08:00 |
|
|
Nicolò Lucchesi
|
7a98c7a392
|
[Misc] Remove old now unsupported max_num_partial_prefills and max_long_partial_prefills (#49244)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-21 08:52:52 +00:00 |
|
|
Lena Onyshchenko
|
0d9e60619b
|
[Misc][Docs] Fix XPU compute-runtime driver link version mismatch (#49299)
Signed-off-by: oonyshch <xonyshch@gmail.com>
|
2026-07-21 08:45:41 +00:00 |
|
|
vllm-agentandvllm-agent
|
1134545b6f
|
Revert "[Sampler] Stop upcasting logits to fp32 in apply_sampling_params" (#48641) (#49033)
Co-authored-by: vllm-agent <vllm-agent@users.noreply.github.com>
|
2026-07-21 09:36:45 +01:00 |
|
|
|
3e0c887511
|
[Bugfix] Fix Ovis2_5 special tokens for transformers v5 (#47298)
Signed-off-by: mgrunwal <milosz.grunwald@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-21 08:09:20 +00:00 |
|
|
Stefan Kaestle
|
adfbbc1005
|
Propagate Flash Attention cache configuration to Ray workers (#49177)
Signed-off-by: Stefan Kaestle <skaestle@nvidia.com>
|
2026-07-21 07:47:53 +00:00 |
|
|
Roy Wang
|
adc98f04d0
|
[Misc] Add @esmeetu to codeowners for rust/src/bench (#49298)
Signed-off-by: esmeetu <jasonailu87@gmail.com>
|
2026-07-21 07:44:24 +00:00 |
|
|
Alex YuanandClaude Opus 4.8
|
8def3cdde2
|
[Bugfix] Propagate quant_config to LFM2 ShortConv projections (#48917)
Signed-off-by: Alex Yuan <alex.yuan@liquid.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 06:51:55 +00:00 |
|
|
Guan-Ming ChiuandCyrus Leung
|
616c9bd0f4
|
[Frontend] Support additional sampling parameters for translation API (#45839)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-07-21 05:53:56 +00:00 |
|
|
Bugen Zhao
|
8688a06d67
|
[Rust][Benchmark] Use tracing for logs (#48937)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-21 05:18:13 +00:00 |
|
|
Salt Satoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f25953cc59
|
[Bugfix][Rust Frontend] Handle zero-column logprobs payloads without panicking (#49113)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Feathbow <feathbow@gmail.com>
|
2026-07-21 04:30:29 +00:00 |
|
|
|
d9aa35161d
|
Update BGE-M3 token expectations for leading spaces (#49269)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-07-21 03:49:17 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
6bcda970fd
|
[CI][NIXL] Isolate concurrent engine internal ports (#49129)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-20 22:28:11 -05:00 |
|
|
Isotr0py
|
ea0e9c8f2e
|
[MRV2] Add encoder cache profiling implementation (#47985)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-20 20:18:14 -07:00 |
|
|
Chauncey
|
94ed0bf4e0
|
[Bugfix][KV Offloading] Handle queued request aborts without allocated KV blocks (#49146)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-07-21 11:16:26 +08:00 |
|
|
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
1940c8441e
|
[Rust Frontend][gRPC] Add engine-aware health reporting (#48992)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
|
2026-07-21 10:54:39 +08:00 |
|
|
Simon Mo
|
72d16aee15
|
[CI] Exercise FA3 FP8 attention on SM90 (#49231)
Signed-off-by: Simon Mo <simon@inferact.ai>
|
2026-07-21 10:26:55 +08:00 |
|
|
Kunshang Ji
|
e78a0c8e59
|
[XPU][Doc] Update XPU docker image documents (#49148)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-21 10:11:27 +08:00 |
|
|
Chris Leonard
|
97a98006b0
|
Update qutlass cmake for stable abi (#47879)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
|
2026-07-20 18:31:10 -07:00 |
|
|
Alejandro Paredes La TorreandShengqi Chen
|
0a684ab0c0
|
[Bugfix] Fix WSL circular import from pin_memory warning_once (#48444)
Signed-off-by: AlejandroParedesLT <alejandroparedeslatorre@gmail.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-07-20 18:30:55 -07:00 |
|
|
|
0d9210a502
|
Fixes non-coalesced HBM access in marlin_int4_fp8_preprocess_kernel_awq (#47268)
Signed-off-by: xjx <493337577@qq.com>
Signed-off-by: flutist-alibaba <30485581+flutist@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-07-20 18:30:38 -07:00 |
|
|
Lena OnyshchenkoandCursor
|
1d874867ea
|
[Misc][Docs] Fix broken protocol link in speech_to_text doc (#47212)
Signed-off-by: oonyshch <xonyshch@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-21 01:05:05 +00:00 |
|
|
|
2e2e626b40
|
[Bugfix] Count per-group blocks in get_max_concurrency_for_kv_cache_config (#48317)
Signed-off-by: David Orman <ormandj@corenode.com>
Co-authored-by: Luke Alonso <lalonso@gmail.com>
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-07-21 00:29:10 +00:00 |
|
|
Nick Hill
|
af91f4b3e4
|
[Cleanup] Remove unused StructuredOutputRequest.status field (#49235)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-21 00:06:16 +00:00 |
|
|
|
2396a61108
|
[Attention][MLA][DCP] Query replication for MLA decode (DeepSeek-V2/R1 + Kimi-K2.5) (#45964)
Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-20 23:51:27 +00:00 |
|
|
|
97a668152b
|
[RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214)
Signed-off-by: Xuanyu Zhang <xuanyu.zhang@mistral.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-20 16:45:10 -07:00 |
|
|
|
58b2012aa2
|
[copy of #45208] CuMem slept-L1 fragmentation accounting (#49208)
Signed-off-by: haosdent <haosdent@gmail.com>
Signed-off-by: Justin Wood <justin.m.wood@me.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: haosdent <haosdent@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Justin Wood <jwood@me.com>
|
2026-07-20 23:08:11 +00:00 |
|
|
Ning Xie
|
b7c20d0cfa
|
[chore] adjust logo be more friendly to white background terminal (#48938)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-07-20 15:15:28 -07:00 |
|
|
TJian
|
a2b1f9fc3b
|
[ROCm] [Release] [Bugfix] Fix the per commit wheel release pipeline. (#49245)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-07-20 22:12:38 +00:00 |
|
|
Fynn Schmitt-UlmsandMichael Goin
|
642076d26c
|
Support loading sample_from_anchor flag from speculators config (#48639)
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-07-20 14:52:43 -07:00 |
|
|
Charlie Fu
|
5feb3950e5
|
[ROCm][CI] fix test_rocm_quick_reduce.py (#49234)
Signed-off-by: charlifu <charlifu@amd.com>
|
2026-07-20 16:39:33 -05:00 |
|
|
|
4ec199b66a
|
[Bugfix][Spec-Decode] Populate draft seq_lens_cpu_upper_bound for spec-decode attention metadata (#44492)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Signed-off-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-20 20:50:58 +00:00 |
|
|
Roberto L. Castroandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
7ca017778f
|
[Feat][Perf] Add new warmup infrastructure for JITs (#47451)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-20 13:21:55 -07:00 |
|
|
|
fbfe58133d
|
[Bugfix][KV Offload] Preserve reachable tails for hybrid SWA groups (#48911)
Signed-off-by: Colton Ottley <colton@ottleyengineering.com>
Co-authored-by: Colton Ottley <colton@ottleyengineering.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-07-20 22:12:36 +03:00 |
|
|
|
9dd62d80ab
|
Cosmos3 FP8 ModelOpt/Diffusers remapping (#48952)
Signed-off-by: Wojciech Kutak <wkutak@nvidia.com>
Signed-off-by: wkutak <wkutak@nvidia.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-07-20 11:31:48 -07:00 |
|
|
tc-mbandwjinxu
|
f878367898
|
[Revert][Bugfix] Restore MiniCPM-V 4.6 ViT QKV weight loader (#49193)
Signed-off-by: wjinxu <1299461899@qq.com>
Co-authored-by: wjinxu <1299461899@qq.com>
|
2026-07-20 18:17:46 +00:00 |
|
|
Matthew Bonanniandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
bd091079cb
|
[Attention] FlashAttention 4 SM100 FP8 kv cache support (#42569)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-20 10:53:27 -07:00 |
|
|
LiangqiusongandKunshang Ji
|
b23bd73f54
|
[XPU]add sycl path for Mhc (#47245)
Signed-off-by: root <xiaolong.guo@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-20 15:32:54 +00:00 |
|
|
Bugen Zhao
|
e2d7adeb64
|
[Rust Frontend] Bump xgrammar-structural-tag and enable local extension (#49161)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-20 16:22:24 +01:00 |
|
|
Isotr0py
|
15cb8e140d
|
[Multimodal] Allow keeping original image mode for ImageIO (#49159)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-20 13:42:45 +00:00 |
|