|
0db502c8d8
|
[Kimi-K3] support DCP partial prefix cache hit (#50493)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-17 17:05:51 -07:00 |
|
|
Kunshang Ji
|
0e8989b416
|
[ROCm] gaurd on_gfx1250 call with rocm platform (#52625)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-18 08:05:48 +08:00 |
|
|
Tommy AsaiandRoger Wang
|
58aa1e3d26
|
[Bugfix][SM120][MLA] Disable dense prefill for FlashInfer sparse MLA (#51395)
Signed-off-by: tommy-asai-sonarsource <yosuke.asai@sonarsource.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-17 16:58:02 -07:00 |
|
|
Jakub ByczkowskiandCopilot
|
c296cf8259
|
[Bugfix] Add forward_xpu to XDRotaryEmbedding for HunyuanOCR on XPU (#52174)
Signed-off-by: Jakub Byczkowski <jakub.byczkowski@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-08-18 07:54:05 +08:00 |
|
|
Divakar Verma
|
49fb2ee348
|
[ROCm][CI] add Aiter ops tests (#52208)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-08-17 18:33:22 -05:00 |
|
|
|
5ae2d38821
|
[Perf][Structured Output] Skip unused request-local reasoners (#52573)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-17 16:30:41 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
60c3a31b12
|
[CI][AMD] Improve Kubernetes failure diagnostics (#52264)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-17 18:09:12 -05:00 |
|
|
Canlin GuoandNick Hill
|
455edc022b
|
[ModelRunnerV2] Support prompt embeds (#42963)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: Canlin Guo <961750412@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-17 21:58:50 +00:00 |
|
|
Hongxia YangandAndreas Karatzas
|
e68fb75b25
|
[ROCm][AMD][Installation] add LMCache kv-connector installation and runtime packages to docker image (#51208)
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 16:58:48 -05:00 |
|
|
Micah Williamson
|
8878ebd8fd
|
[ROCm][CI] Expand AITER W4A4 MoE Coverage (#52647)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-08-17 15:46:22 -05:00 |
|
|
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f08a95f8d8
|
[Rust Frontend][gRPC] Advertise LoRA capabilities (#52031)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 13:27:56 -07:00 |
|
|
Wei Zhao
|
d1e3eee6fb
|
[Spec decode] Support Kimi-K3 DCP with DSpark (#52188)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-17 13:08:45 -07:00 |
|
|
|
9633933dd8
|
Relax CuPy constraint to only exclude 14.1.0 (#44284)
Signed-off-by: khluu <kevin@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: khluu <kevin@inferact.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-17 19:41:09 +00:00 |
|
|
crZhao
|
3fc2893909
|
[Bugfix] Account for local DP workers in startup thread allocation (#52385)
Signed-off-by: real-cpu <zhaochenrui757@gmail.com>
|
2026-08-17 12:10:34 -07:00 |
|
|
Andreas Karatzasandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
c1e438728c
|
[ROCm][CI] Restore Torch defaults and type DSV4 scratch buffers (#52566)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 18:32:04 +00:00 |
|
|
|
75dde08d3f
|
[Perf][MoE] Optimize deepep_v2 receiver CPU Overhead (#51114)
Signed-off-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-08-17 18:21:32 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
402547d7f0
|
[Bugfix][CI] Release the shared ColBERT engine before test_colbert_hf_comparison (#52608)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 17:50:26 +00:00 |
|
|
Juan Pérez de Algaba
|
ceb340e2eb
|
fix: prevent PyNvVideoCodec decoder slot limit bypass via ClassVar shadowing (#52126)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-17 17:45:40 +00:00 |
|
|
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟
|
cfbc5afbf7
|
[BugFix] lora_base_layer / routed_experts order in expert param mapping (#52552)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
|
2026-08-17 17:40:51 +00:00 |
|
|
Roberto L. CastroandCodex
|
49905ad94d
|
[3/N][Feat][Perf] Add new warmup infrastructure for JITs. Add provider registry and orchestration for JIT warmup (#50174)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-17 10:11:14 -07:00 |
|
|
Misha Goin
|
7075ddac28
|
Support DSpark configs with architectures=DSparkDraftModel + model_type=qwen3 (#52197)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-17 12:48:30 -04:00 |
|
|
Misha Goin
|
4ab5e5012a
|
[Refactor] Simplify B12X linear kernels and warmup (#52368)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-17 09:45:45 -07:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
017e9f4448
|
Promote prefix_cache_retention_interval to an argument and change the default to 0 (#52216)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-17 13:20:50 +00:00 |
|
|
qli88
|
1d3a8b9e22
|
[ROCm][Bugfix] Fix Triton W4A16 bug in determining if transpose is required for GPTQ/AutoGPTQ (#48998)
Signed-off-by: Qiang Li <qiang.li2@amd.com>
|
2026-08-17 12:26:05 +00:00 |
|
|
|
70afdedc10
|
[K3] support recoverssm for K3 (#51855)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 19:34:14 +08:00 |
|
|
|
f27ae25473
|
[Bugfix][CPU] Take an attention group's query head count from its layers (#51852)
Signed-off-by: Ganesh R <Ganesh.R@amd.com>
Signed-off-by: R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-17 18:45:59 +08:00 |
|
|
OlaandOpenAI Codex
|
95901ce70a
|
fix(pooling): validate BGE-M3 combined task ownership (#51823)
Signed-off-by: Zhe Li <2843409461@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-17 10:30:35 +00:00 |
|
|
pmanczak
|
cc7cf71fc8
|
[XPU] Enable Kimi K3 KDA kernel tests on XPU (#51809)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-08-17 17:21:34 +08:00 |
|
|
Kevin H. Luu
|
bb233626ca
|
[CI] Shard Humming A100 eval (#52325)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-17 02:03:33 -07:00 |
|
|
TJian
|
c05d923f18
|
[Doc] [ROCm] Update installation documentation (#52303)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-08-17 01:56:44 -07:00 |
|
|
Amal Sebastian
|
0ff370b51c
|
docs: fix incorrect --custom-skip-chat-template flag reference (#52588)
|
2026-08-17 01:48:11 -07:00 |
|
|
Isotr0py
|
5fd7a88838
|
[CI/Build] Fix accident pre-commit breakage due to concurrent merge (#52578)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-17 06:40:36 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
a02cfccbc6
|
[Bugfix][Mamba] Fix overlapping state copy race (#50729)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-17 08:29:41 +02:00 |
|
|
wang.yuqi
|
93550cc4cd
|
[Frontend] Consolidate entrypoint middleware (#52309)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-17 06:17:15 +00:00 |
|
|
Isotr0py
|
53e211d292
|
[CI/Build] Reduce more duplicate runner startup in tests (#52570)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-17 05:19:07 +00:00 |
|
|
Andreas Karatzas
|
311b3513af
|
[ROCm][CI] Avoid forcing FlashAttention in the ColPali pooling test (#52565)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-16 23:08:35 -05:00 |
|
|
Andreas Karatzas
|
71b578b9cc
|
[ROCm][CI] Use the same-build wheel in Python-only CI (#49514)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-16 22:52:24 -05:00 |
|
|
pavelzak
|
7ea4b40954
|
[Hardware][NVIDIA] Add GB10 fused-MoE fp8 tuning configs (E=256, E=512) (#52502)
|
2026-08-16 20:04:15 -07:00 |
|
|
|
292187dd8c
|
[Bugfix][DSv4] Keep indexer scoring in breakable graphs (#52492)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-08-17 03:01:13 +00:00 |
|
|
Cheng RuiandRui Rui4 Cheng
|
6664d397bf
|
[Performance][MRV2] Cache logits-processing request state (#52329)
Signed-off-by: Rui Rui4 Cheng <chengrui4@lenovo.com>
Co-authored-by: Rui Rui4 Cheng <chengrui4@lenovo.com>
|
2026-08-17 02:36:41 +00:00 |
|
|
Yiting Jiang
|
502af5ed00
|
[Doc] Add MatrixHub as a model loading source (#50492)
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
|
2026-08-17 02:32:23 +00:00 |
|
|
Kaif Kohari
|
a6a2a93f9b
|
[Bugfix][Frontend] Guard remaining before-validators against non-object JSON bodies (#52528)
Signed-off-by: Kaif <kaifkohari10@gmail.com>
|
2026-08-17 02:27:59 +00:00 |
|
|
Yongye ZhuandClaude Opus 5
|
967e104fad
|
[Config] Unify indexer cache dtype under attention_config.indexer_kv_dtype (#52550)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-17 10:20:04 +08:00 |
|
|
Shanshan ShenandAndreas Karatzas
|
0ad04cff1b
|
[ROCm][CI] Enable ViT CUDA graph tests on AMD gfx950 GPUs (#52256)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 09:52:02 +08:00 |
|
|
kiroxu
|
a18c9b56ff
|
[Kimi-K3][Perf] Update FlashKDA for automatic K2 V-split (#52458)
|
2026-08-16 18:04:38 -07:00 |
|
|
Guanyi Chen
|
dc9ae4b8ac
|
[Bugfix][Mooncake] Reference GPU blocks for in-flight store jobs and key the store ledger by store_job_id (#52372)
Signed-off-by: Guanyi Chen <939416532@qq.com>
|
2026-08-16 16:09:46 -07:00 |
|
|
Tianyu Guo
|
eee538d5da
|
[Bugfix][V1][Multimodal] Ignore stale same-step encoder cache evictions (#52482)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-16 22:21:55 +00:00 |
|
|
Isotr0py
|
e3c1cb54fc
|
[CI/Build] Avoid duplicate runner startup for multimodal test (#52417)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-16 22:17:25 +00:00 |
|
|
Taneem Ibrahim
|
6b0b850a8b
|
[CI] Fit small KV-offload evals within shared memory (#52496)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-16 16:16:51 -04:00 |
|
|
Taneem Ibrahim
|
fdab2b10bc
|
[ModelRunner v2] Support Transformers pooling model (#52425)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-16 15:25:49 -04:00 |
|