 Micah Williamson
|
8878ebd8fd
|
[ROCm][CI] Expand AITER W4A4 MoE Coverage (#52647)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-08-17 15:46:22 -05:00 |
|
|
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f08a95f8d8
|
[Rust Frontend][gRPC] Advertise LoRA capabilities (#52031)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 13:27:56 -07:00 |
|
|
Wei Zhao
|
d1e3eee6fb
|
[Spec decode] Support Kimi-K3 DCP with DSpark (#52188)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-17 13:08:45 -07:00 |
|
|
crZhao
|
3fc2893909
|
[Bugfix] Account for local DP workers in startup thread allocation (#52385)
Signed-off-by: real-cpu <zhaochenrui757@gmail.com>
|
2026-08-17 12:10:34 -07:00 |
|
|
Andreas Karatzasandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
c1e438728c
|
[ROCm][CI] Restore Torch defaults and type DSV4 scratch buffers (#52566)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 18:32:04 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
402547d7f0
|
[Bugfix][CI] Release the shared ColBERT engine before test_colbert_hf_comparison (#52608)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 17:50:26 +00:00 |
|
|
Juan Pérez de Algaba
|
ceb340e2eb
|
fix: prevent PyNvVideoCodec decoder slot limit bypass via ClassVar shadowing (#52126)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-17 17:45:40 +00:00 |
|
|
Roberto L. CastroandCodex
|
49905ad94d
|
[3/N][Feat][Perf] Add new warmup infrastructure for JITs. Add provider registry and orchestration for JIT warmup (#50174)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-17 10:11:14 -07:00 |
|
|
Misha Goin
|
4ab5e5012a
|
[Refactor] Simplify B12X linear kernels and warmup (#52368)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-17 09:45:45 -07:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
017e9f4448
|
Promote prefix_cache_retention_interval to an argument and change the default to 0 (#52216)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-17 13:20:50 +00:00 |
|
|
qli88
|
1d3a8b9e22
|
[ROCm][Bugfix] Fix Triton W4A16 bug in determining if transpose is required for GPTQ/AutoGPTQ (#48998)
Signed-off-by: Qiang Li <qiang.li2@amd.com>
|
2026-08-17 12:26:05 +00:00 |
|
|
|
70afdedc10
|
[K3] support recoverssm for K3 (#51855)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 19:34:14 +08:00 |
|
|
|
f27ae25473
|
[Bugfix][CPU] Take an attention group's query head count from its layers (#51852)
Signed-off-by: Ganesh R <Ganesh.R@amd.com>
Signed-off-by: R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-17 18:45:59 +08:00 |
|
|
OlaandOpenAI Codex
|
95901ce70a
|
fix(pooling): validate BGE-M3 combined task ownership (#51823)
Signed-off-by: Zhe Li <2843409461@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-17 10:30:35 +00:00 |
|
|
pmanczak
|
cc7cf71fc8
|
[XPU] Enable Kimi K3 KDA kernel tests on XPU (#51809)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-08-17 17:21:34 +08:00 |
|
|
Kevin H. Luu
|
bb233626ca
|
[CI] Shard Humming A100 eval (#52325)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-17 02:03:33 -07:00 |
|
|
Isotr0py
|
5fd7a88838
|
[CI/Build] Fix accident pre-commit breakage due to concurrent merge (#52578)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-17 06:40:36 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
a02cfccbc6
|
[Bugfix][Mamba] Fix overlapping state copy race (#50729)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-17 08:29:41 +02:00 |
|
|
wang.yuqi
|
93550cc4cd
|
[Frontend] Consolidate entrypoint middleware (#52309)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-17 06:17:15 +00:00 |
|
|
Isotr0py
|
53e211d292
|
[CI/Build] Reduce more duplicate runner startup in tests (#52570)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-17 05:19:07 +00:00 |
|
|
Andreas Karatzas
|
311b3513af
|
[ROCm][CI] Avoid forcing FlashAttention in the ColPali pooling test (#52565)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-16 23:08:35 -05:00 |
|
|
Andreas Karatzas
|
71b578b9cc
|
[ROCm][CI] Use the same-build wheel in Python-only CI (#49514)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-16 22:52:24 -05:00 |
|
|
Cheng RuiandRui Rui4 Cheng
|
6664d397bf
|
[Performance][MRV2] Cache logits-processing request state (#52329)
Signed-off-by: Rui Rui4 Cheng <chengrui4@lenovo.com>
Co-authored-by: Rui Rui4 Cheng <chengrui4@lenovo.com>
|
2026-08-17 02:36:41 +00:00 |
|
|
Kaif Kohari
|
a6a2a93f9b
|
[Bugfix][Frontend] Guard remaining before-validators against non-object JSON bodies (#52528)
Signed-off-by: Kaif <kaifkohari10@gmail.com>
|
2026-08-17 02:27:59 +00:00 |
|
|
Yongye ZhuandClaude Opus 5
|
967e104fad
|
[Config] Unify indexer cache dtype under attention_config.indexer_kv_dtype (#52550)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-17 10:20:04 +08:00 |
|
|
Shanshan ShenandAndreas Karatzas
|
0ad04cff1b
|
[ROCm][CI] Enable ViT CUDA graph tests on AMD gfx950 GPUs (#52256)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 09:52:02 +08:00 |
|
|
Guanyi Chen
|
dc9ae4b8ac
|
[Bugfix][Mooncake] Reference GPU blocks for in-flight store jobs and key the store ledger by store_job_id (#52372)
Signed-off-by: Guanyi Chen <939416532@qq.com>
|
2026-08-16 16:09:46 -07:00 |
|
|
Tianyu Guo
|
eee538d5da
|
[Bugfix][V1][Multimodal] Ignore stale same-step encoder cache evictions (#52482)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-16 22:21:55 +00:00 |
|
|
Isotr0py
|
e3c1cb54fc
|
[CI/Build] Avoid duplicate runner startup for multimodal test (#52417)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-16 22:17:25 +00:00 |
|
|
Taneem Ibrahim
|
6b0b850a8b
|
[CI] Fit small KV-offload evals within shared memory (#52496)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-16 16:16:51 -04:00 |
|
|
Taneem Ibrahim
|
fdab2b10bc
|
[ModelRunner v2] Support Transformers pooling model (#52425)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-16 15:25:49 -04:00 |
|
|
|
ef43e3101b
|
[ROCm][DSV4][Perf] Optimize Triton sparse-MLA decode on gfx950 (#52212)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Cursor Grok 4.6 <cursoragent@cursor.com>
|
2026-08-16 12:16:46 -07:00 |
|
|
Taneem IbrahimandWentao Ye
|
1f0e0bf612
|
[Bugfix][Attention] Temporarily disable FA4 head-dim 256 (#52050)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-16 17:13:02 +00:00 |
|
|
Wentao Ye
|
7d7b6f26f4
|
[Refactor] Remove dead code for quantization (#52221)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-16 13:10:16 -04:00 |
|
|
|
9409f59e09
|
[Core] Add CuMemAllocator.discard() for tag-selective GPU memory release (#52514)
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: AlanFokCo <alanfok2868@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-16 23:15:14 +08:00 |
|
|
|
4d2a68d64d
|
[Bugfix][Spec Decode][Structured Output] DSpark: fix the grammar bitmask mapping when the draft budget is zero (#52436)
Signed-off-by: oops-oom <73481342@qq.com>
Co-authored-by: oops-oom <73481342@qq.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-16 11:09:23 +00:00 |
|
|
Chauncey
|
84530eb235
|
[Bugfix][Multimodal] Keep Gemma 4 video frame counts on CPU (#52441)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-16 09:17:04 +00:00 |
|
|
|
1b079c40ff
|
[Bugfix][Model Runner V2][Spec Decode] Fix off-by-one in bad_words draft-prefix matching (#52311)
Signed-off-by: jyan <r_02213@sjtu.edu.cn>
Co-authored-by: jyan <r_02213@sjtu.edu.cn>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-16 09:02:20 +00:00 |
|
|
Do_it_now_!
|
70aaec832b
|
[Bugfix][Anthropic] Return 4xx for client-caused errors in /v1/messages (#52246)
Signed-off-by: Do_it_now_! <lizhengcheng233@gmail.com>
|
2026-08-16 01:05:17 -07:00 |
|
|
Jeffrey WangandClaude Opus 5
|
41f12a0daf
|
[Bugfix] Raise VLLMValidationError from structured output validators (#52394)
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-16 01:04:51 -07:00 |
|
|
Nick Hill
|
8efa13b700
|
[Bugfix] Pick the DeepSeek V4 eager cudagraph region per model runner (#52401)
|
2026-08-15 21:04:08 -07:00 |
|
|
mispa-ms
|
6593754e61
|
[Bugfix][Spec Decode] Keep EAGLE cache registration on the partial-hash-hit path (#52419)
|
2026-08-15 21:03:53 -07:00 |
|
|
|
edd4c8176c
|
[Bugfix][DSv4] Revert adaptive C128A metadata packing (#51318)
Signed-off-by: tobymao <toby.mao@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-15 18:39:23 -07:00 |
|
|
|
fa9d67f782
|
[EC Connector] Added Build Connector Worker Meta for EC Connector (#49585)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Signed-off-by: omerpaz95 <73347585+omerpaz95@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-15 15:40:38 -07:00 |
|
|
Henry Su
|
c94cdd0ae0
|
[Bugfix][Sampling] Clear empty side on thinking-budget asymmetric SWAP (#49613)
Signed-off-by: Henry Su <henrysu4707@gmail.com>
|
2026-08-15 21:13:02 +00:00 |
|
|
Shane Widanagama
|
d4801990a4
|
[CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901)
|
2026-08-15 07:01:52 -07:00 |
|
|
Gabriel Wu
|
97388c44f9
|
[Bugfix] Make DSV4 sparse MLA work end-to-end for plain decode, MTP, and DSpark (#51538)
|
2026-08-15 07:01:32 -07:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ac2ae8798c
|
[Frontend] Support count_reasoning_tokens in the Streaming Parser Engine (#45802)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-15 06:51:14 -07:00 |
|
|
Andreas Karatzas
|
44fc57d7b7
|
[ROCm][CI] Select CPU platform for native no-GPU jobs (#49515)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-14 23:30:56 -07:00 |
|
|
Nick HillandClaude Opus 4.8
|
615d4cfade
|
[Core] Check for GPU<->CPU syncs during CI (#43107)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-14 17:42:05 -07:00 |
|