 Shimi BandielandClaude
|
4dc57d44c4
|
[Frontend] Attach resolved logprobs to streaming derender chunks (#55029)
Signed-off-by: Shimi Bandiel <shimib@google.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-29 18:43:44 +00:00 |
|
|
Chanbin Lim
|
91de237333
|
[Bugfix][DP] add_dp_placement_groups does not require ray[default] (#57648)
Signed-off-by: beenpow <57864041+beenpow@users.noreply.github.com>
|
2026-09-29 18:15:13 +00:00 |
|
|
|
467d81d9a0
|
[ROCm] Upgrade MoRI version on rocm dockers required for WideEP DP16 DI CI enablement and fixes for combine API (#56073)
Signed-off-by: Shiksha Patel <shiksha.patel@amd.com>
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
Co-authored-by: shikamd123 <shikpate@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-29 18:07:31 +00:00 |
|
|
|
f5ed3d9c03
|
[Fast Start] Charge daemon-held weights against gpu_memory_utilization (#57298)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
|
2026-09-29 17:58:35 +00:00 |
|
|
Jung JiyuandMisha Goin
|
cb4f016c5d
|
[Bugfix] Fix standalone torch.compile cache loading after relocation (#52142)
Signed-off-by: jungjiyu <libraryofjiyu@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-29 12:53:20 -04:00 |
|
|
|
cd94b21264
|
[Bugfix][Frontend] Return 400 for malformed RL dev route bodies (#59236)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 16:46:56 +00:00 |
|
|
Isotr0py
|
31876d8ea1
|
[Bugfix] Fix TorchCodec audio IO correctness (#58364)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-29 11:34:48 -05:00 |
|
|
|
f4917dadc8
|
[Bugfix][Quantization] Stop sleep(level=2) from zeroing compressed-tensors KV scales (#57163)
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-29 15:34:15 +00:00 |
|
|
|
cd947f5c62
|
[MM] Fix compiled ViT attention output layouts (#58182)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
|
2026-09-29 06:27:03 -07:00 |
|
|
Shijin ZhangandChauncey
|
d95d1dcfb9
|
[Bugfix][Frontend] Force reasoning mode for GLM-5.3 chat templates in the GLM MoE parser (#56994)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-29 21:26:34 +08:00 |
|
|
|
dfc8e0f3e2
|
[Frontend] Support strict MiMo-V2.6 tool calling (#58019)
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Ubospica <ubospica@gmail.com>
Signed-off-by: yuchuan <yuchuan.7streams@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-29 12:47:47 +00:00 |
|
|
jackandQwertyJack
|
79a0307d74
|
[Config] Remove Engram CUDA-alike device restrictions (#59171)
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
|
2026-09-29 12:42:02 +00:00 |
|
|
|
05d89636fc
|
[ROCm][CI] Mirror generic GEMM-RS/AR on MI355 (#58433)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 10:28:15 +00:00 |
|
|
Louie Tsai
|
208bb38c80
|
[Bugfix][Rust Frontend] Fix startup with config-only model (#58643)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-09-29 10:11:53 +00:00 |
|
|
|
af5b4857e1
|
[Fast Start] Support PP (#55477)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
|
2026-09-29 09:37:43 +00:00 |
|
|
aoshen02andOpenAI Codex
|
4861833ae2
|
[Bugfix][Core] Allow AuxOutput reset after abort without running requests (#59060)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 09:23:32 +00:00 |
|
|
Chauncey
|
3e2a7e74a5
|
[Feat][Model] Enable KDA prefill checkpoints for GLM-5.3-Flash (#56960)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-29 09:14:30 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
3acddf01e7
|
[Bugfix][ROCm] Keep Mooncake bootstrap ports bound during startup (#58967)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 04:14:26 -05:00 |
|
|
Andreas Karatzas
|
6ebb5bd64f
|
[ROCm][CI] Expand MI355 mirrors and route MIG-sized jobs to DPX (#59137)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
|
2026-09-29 03:40:07 -05:00 |
|
|
Jakub ZakrzewskiandOpenAI Codex
|
70dc122f81
|
[MM] Enable device normalization for Llama Nemotron VL Embed/Rerank (#57928)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 08:33:52 +00:00 |
|
|
Yifan QiaoandClaude Fable 5.1
|
4b2e1cfa7b
|
[Model] Decoder-side SWA bounded replay for DeepSeek-V4.1 (#58132)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-29 08:25:46 +00:00 |
|
|
Václav ČadekandCursor Agent
|
6cbbea8721
|
[Bugfix] Hoist $defs/definitions in Cohere parser tool schema composition (#49602)
Signed-off-by: Václav Čadek <vaclavcadek@gmail.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-09-29 07:11:56 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
78fc1e6274
|
[ROCm][CI] Add MI355 TP2 AR-RMS and B200 fusion mirrors (#58284)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-29 07:10:26 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
69d5c81fcd
|
[ROCm][CI] Mirror split kernel groups on MI355 and fix exposed tests (#58654)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-29 02:08:31 -05:00 |
|
|
Andreas KaratzasandCodex
|
0ae480ff1a
|
[CI][ROCm] Mirror large-model GSM8K evaluations on MI355 (#58683)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-29 02:06:44 -05:00 |
|
|
|
d86cf91240
|
[MM][Mistral3] Image preprocessing optimization (#57531)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 06:53:38 +00:00 |
|
|
|
65ed0a2642
|
[Bugfix][GLM-5.3-Flash] Take video placeholder timestamps from the pixel path's frame sampler (#55647)
Signed-off-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-29 06:45:29 +00:00 |
|
|
|
63b9931b73
|
[ROCm][DSv4.1] Paged MXFP4 sparse indexer on aiter's MQA-logits kernel (#58671)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-29 14:37:57 +08:00 |
|
|
Bowen WangandClaude Opus 5.5
|
35d6fb3187
|
[Perf][Spec Decode] Enable fused multi-step draft decode for FlashInfer trtllm-gen (#58371)
Signed-off-by: Bowen Wang <bowen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 06:06:47 +00:00 |
|
|
Ren YuzhouandClaude
|
ec5e0c352f
|
[Bugfix][Engram] Keep THP tables private when resolving shared memory (#59068)
Signed-off-by: Ren Yuzhou <54501155+yuzhouo7@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-29 05:19:49 +00:00 |
|
|
Shinichi Hemmi
|
17cc3cd80e
|
[Model] Engine based plamo3 parser (#56575)
Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
|
2026-09-29 05:17:42 +00:00 |
|
|
Bowen WangandClaude Opus 5.5
|
1fde8ff7da
|
[Bugfix] Detect the CUDA toolkit the way FlashInfer does in has_flashinfer() (#58360)
Signed-off-by: Bowen Wang <bowen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 04:14:49 +00:00 |
|
|
Daniel M. García-Ocaña Hernández
|
295a0b8d64
|
[Bugfix][Multimodal] Fix flat/scoped mm_processor_kwargs merge and resolution (#56372)
Signed-off-by: Daniel M. García-Ocaña Hernández <danielgarciaocana@gmail.com>
|
2026-09-29 03:58:39 +00:00 |
|
|
cjackalandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
491f44adfa
|
[Model] Extend device-side mm normalization to Qwen3VL/Qwen3.5/Qwen4Next (#51289)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 11:44:54 +08:00 |
|
|
|
4e59d53ab5
|
[MRV2] Support stock torch.compile mode (#59079)
Signed-off-by: cheesecake <farzanaman99@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-28 20:17:48 -07:00 |
|
|
Tyler Michael SmithandCodex
|
4406874e7c
|
[Bugfix][FT] Pass stateless process-group timeouts explicitly (#58611)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-29 03:14:02 +00:00 |
|
|
|
c6843d397c
|
[Bugfix][Frontend] Validate reused prompt token ids; render messages for media and echo (#55771)
Signed-off-by: Shijie Lyu <sjlyu@amazon.com>
Co-authored-by: Shijie Lyu <sjlyu@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-29 10:36:22 +08:00 |
|
|
Muhammad Ahmed
|
0af34418e9
|
[ROCm][DSv4.1][Perf] Run the delayed mHC seams through aiter's fused Triton kernel (#58655)
Signed-off-by: Ahmed <Muhammad.Ahmed@amd.com>
|
2026-09-29 10:19:10 +08:00 |
|
|
Chaojun Zhang
|
7230dfea50
|
[XPU] Preserve non-contiguous strides when pinning CPU tensors for UVA view (#54874)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-09-29 09:43:07 +08:00 |
|
|
Mehmet Cagri
|
70ae0b7435
|
[ROCm][MLA] Enable sparse MLA Gluon kernel from Aiter (#53492)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Signed-off-by: Mehmet Cagri <mehmet.kaymak@amd.com>
|
2026-09-29 09:08:18 +08:00 |
|
|
Laith Sakka
|
b39f760cc7
|
[torch.compile] Canonicalize functionalized split slices for fusion pa… (#57299)
Signed-off-by: Laith Sakka <lsakka@meta.com>
|
2026-09-28 20:21:59 -04:00 |
|
|
Almog Tavor
|
171d1b9ef6
|
[Elastic EP] Support Model Runner V2 (#53934)
Signed-off-by: almogtavor <almogtavor@gmail.com>
Signed-off-by: Almog Tavor <70065337+almogtavor@users.noreply.github.com>
|
2026-09-29 00:20:40 +00:00 |
|
|
Benedikt Falk
|
c68eb98b69
|
[Bugfix][Frontend] Keep in-flight requests on the same DP engine (#59017)
Signed-off-by: Benedikt Falk <bfalk@nvidia.com>
|
2026-09-28 23:52:29 +00:00 |
|
|
Mehmet CagriandClaude Opus 5.5
|
75fad5bbef
|
[Bugfix][ROCm] Drop -1 sentinels when building the ragged sparse-MLA indices (#58058)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-28 18:40:11 -05:00 |
|
|
|
9b29370524
|
[Bugfix] Fix moe_wna16 w13 zero-point shard split for 8-bit asym GPTQ MoE (#58950)
Signed-off-by: Spandan Tiwari <sptiwari@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-28 23:38:28 +00:00 |
|
|
|
e03875f4d2
|
[Minimax M3] Enable fp8 indexer cache on triton indexer for non-SM100 architectures. (#59081)
Signed-off-by: Jarrel Seah <jarrel@harrison.ai>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Rajas Mhaskar <rmhaskar@nvidia.com>
Co-authored-by: Jarrel Seah <jarrel@harrison.ai>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-28 19:21:13 -04:00 |
|
|
Fanli LinandKunshang Ji
|
6a6c2952fa
|
[XPU][CI] Make test_mamba_prefix_cache block-size agnostic (#58269)
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-29 07:12:43 +08:00 |
|
|
0xsenseiandOpenAI Codex
|
d28795f1a7
|
[Bugfix][Scheduler] Refresh max tokens for streaming continuations (#57676)
Signed-off-by: 0xsensei <prblmslvr.aditya@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-28 20:31:57 +00:00 |
|
|
|
beef814e1d
|
[ROCm][CI] Add missing test coverage for upstream parity (#50519)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-28 13:12:07 -07:00 |
|
|
|
fedbc3b564
|
[Bugfix][MRV2][Spec Decode] Reject draft slots that were never proposed (#58784)
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-28 13:07:15 -07:00 |
|