 Shijin ZhangandChauncey
|
d95d1dcfb9
|
[Bugfix][Frontend] Force reasoning mode for GLM-5.3 chat templates in the GLM MoE parser (#56994)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-29 21:26:34 +08:00 |
|
|
|
dfc8e0f3e2
|
[Frontend] Support strict MiMo-V2.6 tool calling (#58019)
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Ubospica <ubospica@gmail.com>
Signed-off-by: yuchuan <yuchuan.7streams@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-29 12:47:47 +00:00 |
|
|
jackandQwertyJack
|
79a0307d74
|
[Config] Remove Engram CUDA-alike device restrictions (#59171)
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
|
2026-09-29 12:42:02 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
998490cd9f
|
[Docs] Speed up docs build ~5x (#58705)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 12:16:33 +01:00 |
|
|
|
05d89636fc
|
[ROCm][CI] Mirror generic GEMM-RS/AR on MI355 (#58433)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 10:28:15 +00:00 |
|
|
|
3f3fbe286f
|
[Bugfix][Rust Frontend] Account for new requests in DP routing (#58956)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-29 10:24:28 +00:00 |
|
|
Louie Tsai
|
208bb38c80
|
[Bugfix][Rust Frontend] Fix startup with config-only model (#58643)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-09-29 10:11:53 +00:00 |
|
|
|
af5b4857e1
|
[Fast Start] Support PP (#55477)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
|
2026-09-29 09:37:43 +00:00 |
|
|
yhcheong (vllmellm)
|
77e52645e9
|
[Bugfix][Model] MiMo: keep fused fp8 qkv_proj pairing state across weight-loading calls (#58142)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
|
2026-09-29 09:37:20 +00:00 |
|
|
aoshen02andOpenAI Codex
|
4861833ae2
|
[Bugfix][Core] Allow AuxOutput reset after abort without running requests (#59060)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 09:23:32 +00:00 |
|
|
Chauncey
|
3e2a7e74a5
|
[Feat][Model] Enable KDA prefill checkpoints for GLM-5.3-Flash (#56960)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-29 09:14:30 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
3acddf01e7
|
[Bugfix][ROCm] Keep Mooncake bootstrap ports bound during startup (#58967)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 04:14:26 -05:00 |
|
|
Andreas Karatzas
|
6ebb5bd64f
|
[ROCm][CI] Expand MI355 mirrors and route MIG-sized jobs to DPX (#59137)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
|
2026-09-29 03:40:07 -05:00 |
|
|
Jakub ZakrzewskiandOpenAI Codex
|
70dc122f81
|
[MM] Enable device normalization for Llama Nemotron VL Embed/Rerank (#57928)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-29 08:33:52 +00:00 |
|
|
Chauncey
|
61349e342d
|
[Misc] Avoid repeated warnings for merged Anthropic system messages (#59172)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-29 01:31:22 -07:00 |
|
|
Yifan QiaoandClaude Fable 5.1
|
4b2e1cfa7b
|
[Model] Decoder-side SWA bounded replay for DeepSeek-V4.1 (#58132)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-29 08:25:46 +00:00 |
|
|
|
9af952c555
|
[Bugfix][Rust Frontend] Support raise_exception in chat templates (#59020)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Yashasvi Asthana <yashasvi.asthana@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-29 08:01:52 +00:00 |
|
|
|
77d9cda688
|
[ROCm][Model][Bugfix] Fix GLM-5.2 shared-expert fusion and MTP on the ROCm DSA path (#58904)
Signed-off-by: Jin Tao <jin.tao@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-29 07:57:23 +00:00 |
|
|
Juntian LiuandClaude Opus 5.5
|
30f5c01d4e
|
[DSv4.1] Avoid runtime recompiles of _ring_slot_mapping_kernel (#59119)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-29 07:31:30 +00:00 |
|
|
Václav ČadekandCursor Agent
|
6cbbea8721
|
[Bugfix] Hoist $defs/definitions in Cohere parser tool schema composition (#49602)
Signed-off-by: Václav Čadek <vaclavcadek@gmail.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-09-29 07:11:56 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
78fc1e6274
|
[ROCm][CI] Add MI355 TP2 AR-RMS and B200 fusion mirrors (#58284)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-29 07:10:26 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
69d5c81fcd
|
[ROCm][CI] Mirror split kernel groups on MI355 and fix exposed tests (#58654)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-29 02:08:31 -05:00 |
|
|
Andreas KaratzasandCodex
|
0ae480ff1a
|
[CI][ROCm] Mirror large-model GSM8K evaluations on MI355 (#58683)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-29 02:06:44 -05:00 |
|
|
|
d86cf91240
|
[MM][Mistral3] Image preprocessing optimization (#57531)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 06:53:38 +00:00 |
|
|
|
65ed0a2642
|
[Bugfix][GLM-5.3-Flash] Take video placeholder timestamps from the pixel path's frame sampler (#55647)
Signed-off-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: NNNtrance <232268405+NNNtrance@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-29 06:45:29 +00:00 |
|
|
|
63b9931b73
|
[ROCm][DSv4.1] Paged MXFP4 sparse indexer on aiter's MQA-logits kernel (#58671)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-29 14:37:57 +08:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
e05095c9e1
|
[Rust Frontend] Feed parser tests and benchmarks attributed input (#59048)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 06:23:54 +00:00 |
|
|
Bowen WangandClaude Opus 5.5
|
35d6fb3187
|
[Perf][Spec Decode] Enable fused multi-step draft decode for FlashInfer trtllm-gen (#58371)
Signed-off-by: Bowen Wang <bowen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 06:06:47 +00:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
28f6739576
|
[Rust Frontend] Relax schema-aware tool argument conversion (#59004)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 05:40:41 +00:00 |
|
|
Ren YuzhouandClaude
|
ec5e0c352f
|
[Bugfix][Engram] Keep THP tables private when resolving shared memory (#59068)
Signed-off-by: Ren Yuzhou <54501155+yuzhouo7@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-29 05:19:49 +00:00 |
|
|
Shinichi Hemmi
|
17cc3cd80e
|
[Model] Engine based plamo3 parser (#56575)
Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
|
2026-09-29 05:17:42 +00:00 |
|
|
shaohuaxiandCodex
|
36768d1bfd
|
[Bugfix][Frontend] Preserve caller parameters in offline pooling (#58842)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-29 05:02:59 +00:00 |
|
|
Bowen WangandClaude Opus 5.5
|
1fde8ff7da
|
[Bugfix] Detect the CUDA toolkit the way FlashInfer does in has_flashinfer() (#58360)
Signed-off-by: Bowen Wang <bowen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 04:14:49 +00:00 |
|
|
debanshd
|
13c8589b86
|
fix: return loaded parameters in Aria load_weights (#57476)
Signed-off-by: Debanshu Das <debanshu@google.com>
|
2026-09-29 04:05:07 +00:00 |
|
|
Daniel M. García-Ocaña Hernández
|
295a0b8d64
|
[Bugfix][Multimodal] Fix flat/scoped mm_processor_kwargs merge and resolution (#56372)
Signed-off-by: Daniel M. García-Ocaña Hernández <danielgarciaocana@gmail.com>
|
2026-09-29 03:58:39 +00:00 |
|
|
cjackalandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
491f44adfa
|
[Model] Extend device-side mm normalization to Qwen3VL/Qwen3.5/Qwen4Next (#51289)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-29 11:44:54 +08:00 |
|
|
Isotr0pyandcjackal
|
07f1ba2ec6
|
[Multimodal] Remove processsor fallback for fused input norm params resolve (#59073)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-09-29 03:33:43 +00:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
aedaba8664
|
[CI/Build] Skip the snapshot runtime on CUDA 12.x images (#59118)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-28 20:17:59 -07:00 |
|
|
|
4e59d53ab5
|
[MRV2] Support stock torch.compile mode (#59079)
Signed-off-by: cheesecake <farzanaman99@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-28 20:17:48 -07:00 |
|
|
Tyler Michael SmithandCodex
|
4406874e7c
|
[Bugfix][FT] Pass stateless process-group timeouts explicitly (#58611)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-29 03:14:02 +00:00 |
|
|
Fangzhou AiandCursor
|
cf971b419a
|
[Bugfix] Revert "[ROCm][Perf] Replace torch.topk in DSA candidate block selection" (#59125)
Signed-off-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-28 20:11:48 -07:00 |
|
|
|
c6843d397c
|
[Bugfix][Frontend] Validate reused prompt token ids; render messages for media and echo (#55771)
Signed-off-by: Shijie Lyu <sjlyu@amazon.com>
Co-authored-by: Shijie Lyu <sjlyu@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-29 10:36:22 +08:00 |
|
|
Muhammad Ahmed
|
0af34418e9
|
[ROCm][DSv4.1][Perf] Run the delayed mHC seams through aiter's fused Triton kernel (#58655)
Signed-off-by: Ahmed <Muhammad.Ahmed@amd.com>
|
2026-09-29 10:19:10 +08:00 |
|
|
Chaojun Zhang
|
7230dfea50
|
[XPU] Preserve non-contiguous strides when pinning CPU tensors for UVA view (#54874)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-09-29 09:43:07 +08:00 |
|
|
Mehmet Cagri
|
70ae0b7435
|
[ROCm][MLA] Enable sparse MLA Gluon kernel from Aiter (#53492)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Signed-off-by: Mehmet Cagri <mehmet.kaymak@amd.com>
|
2026-09-29 09:08:18 +08:00 |
|
|
Andrey Talman
|
869278cbb0
|
[CI] Bound the CRCR report by build age, and stop gating it on a job (#59066)
|
2026-09-28 17:42:32 -07:00 |
|
|
Laith Sakka
|
b39f760cc7
|
[torch.compile] Canonicalize functionalized split slices for fusion pa… (#57299)
Signed-off-by: Laith Sakka <lsakka@meta.com>
|
2026-09-28 20:21:59 -04:00 |
|
|
Almog Tavor
|
171d1b9ef6
|
[Elastic EP] Support Model Runner V2 (#53934)
Signed-off-by: almogtavor <almogtavor@gmail.com>
Signed-off-by: Almog Tavor <70065337+almogtavor@users.noreply.github.com>
|
2026-09-29 00:20:40 +00:00 |
|
|
Benedikt Falk
|
c68eb98b69
|
[Bugfix][Frontend] Keep in-flight requests on the same DP engine (#59017)
Signed-off-by: Benedikt Falk <bfalk@nvidia.com>
|
2026-09-28 23:52:29 +00:00 |
|
|
Mehmet CagriandClaude Opus 5.5
|
75fad5bbef
|
[Bugfix][ROCm] Drop -1 sentinels when building the ragged sparse-MLA indices (#58058)
Signed-off-by: Mehmet Cagri Kaymak <mehmet.kaymak@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-28 18:40:11 -05:00 |
|