 Rohan PotdarandClaude Opus 5.5
|
fa94ad4143
|
[Test] Allow one bf16 ulp in the fused mHC post/pre residual check (#60724)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 17:54:06 -05:00 |
|
|
Matthew BonanniandClaude Opus 5.5
|
4c43254d52
|
[HiSparse] Report host-pool block residency as HiSparse metrics (#59485)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 16:45:34 -06:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
783ac12071
|
[CI] Accept whitespace around /ci commands and reply instead of going silent (#60925)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 15:43:37 -07:00 |
|
|
|
ed7ae705a1
|
[Bugfix][MRV2] Use int64 index mappings to fix row-offset overflow (#60736)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-09 14:38:11 -07:00 |
|
|
|
51144dd83e
|
[Bugfix][Spec Decode] Trim token_ids/logprobs left past a stop string under speculative decoding (#47616)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 14:22:31 -07:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
35e920d671
|
[Rust Frontend] Support --stream-interval and per-request stream_interval (#60589)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 14:10:42 -07:00 |
|
|
Giancarlo Delfin
|
ffdde24f54
|
[Docs] Document adaptive verification without a confidence head (#60913)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-10-09 13:54:40 -07:00 |
|
|
Kai HoangandFlora Feng
|
e0cb3efce0
|
[Bugfix][Structured Output] Decode choice specs as JSON in outlines and LMFE (#60748)
Signed-off-by: hpdkhoa <hpdkhoa2311@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-09 20:52:08 +00:00 |
|
|
|
02e55d2af3
|
[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-10-09 15:48:37 -04:00 |
|
|
Misha GoinandClaude
|
3766a67a32
|
[WideEP] Explain how to fix a too-old NCCL for DeepEP v2 (#60449)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-09 12:34:58 -07:00 |
|
|
|
04462732a4
|
[Bugfix] Reject max_num_scheduled_tokens=0 at config time instead of hanging (#60714)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Hui Li <40770106+untrall@users.noreply.github.com>
|
2026-10-09 19:15:10 +00:00 |
|
|
Willow LopezandArtem Perevedentsev
|
ad8a6065f4
|
[Bugfix] Validate guidance tokenizer compatibility before EngineCore (#52298)
Signed-off-by: Oxygen56 <jiangth99@163.com>
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-09 21:59:02 +03:00 |
|
|
Misha GoinandClaude
|
1dc60dd367
|
[CI] Pin pydantic in the mypy pre-commit hook (#60894)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-09 11:42:41 -07:00 |
|
|
Ning XieandSimon Mo
|
a0f28d73a8
|
[sharded state loader] support pp in sharded state loader (#52110)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
|
2026-10-09 11:08:31 -07:00 |
|
|
premsurawutandClaude Opus 5.5
|
c811943137
|
[Bugfix][Frontend] Reject beam search with echo and logprobs in /v1/completions (#60876)
Signed-off-by: surawut.j <surawut.jirasaktavee@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 18:06:26 +00:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
5dc9bcd8cd
|
[Rust Frontend] Pass reasoning controls through render -> generate (#60546)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:04:49 -07:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
ce4603cad6
|
[Bugfix][Rust Frontend] Pass through raw characters in byte-level decode (#59861)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:04:00 -07:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
9a585c62aa
|
[Rust Frontend] Box rarely-set fields of per-token output types (#60588)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:01:16 -07:00 |
|
|
|
1a3a7a8f01
|
[Bugfix] Treat max_tokens as output upper bound, not input-space reservation (#57035)
Signed-off-by: YuvrajSinghBhadoria2 <245782664+YuvrajSinghBhadoria2@users.noreply.github.com>
Signed-off-by: YuvrajSinghBhadoria2 <yuvrajsinghbhado2030@gmail.com>
Signed-off-by: Yuvraj Singh Bhadoria <yuvrajsinghbhado2030@gmail.com>
Co-authored-by: YuvrajSinghBhadoria2 <245782664+YuvrajSinghBhadoria2@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-10-10 01:15:22 +08:00 |
|
|
Andrey TalmanandAndrey Talman
|
89ac8d971b
|
[CI][Test] Allow 10% ngram acceptance drop under preemption on CUDA in test_async_scheduling_accuracy (#60715)
pre-commit / pre-run-check (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Signed-off-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com>
|
2026-10-09 16:59:17 +00:00 |
|
|
stefankoncarevic
|
b74233860d
|
[CI][ROCm] Wait for VRAM to settle before building LLM in test_full_graph (#60872)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-10-09 16:48:43 +00:00 |
|
|
Taewoong KimandCyrus Leung
|
75e3b17c05
|
[Frontend] Add cache salt support to generative scoring (#60841)
Signed-off-by: Taewoong Kim <ktw2172@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-09 16:07:50 +00:00 |
|
|
|
90ba2f34b5
|
[Build] Find compatible published wheels for precompiled installs (#58871)
Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 08:05:54 -07:00 |
|
|
Abhijit Roy
|
970dc63478
|
[Docs] Add Giga-Embeddings bidirectional Qwen3 usage to embed docs (#60854)
Signed-off-by: Abhijit <abroy@redhat.com>
|
2026-10-09 14:41:38 +00:00 |
|
|
Taneem Ibrahim
|
a6b39f0262
|
[Bugfix] Clean up async client sockets after event loop closure (#57757)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-10-09 10:32:47 -04:00 |
|
|
Warren Dengandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
fc39317392
|
[Bugfix][Kernel] Remove invalid NC from Kimi-K3 KDA autotune keys (#60446)
Signed-off-by: Warren Deng <warrdeng@meta.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-09 14:25:41 +00:00 |
|
|
Juan Pérez de Algabaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
3d52578e13
|
[Security] Do not retain Phi-4 MM audio attention matrices (#60614)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-09 22:23:35 +08:00 |
|
|
Mikko TukiainenandCursor
|
81c993658e
|
[ROCm][Perf] Fuse main QK-norm/RoPE/gate and KV-cache write into the AMD QSA prepare launch (#59732)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-09 21:14:49 +08:00 |
|
|
Li, Jiang
|
9adba10f3f
|
[Bugfix] Fix pre-commit check (#60840)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-10-09 12:48:32 +00:00 |
|
|
Suraj Sharanandlinitra24
|
1ee69dde9c
|
[Bugfix][LoRA] Reject PEFT adapter features vLLM does not implement (#60225)
Signed-off-by: suraj <surajsharan85@gmail.com>
Co-authored-by: linitra24 <renshuang.zhou@daocloud.io>
|
2026-10-09 16:39:58 +04:00 |
|
|
Yan Ma
|
c17fadcfdc
|
[XPU] fix fused_input_norm for MM (#59865)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-10-09 20:16:35 +08:00 |
|
|
YiSheng5andKunshang Ji
|
0cc0460870
|
[XPU]Fix the accuracy issue when meet topk_ids=-1 on DP+EP scenarios (#57787)
Signed-off-by: yisheng <yi.sheng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-09 20:01:54 +08:00 |
|
|
Louie Tsai
|
196483e25b
|
[Tools] Recipes sweep workflow (#57307)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-10-09 19:44:09 +08:00 |
|
|
Praneeth Reddy AandLi, Jiang <jiang1.li@intel.com>
|
1c47ebfc57
|
[Docs] Fix VLLM_CPU_KVCACHE_SPACE default and units (#60053)
Signed-off-by: Praneeth <praneethreddyarikatla@gmail.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-10-09 19:43:55 +08:00 |
|
|
Chen ChengandIsotr0py
|
d095e61c0b
|
[Bugfix][Spec Decode] Fix GLM-5.3-Flash DFlash2/EAGLE3 aux hidden-state capture with the upstream config (#60763)
Signed-off-by: Chen Cheng <85005591+ischencheng@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-09 11:35:48 +00:00 |
|
|
wang.yuqi
|
7368fadebd
|
[CI Failure] Move MTEB tests to h200_35gb (#60817)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-10-09 11:34:38 +00:00 |
|
|
Luca MotzandClaude Opus 5.5
|
83ed0c7c09
|
[Bugfix][NIXL] Fix receive post-process for different P/D block sizes (#58860)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 19:30:11 +08:00 |
|
|
Shreyansh JainandArtem Perevedentsev
|
28d76f3bad
|
[Bugfix][Structured Output] Reject unsupported regex inside groups (#60359)
Signed-off-by: Shreyansh Jain <shreyanshjain646@gmail.com>
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-09 14:16:13 +03:00 |
|
|
Chaojun Zhang
|
b027ac8312
|
[XPU] Support register KV offload mmap region as pinned host memory on XPU (#51956)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-10-09 18:58:07 +08:00 |
|
|
|
5cadabfafd
|
[Docs] Add Qwen2.5-Coder-7B-Instruct to batch invariance tested models (#46368)
Signed-off-by: Yuval Luria <yluria@redhat.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-09 10:41:29 +00:00 |
|
|
Yan Ma
|
4e318ac563
|
[XPU] fix online fp8_per_channel quantization (#56027)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-10-09 18:38:01 +08:00 |
|
|
Thang NguyenandClaude Opus 5.5
|
efd141047d
|
[CI] Enroll a third batch of five steps in automatic sharding (#60757)
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 03:26:47 -07:00 |
|
|
Thang NguyenandClaude Opus 5.5
|
b8bd335754
|
[CI] Enroll five more steps in automatic sharding (#60662)
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 03:26:27 -07:00 |
|
|
Warren Deng
|
59ffd73e85
|
[Bugfix][Kernel] Restore FP fusion for indexer Q quantization (#60716)
Signed-off-by: Warren Deng <warrdeng@meta.com>
|
2026-10-09 09:46:41 +00:00 |
|
|
Damien LaineandCyrus Leung
|
2186b89a9a
|
[Bugfix][Model] Voxtral realtime: fix boot OOM and engine crash at max_model_len (#45022)
Signed-off-by: Damien Laine <damien.laine@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-09 17:40:29 +08:00 |
|
|
Harry MellorandClaude Opus 5.5
|
2c99ee9333
|
[Chore] Remove vendored code made redundant by Transformers 5.16.1 (#60623)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 09:29:03 +00:00 |
|
|
Chao Lei
|
bc713cf8cc
|
[Bugfix]MooncakeConnect add query timeout and retry (#55923)
|
2026-10-09 09:19:33 +00:00 |
|
|
Taewoong KimandChauncey
|
18c19eaf23
|
[Frontend] Add cache salt and tracing to structured decisions (#60786)
Signed-off-by: Taewoong Kim <ktw2172@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-10-09 08:53:50 +00:00 |
|
|
|
a6f43e57d6
|
[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm (#59523)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: indianspeedster <cspandey016@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: indianspeedster <cspandey016@gmail.com>
|
2026-10-09 08:29:55 +00:00 |
|
|
The Anh Nguyen
|
bacbbe1878
|
[Bugfix][NIXL] Guard record_transfer against None telemetry (#57734)
Signed-off-by: The Anh Nguyen <ntheanh201@gmail.com>
|
2026-10-09 08:22:18 +00:00 |
|