+1
|
4f1da84eb5
|
Enable gfx1250 ROCm architecture (#46516)
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Signed-off-by: jpvillam <juan.villamizar@amd.com>
Signed-off-by: Daniel <danichan@amd.com>
Signed-off-by: Jaden Mathias <jaden.mathias@amd.com>
Signed-off-by: jpvillam <jpvillam@amd.com>
Signed-off-by: Juan Villamizar <100237675+jpvillam-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Jaden Mathias <Jaden.Mathias@amd.com>
Co-authored-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Daniel <danichan@amd.com>
Co-authored-by: Jaden Mathias <jaden.mathias@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
Co-authored-by: root <root@ctheliosr-1b114-f01-2.mnb.dcgpu>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: dllehr <douglehr@amd.com>
Co-authored-by: Daniel Chan <Daniel.Chan@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-31 01:41:12 +00:00 |
|
|
Nicolò Lucchesi
|
8700f86a70
|
[CI] Fix tests/entrypoints/multimodal/openai/chat_completion/test_audio.py::test_chat_streaming_audio (#50451)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-30 16:18:53 -07:00 |
|
|
Andreas Karatzas
|
5b95890742
|
[FlexAttention] Avoid encoder block-mask compile explosion (#50339)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 11:24:13 -04:00 |
|
|
Martin HickeyandHarry Mellor
|
38a267cdd5
|
[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-30 05:02:51 -07:00 |
|
|
Andreas Karatzas
|
e04a30a77c
|
[Frontend] Lazily initialize chat media connectors (#49914)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 14:56:37 +08:00 |
|
|
Martin Hickey
|
0a31372e5f
|
[Frontend] Add detokenization streaming derender for disaggregated serving (#47301)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-07-29 18:01:20 -07:00 |
|
|
Seiji Eicher
|
6370e53f24
|
[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
|
2026-07-29 10:02:57 +02:00 |
|
|
Zach Zhu
|
58f9659397
|
[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)
Signed-off-by: Zach Zhu <zzqshu@126.com>
|
2026-07-29 04:20:40 +00:00 |
|
|
Andreas Karatzas
|
176256b962
|
[ROCm][CI] Stabilize ROCm audio streaming test (#50163)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-29 07:58:10 +08:00 |
|
|
Bugen Zhao
|
01661cc57f
|
[Rust][Benchmark] Make vllm bench serve Rust delegation opt-in (#50081)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-28 16:21:12 +00:00 |
|
|
Shuolei Wang
|
9069a57139
|
[Core][Frontend] Add weight version tagging for RL rollouts (#49040)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
|
2026-07-28 14:35:29 +08:00 |
|
|
TobyJBell
|
15d65f8669
|
[Bugfix] Changed speech to text chunk timestamp to cumulative approach (#41131)
Signed-off-by: Toby Bell <toby.bell1702@hotmail.co.uk>
|
2026-07-27 17:06:46 +00:00 |
|
|
Umut Polat
|
27d7061ef6
|
[Bugfix] Restore truncate_prompt_tokens for Jina rerank/score online (#49963)
Signed-off-by: Umut Polat <52835619+umut-polat@users.noreply.github.com>
|
2026-07-27 22:52:59 +08:00 |
|
|
Taneem Ibrahim
|
0164022c90
|
[CI] Fix speech correctness check rejecting improved WER (#49853)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-07-26 06:24:07 +00:00 |
|
|
Chang Guo
|
7a6a5b3667
|
[CI] Compute speech WER directly with jiwer (#49773)
|
2026-07-25 20:51:21 -04:00 |
|
|
Taneem Ibrahim
|
6b0103d1c9
|
[CI] Stabilize Pooling Rerank Equivalence Test (#49822)
|
2026-07-25 14:36:50 -04:00 |
|
|
Harry MellorandAndreas Karatzas
|
ca0defa343
|
Make bare hugging_face imports forbidden (#49726)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-25 04:18:39 -07:00 |
|
|
|
7513d071bd
|
[ROCm][CI] Fix XPASS(strict) on mixed audio embeds test (#49733)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-24 16:09:18 -05:00 |
|
|
Harry Mellor
|
89f6aa3a9e
|
[KV Offload][CI] Fall back to buffered I/O without O_DIRECT; fix flaky api-server test (#49734)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-24 13:56:57 -07:00 |
|
|
Jiangyun ZhuandOpenAI Codex
|
9e6746b3c7
|
[CI] Stabilize memory-sensitive compile and structured output tests (#49749)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-24 16:45:09 -04:00 |
|
|
Andreas Karatzas
|
a49d37c6b9
|
[CI] Disable reasoning in Responses smoke test (#49511)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-23 19:02:54 +00:00 |
|
|
|
75ccdf3145
|
[Core] Update PyTorch to 2.13.0, torchvision to 0.28.0, triton to 3.7.1 (#48155)
Signed-off-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-23 11:09:36 -07:00 |
|
|
wang.yuqi
|
61c9ef986a
|
[Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-22 10:56:23 +00:00 |
|
|
hcl
|
530ee36a0d
|
fix(openai): reject non-numeric logprobs with 400 instead of 500 (#49144)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
|
2026-07-20 10:04:50 +00:00 |
|
|
yzong-rh
|
ac5f38a0f7
|
[Refactor] Extract StructuredOutputsParams creation logic from Request.to_sampling_params (#49003)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-07-19 05:18:00 -07:00 |
|
|
yzong-rh
|
a287eb163f
|
[Front-end] [Messages] Populate num_cache_creation_tokens (#48535)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-07-18 13:04:35 -04:00 |
|
|
|
29c0ec4d63
|
[ci] Move 3 entrypoints tests to h200_35gb queue (#43164)
Signed-off-by: Simon Mo <simon@inferact.ai>
Signed-off-by: Simon Mo <simon@simon-mac-mini-9.local>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-18 08:43:49 -07:00 |
|
|
|
26c909ed74
|
[Model] Support TranslateGemma-12b-it (#41599)
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-07-17 07:17:59 +00:00 |
|
|
Martin Hickey
|
4d4e04f452
|
[Render] Add round trip parity test and docs for derender (#48617)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-07-17 05:02:46 +00:00 |
|
|
Micah Williamson
|
67fe73b2b4
|
[CI] Extend max-model-len for test_parsable_context to allow reasoning to finish (#48873)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-07-17 11:36:44 +08:00 |
|
|
wang.yuqi
|
3e90d015ba
|
[Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-16 14:00:20 +00:00 |
|
|
Artem PerevedentsevandMatthew Bonanni
|
7cd1d57b74
|
[CI/Build][Docker] Bump nvidia-cutlass-dsl to 4.6.0 and drop packaging workarounds (#47442)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-16 13:51:41 +00:00 |
|
|
langzhao-netizenandClaude
|
8b8af2caf7
|
[Frontend] Expose logprob_token_ids on Python OpenAI endpoints (#43463)
Signed-off-by: Lang Zhao <lang.zhao@galileo.ai>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-13 14:40:21 -07:00 |
|
|
|
fc1c548093
|
Runtime Draft Weight Update for Speculative Decoding (#46725)
Signed-off-by: vx120 <893600387@qq.com>
Signed-off-by: vx120 <57470515+vx120@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: crp0128 <191679376@qq.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-11 22:51:53 -07:00 |
|
|
ErenAta16
|
0067311536
|
fix(entrypoints): stop resolve_items leaking in-flight media fetch tasks on partial failure (#48333)
Signed-off-by: ErenAta16 <erena6466@gmail.com>
|
2026-07-11 15:42:08 +00:00 |
|
|
Robert ShawandRobert Shaw
|
3d99b0499a
|
[Logs] DP Supervisor Log Improvement (#48278)
Signed-off-by: Robert Shaw <robertgshaw2-redhat@ip-172-31-18-125.us-east-2.compute.internal>
Co-authored-by: Robert Shaw <robertgshaw2-redhat@ip-172-31-18-125.us-east-2.compute.internal>
|
2026-07-11 12:07:00 +08:00 |
|
|
albertoandChauncey
|
5715fde12c
|
[Feature][Parser] Support include_reasoning param for non-Harmony models (#44301)
Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-07-10 15:34:02 +08:00 |
|
|
Muhammad FawazandMahad Durrani
|
e87521626f
|
Sanitize server file paths from validation error responses (#46415)
Signed-off-by: muhammadfawaz1 <135441198+muhammadfawaz1@users.noreply.github.com>
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com>
|
2026-07-09 17:46:29 +08:00 |
|
|
JooHo LeeandJooHo Lee
|
a07765c6bd
|
[Bugfix] Fix Qwen3-ASR transcription streaming postprocessing (#42478)
Signed-off-by: JooHo Lee <BWAAEEEK@users.noreply.github.com>
Signed-off-by: JooHo Lee <jooho414@gmail.com>
Co-authored-by: JooHo Lee <BWAAEEEK@users.noreply.github.com>
|
2026-07-09 00:33:27 -07:00 |
|
|
sungbin1015andClaude
|
04a703e397
|
[Frontend] Support bad_words in the /v1/completions endpoint (#46793)
Signed-off-by: sungbin1015 <sbin@solbox.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-08 09:51:17 +00:00 |
|
|
Muhammad FawazandMahad Durrani
|
d35eba302f
|
[Bugfix] Avoid leaking Pydantic repr in tool_choice error message (#47028)
Signed-off-by: muhammadfawaz1 <135441198+muhammadfawaz1@users.noreply.github.com>
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com>
|
2026-07-08 15:00:59 +08:00 |
|
|
Zach Zhu
|
5d5fab0061
|
[Bugfix][Frontend] Fix http_requests_total metric recording some 4xx errors as 5xx (#44303)
Signed-off-by: Zach Zhu <zzqshu@126.com>
|
2026-07-08 05:33:21 +00:00 |
|
|
Ting SUN
|
0303f37a54
|
[Bugfix][Pooling] Align CrossEncoder token type ids after truncation (#47772)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-07-08 03:59:22 +00:00 |
|
|
Juan Pérez de Algaba
|
675f4295cd
|
fix(security): bound completion prompt list to prevent unbounded engine fan-out (#47845)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-07-07 22:48:20 +00:00 |
|
|
Harry Mellor
|
dd94484577
|
Bump Transformers version to 5.10.4 (#41359)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-07 05:13:28 -07:00 |
|
|
Juan Pérez de AlgabaandCursor
|
b3e85be663
|
fix: use configured max_logprobs instead of hardcoded 20 in derender validation (#47834)
Signed-off-by: jperezde <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-07 09:42:47 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e55cc59e52
|
[Rust Frontend][CI] Unblock more end-to-end test cases (#47735)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-07 08:27:20 +00:00 |
|
|
Juan Pérez de Algabaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
8e61b646e2
|
fix(security): add resource bounds validation to derender endpoints (#47260)
Signed-off-by: jperezde <jperezde@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-07 14:58:26 +08:00 |
|
|
|
86db6c3070
|
[Frontend] add per-request timing metrics field to response body of Chat/Completions APIs (#46768)
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
Signed-off-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: GPT-5.5 <noreply@cursor.com>
|
2026-07-06 17:48:29 -07:00 |
|
|
akii96andAndreas Karatzas
|
5769a7382c
|
[ROCm][CI][Bugfix] Fix flaky parallel tool-call streaming (test assertion + Mistral/Granite parsers) (#47550)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-06 19:06:19 -04:00 |
|