 alpandmottopanikeiku
|
ff01a6b14f
|
[Bugfix][Frontend] Stop beam search on generation config EOS tokens (#62072)
pre-commit / pre-run-check (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Signed-off-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
Co-authored-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
|
2026-10-18 16:49:42 +00:00 |
|
|
Rémi Delhaye
|
3c13653738
|
[Frontend] Score with the chat template declared by Sentence Transformers CrossEncoders (#60877)
Signed-off-by: rdlhio <contact@rdlh.io>
|
2026-10-18 11:30:12 +00:00 |
|
|
Ting SUN
|
eb8de8d1a1
|
[Bugfix][OpenAI] Respect allowed_token_ids in beam search (#47630)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-10-17 08:50:40 +00:00 |
|
|
JovanandOpenAI Codex
|
5be4266f5c
|
[Bugfix][Frontend] Preserve Cohere and Anthropic streaming errors (#61947)
Signed-off-by: Kevin <jia__kuan@163.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-17 06:10:16 +00:00 |
|
|
Shuolei Wangandaoshen02
|
b3a7e2ff6e
|
[RL][Frontend] Return weight-version spans on OpenAI completions and chat (#61347)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-10-17 02:08:07 +00:00 |
|
|
|
153a17166e
|
[Frontend] Add the Beam reasoning and tool parsers (#62052)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yoni Gozlan <74535834+yonigozlan@users.noreply.github.com>
Co-authored-by: neilkg <33635204+neilkg@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 14:08:29 -07:00 |
|
|
alpandmottopanikeiku
|
4ab99ff136
|
[Bugfix][Frontend] Honor the constructor chat template in offline scoring (#61990)
Signed-off-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
Co-authored-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
|
2026-10-16 10:20:46 +00:00 |
|
|
|
dd9e07a25f
|
[Feature] Add External LB Mode Support for Elastic EP Scaling (#43202)
Signed-off-by: lqh-hh <liuqihang6@huawei.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: lqh-hh <liuqihang6@huawei.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: 2017403603 <705328646@qq.com>
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
Co-authored-by: Itay Alroy <75032521+itayalroy@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-15 21:29:02 -04:00 |
|
|
Jovan
|
a9e90b9d1d
|
[Bugfix][Frontend] Reject Cohere REQUIRED tool choice without tools (#61825)
Signed-off-by: Kevin <jia__kuan@163.com>
|
2026-10-15 16:37:08 +00:00 |
|
|
|
3dcfaeb4e8
|
[Frontend] Apply each endpoint's top_logprobs cut in derender (#59518)
Signed-off-by: Yin Li <kevinli.ai.work@gmail.com>
Co-authored-by: Yin Li <kevinli.ai.work@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-15 15:04:04 +00:00 |
|
|
Martin Hickey
|
252be28c18
|
[Frontend] Replace return_mm_kwargs with an mm_payload enum on render requests (#61427)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-10-15 12:41:46 +00:00 |
|
|
Martin Hickey
|
c6b772cf6b
|
[Bugfix][Frontend] Emit kv/ec transfer params at the top level of render output (#61241)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-10-15 12:34:15 +00:00 |
|
|
Talor Abramovich
|
81e42c9987
|
[Feature][Frontend] Control the log level of request JSON body using env var (#60630)
Signed-off-by: talora <talora@nvidia.com>
|
2026-10-15 11:07:19 +00:00 |
|
|
Flora FengandChauncey
|
80dd705c1d
|
[Frontend] Make finish_reason and Responses item status truthful (#59324)
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-10-15 10:12:02 +01:00 |
|
|
Misha GoinandClaude Opus 5.5
|
1c4c319792
|
[Frontend] Advertise --enable-x/--disable-x for boolean CLI flags (#61479)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 01:08:02 -07:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
8fa5ae844a
|
[Frontend] Let an unset --tool-strict-level fall back to the tool parser's default (#61328)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 15:48:38 +08:00 |
|
|
FeanorandTaneem Ibrahim
|
5d5c3d7c43
|
[Bugfix] Preserve padding token types for cross encoders (#58143)
Signed-off-by: zhaoye <772971548@qq.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-10-15 03:09:24 +00:00 |
|
|
alpandmottopanikeiku
|
e73fa00981
|
[Bugfix][Frontend] Apply the JSON schema in Cohere Chat v2 response_format (#60586)
Signed-off-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
Co-authored-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
|
2026-10-14 19:42:20 +00:00 |
|
|
Robert ShawandClaude
|
d3f6b2a7b3
|
[Frontend] Clean Client Facing 500 Report (#58043)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-14 14:27:58 -04:00 |
|
|
Woosuk KwonandClaude Opus 5.5
|
9d3dfa2886
|
[Benchmark] Add vllm bench forward: exact-shape forward timing (#61339)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 10:52:26 -07:00 |
|
|
Xunzhuo
|
89cab55086
|
[Model] Support Decision 3.0 decision models (vllm-sr/d3) (#61565)
Signed-off-by: Xunzhuo Liu <xunzhuo.liu@amd.com>
|
2026-10-14 17:10:55 +00:00 |
|
|
ChaunceyandCyrus Leung
|
e1726d9142
|
[Frontend] Add cache salt and tracing to openai decisions (#61550)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-14 00:48:44 -07:00 |
|
|
|
c923e7769b
|
[Feat] Add text-only OpenAI Decisions API MVP (#60465)
Signed-off-by: Francisco Javier Arceo <4163062+franciscojavierarceo@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-14 07:51:08 +08:00 |
|
|
GuanLuoandsfeng33
|
6d1daa9fe5
|
[Bugfix][Frontend] Expose completion response schemas in OpenAPI (#60926)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-13 18:54:06 +00:00 |
|
|
wang.yuqi
|
669f85e686
|
[Misc] Break chat_utils into more maintainable modules. (#60972)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-10-13 15:08:07 +00:00 |
|
|
Aditya Ganesh Kumar
|
d9a543c500
|
[Bugfix][Frontend] Forward --enable-log-outputs to the Cohere Chat v2 (#61089)
Signed-off-by: Aditya Ganesh Kumar <adty910@gmail.com>
|
2026-10-13 12:01:59 +00:00 |
|
|
Linze Shi
|
e6e84f350c
|
[Feature][Pooling] Add offline fixed-length late chunking (#60164)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
|
2026-10-13 11:16:21 +00:00 |
|
|
|
380638afbb
|
[Model] Add Clef-Flash support (#61308)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-13 05:46:37 +00:00 |
|
|
Martin Hickey
|
08582942d8
|
[Bugfix][Frontend] Honor request_id and X-Request-Id in chat and completions render (#61236)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-10-12 19:17:12 +00:00 |
|
|
Chester
|
c599b5971f
|
[Bugfix][Frontend] Return all logprobs when completions requests logprobs=-1 (#55717)
Signed-off-by: Chester <42577861+superdiaodiao@users.noreply.github.com>
|
2026-10-12 17:05:55 +00:00 |
|
|
|
fa39582756
|
[Frontend] Serve LiquidAI/d1-3B on /v1/systemone (#60676)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-12 13:00:47 -04:00 |
|
|
bzsuni
|
f022975964
|
[Bugfix] Reject beam search in completion render (#61212)
Signed-off-by: bzsuni <bingzhe.sun@daocloud.io>
|
2026-10-12 13:49:46 +00:00 |
|
|
|
092c35dd15
|
[Model] Support Cloudflare/clef-omni on /v1/systemone (#61064)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-12 21:27:34 +08:00 |
|
|
|
8d7b93fec2
|
[Frontend] Report stop_reason on /inference/v1/generate and pass it through derender (#60251)
Signed-off-by: Hyeonki Hong <hhk7734@gmail.com>
Signed-off-by: Shimi Bandiel <shimib@google.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Hyeonki Hong <hhk7734@gmail.com>
Co-authored-by: Mimir <mimir@nousresearch.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
|
2026-10-12 19:37:53 +08:00 |
|
|
Shijin ZhangandChauncey
|
83773ecdf3
|
[Frontend] Support CustomToolCall in the non-Harmony Responses API (#57322)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-10-12 17:22:55 +08:00 |
|
|
|
d4e92ccc37
|
[Bugfix][Frontend] Honor endpoint plugin route overrides (#58839)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-12 03:58:15 +00:00 |
|
|
Ting SUNandCyrus Leung
|
b99fdbe1f8
|
[Bugfix] Respect the configured offline chat template (#61061)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-11 16:27:21 +00:00 |
|
|
aoshen02
|
bd5bbce6e4
|
[RL] Release weight-transfer communicators without stopping inference (#61060)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: fh3 <a@b>
|
2026-10-11 21:15:14 +08:00 |
|
|
Subhash Polisetti
|
f425a21208
|
[Bugfix][Frontend] Support scalar priority and wire priority into LLM.chat() (#57243)
Signed-off-by: subhash polisetti <subhashr161347@gmail.com>
|
2026-10-11 10:03:33 +00:00 |
|
|
aoshen02andOpenAI Codex
|
1789f09588
|
[Frontend] Explain disabled scale-out endpoints with opt-in hints (#61042)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-11 08:58:07 +00:00 |
|
|
Juan Pérez de AlgabaandCyrus Leung
|
fcae5c9887
|
[Security] Restrict default CORS origins (#61009)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-11 08:26:02 +00:00 |
|
|
Shuolei Wangandaoshen02
|
b89852aad0
|
[RL][Frontend] Return token-level weight-version spans on final outputs (#59582)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-10-11 11:33:29 +08:00 |
|
|
Wentao Ye
|
276fbcff27
|
[Deprecation] Remove scheduled deprecated items (#60923)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-10-10 15:45:33 -04:00 |
|
|
Yufeng He
|
187a0eb98a
|
[Bugfix][Frontend] Forward --enable-log-outputs to the Anthropic handler (#60982)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
|
2026-10-10 16:36:03 +00:00 |
|
|
|
f2376cdc4d
|
[Fast Start] Preload the FlashInfer autotune table on the weight cache daemon (#60085)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-10 15:48:06 +00:00 |
|
|
Kay YanandCodex
|
c41b2639e2
|
[Bugfix][Responses API] Complete cache-write token accounting (#60973)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-10 09:08:36 +00:00 |
|
|
wang.yuqi
|
c1692c85f1
|
[Misc] mv chat_utils.py to renderers. (#60522)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-10-10 06:50:34 +00:00 |
|
|
Chauncey
|
fa5cfd48d5
|
[Refactor] Deduplicate trace header handling in BaseServing (#60828)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-10-10 05:27:58 +00:00 |
|
|
Misha GoinandClaude Opus 5.5
|
29e4d2d42e
|
[Frontend][Build] Add vllm download-kernels for FlashInfer precompiled kernels (#58765)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 21:22:35 -07:00 |
|
|
|
3c802af3cf
|
[Feat][Frontend] structured decisions: DiffusionGemma read strategy (#60466)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Signed-off-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-10 09:33:22 +08:00 |
|