Hexiang Wang
9a16d43ef0
[Bugfix][Mooncake] Fix MultiConnector stats and proxy SSE responses ( #61218 )
...
Signed-off-by: whx-sjtu <xiaowang990929@gmail.com >
Signed-off-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com >
2026-10-16 17:54:48 +08:00
littlecircle0730 and Shanshan Shen
71536bd5f8
[MM][CG] Support ViT full CUDA graph for DeepSeek-VL2 ( #46005 )
...
Signed-off-by: littlecircle0730 <littlecircle0730@gmail.com >
Signed-off-by: littlecircle0730 <43994952+littlecircle0730@users.noreply.github.com >
Co-authored-by: Shanshan Shen <467638484@qq.com >
2026-10-15 21:38:52 +08:00
Misha Goin and Claude Opus 5.5
1c4c319792
[Frontend] Advertise --enable-x/--disable-x for boolean CLI flags ( #61479 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-15 01:08:02 -07:00
Woosuk Kwon and Claude Opus 5.5
e57bb4ace7
[Core] Remove the legacy Ray compiled-graph executor ( #61712 )
...
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-14 18:13:27 -07:00
Linze Shi
e6e84f350c
[Feature][Pooling] Add offline fixed-length late chunking ( #60164 )
...
Signed-off-by: Linze-Shi <linzeshi0@gmail.com >
2026-10-13 11:16:21 +00:00
Shuolei Wang and aoshen02
b89852aad0
[RL][Frontend] Return token-level weight-version spans on final outputs ( #59582 )
...
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com >
Signed-off-by: Shuolei Wang <948904026@qq.com >
Co-authored-by: aoshen02 <aoshen@inferact.ai >
2026-10-11 11:33:29 +08:00
wang.yuqi
c1692c85f1
[Misc] mv chat_utils.py to renderers. ( #60522 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-10-10 06:50:34 +00:00
Ning Xie and Simon Mo
a0f28d73a8
[sharded state loader] support pp in sharded state loader ( #52110 )
...
Signed-off-by: Andy Xie <andy.xning@gmail.com >
Co-authored-by: Simon Mo <simon.mo@hey.com >
2026-10-09 11:08:31 -07:00
Rémi Delhaye
a1cd0ec650
[Model] Add zerank-2 reranker ( #60415 )
...
Signed-off-by: rdlhio <contact@rdlh.io >
2026-10-09 03:01:51 +00:00
Harry Mellor and Claude Opus 5.5
21d9758459
Remove Python 3.10 support now that it is EOL ( #60402 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 02:30:52 -07:00
cbee82324c
[Docs][RL] Move pause/resume and batch invariance examples to examples/rl ( #59949 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-07 06:22:10 +00:00
Jee Jee Li
f9c9e8ac24
[LoRA] Remove tensorizer ( #60024 )
...
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
2026-10-05 07:01:56 -07:00
Teng Ma and Teng Ma
1a9eaa3a68
[Doc] Document ECMooncakeConnector for EPD disaggregation ( #59196 )
...
Signed-off-by: Teng Ma <stmatengss@gmail.com >
Co-authored-by: Teng Ma <stmatengss@users.noreply.github.com >
2026-10-02 12:10:33 +08:00
Mark McLoughlin and OpenAI Codex
91fcec1235
[Core][Logging] Add built-in JSON formatter ( #58739 )
...
Add `--logging-config.formatter=json` to enable the python-json-logger
formatter without having to use a complete Python logging dictConfig.
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-10-01 09:11:46 +01:00
Mia Ojeda
e006d761a5
[Bugfix][CPU][DiffusionGemma] Support narrower canvas w/ sync scheduling ( #59107 )
...
Signed-off-by: ojeda-e <estefania.b.ojeda@gmail.com >
2026-09-29 23:28:50 -04:00
sashko-zakharchuk
a96ee5935d
[MRV2] Add DRY as a custom logits processor example ( #50584 )
...
Signed-off-by: Oleksandr Zakharchuk <oleksandr.zakharchuk@gmail.com >
2026-09-29 19:46:00 +00:00
b6d2b4fc25
[RL] Add sharding-aware NCCL M2N weight transfer ( #51520 )
...
Signed-off-by: Ke Wen <kwen@nvidia.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai >
2026-09-26 01:38:53 +00:00
Mark McLoughlin
a44d7b5151
[Core][Logging] Fix JSON logging process decoration ( #57957 )
...
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
2026-09-25 10:12:28 -06:00
Mark McLoughlin and AI Assistant
45d56c0baf
[Core] Model console logging as CLI configuration ( #57205 )
...
Add `--logging-config` CLI argument which can be supplied as
JSON or using dotted arguments. The `--log-level` argument
is provided for convenience, and `--log-config-file` is deprecated
in favor of `--logging-config.pylogging_config_file`.
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
Co-authored-by: AI Assistant <noreply@openai.com >
2026-09-25 11:36:59 +01:00
ab3de6edf2
[Perf] DiffusionGemma: constrained reads over the request's logprob_token_ids ( #58216 )
...
Signed-off-by: Matt Mastracci <matthew@mastracci.com >
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com >
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com >
2026-09-24 13:15:08 -07:00
Harry Mellor and Claude Opus 5.5
d636456b1f
[Frontend] Remove the slow tokenizer mode ( #58545 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-09-24 08:48:28 -07:00
Tianyu Guo and Cyrus Leung
3ee2906f47
[EPD] Support metadata-only audio inputs ( #57887 )
...
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-09-23 09:03:50 +08:00
1b3b88ec2b
[Core] structured generation mode for DiffusionGemma model (Jev-like) ( #57250 )
...
Signed-off-by: Matt Mastracci <matthew@mastracci.com >
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com >
Signed-off-by: Razorback16 <razorback16@protonmail.com >
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com >
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: Razorback16 <razorback16@protonmail.com >
2026-09-22 20:51:17 +00:00
Ting SUN and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
a33b3bac5d
[Bugfix][Qwen2.5-VL] Honor video fps for temporal M-RoPE ( #47736 )
...
Signed-off-by: Ting Sun <suntcrick@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-22 05:56:12 +00:00
YukioZzz
9679173788
[KVConnector][MoRIIO] Transfer hybrid mamba/KDA recurrent state in READ mode ( #51052 )
...
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com >
2026-09-20 17:30:34 -04:00
70fc7bd695
[Feature][EPD] Support dynamic EPD (EC-connector) proxy ( #54176 )
...
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-09-20 12:24:41 +08:00
0d72627565
[Perf][EPD] Batch image requests per encoder ( #57095 )
...
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com >
Co-authored-by: Zhou ziheng <jiaranran2@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-17 03:45:52 -07:00
Harry Mellor and Claude Opus 5
651a88c09a
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings ( #57212 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 10:57:24 -07:00
Harry Mellor and Claude Opus 5
8c1557a79c
Add pydocstyle to the ruff rules ( #52136 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Harry Mellor <hej.mellor@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 16:44:29 +00:00
linitra24 and Jee Jee Li
c81eb3e69c
[LoRA] Support modules_to_save for sequence classification ( #53555 )
...
Signed-off-by: linitra24 <Joy25810@foxmail.com >
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-09-16 07:15:42 -07:00
+174
79e205e8cd
[Doc] Clarify ITL vs TPOT Prometheus metrics ( #55283 )
...
Signed-off-by: Jyotirmoy Roy <jyotirmoyroy649@gmail.com >
Signed-off-by: Cenab Batu Bora <40250311+cenab@users.noreply.github.com >
Signed-off-by: Itay Alroy <ialroy@nvidia.com >
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com >
Signed-off-by: Josiah Davis <Josiah.Davis@arm.com >
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Signed-off-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com >
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com >
Signed-off-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster >
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com >
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com >
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com >
Signed-off-by: Micah Williamson <micah.williamson@amd.com >
Signed-off-by: JiataiWang <wangjiatai@proton.me >
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com >
Signed-off-by: Colin McNamara <colin@2cups.com >
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Signed-off-by: Marceli Fylcek <marceli.fylcek@intel.com >
Signed-off-by: LearningMachine621 <147347705+LearningMachine621@users.noreply.github.com >
Signed-off-by: jamesETsmith <james.smith9113@gmail.com >
Signed-off-by: Cursor <cursoragent@cursor.com >
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com >
Signed-off-by: wangyicong <wangyicong@bytedance.com >
Signed-off-by: Kushal <72650064+kushaldabbe@users.noreply.github.com >
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
Signed-off-by: Summer Yang <girasoleyang@gmail.com >
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com >
Signed-off-by: hungh <hungh@nvidia.com >
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: zhicheng Liu <lzc021026@gmail.com >
Signed-off-by: Andrii Skliar <askliar@nvidia.com >
Signed-off-by: Alexander Salikov <salikov57@gmail.com >
Signed-off-by: Luca Motz <luca.motz@icloud.com >
Signed-off-by: pmanczak <pawel.manczak@intel.com >
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com >
Signed-off-by: Julien Darve <jdarve@NVIDIA.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai >
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Signed-off-by: khluu <khluu000@gmail.com >
Signed-off-by: Kevin H. Luu <khluu000@gmail.com >
Signed-off-by: Tony Lin <tony.lin@intel.com >
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Signed-off-by: andyluo7 <andy.luo@amd.com >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: JinYan Su <751080330@qq.com >
Signed-off-by: nicole-lihui <nicole.li@daocloud.io >
Signed-off-by: waizuichougou <2082431897@qq.com >
Signed-off-by: waizuichougou <105572299+waizuichougou@users.noreply.github.com >
Signed-off-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk >
Signed-off-by: 김재억 <gadian88@gmail.com >
Signed-off-by: xiaoming <1259730330@qq.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Guy Stone <guys@spotify.com >
Signed-off-by: Djordje Ramic <djoramic@amd.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Signed-off-by: yewentao256 <zhyanwentao@126.com >
Signed-off-by: Lucain Pouget <lucain@huggingface.co >
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com >
Signed-off-by: Sören Dréano <gailenstorm@gmail.com >
Signed-off-by: Chris Eastwood <chris.eastwood@pwn4g3.dev >
Signed-off-by: Andy Lo <andy@mistral.ai >
Signed-off-by: mgoin <mgoin64@gmail.com >
Signed-off-by: Chengcheng Pei <5881383+chengchengpei@users.noreply.github.com >
Signed-off-by: Lyle Lai <lyle.lai@cienet.com >
Signed-off-by: Vincent <vincexxchan@gmail.com >
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai >
Signed-off-by: xawang <xawang@amd.com >
Signed-off-by: Alec Flowers <aflowers@nvidia.com >
Signed-off-by: Fangzhou Ai <fangzhou@semianalysis.ai >
Signed-off-by: Yizheng Jiao <jyizheng@gmail.com >
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com >
Signed-off-by: Divakar Verma <divakar.verma@amd.com >
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com >
Signed-off-by: Biswa Panda <biswa.panda@gmail.com >
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com >
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com >
Signed-off-by: Matthew Bonanni <matthew@neuralmagic.com >
Signed-off-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai >
Signed-off-by: Canlin <canlinguosdu@gmail.com >
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com >
Signed-off-by: walterbm <walter.beller.morales@gmail.com >
Signed-off-by: arcusbuilds <srijankeshri007@gmail.com >
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com >
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com >
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
Signed-off-by: JartX <sagformas@epdcenter.es >
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com >
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com >
Signed-off-by: Joe Cotant <joe@inferact.ai >
Signed-off-by: yangzeyu <532183776@qq.com >
Signed-off-by: Ayushman Singh <40520701+ayush1399@users.noreply.github.com >
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai >
Signed-off-by: Simon Veitner <sveitner@redhat.com >
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com >
Signed-off-by: patryk.saffer <patryk.saffer@blc-login-1.blc1.mistralcompute.ai >
Signed-off-by: patryk.saffer <patryk.saffer@blc-login-0.blc1.mistralcompute.ai >
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai >
Signed-off-by: Chao Lei <leichao139636@163.com >
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com >
Signed-off-by: Ayushman Singh <ayush1399@users.noreply.github.com >
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com >
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai >
Signed-off-by: surajm20061998 <surajm20061998@gmail.com >
Signed-off-by: Roger Wang <hey@rogerw.io >
Signed-off-by: Ylean <61880605+Woolgathererer@users.noreply.github.com >
Signed-off-by: Juntian Liu <Juntianl777@gmail.com >
Signed-off-by: Kebe <mail@kebe7jun.com >
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io >
Signed-off-by: Shenglei Fu <sfu@confluent.io >
Signed-off-by: pavelzak <pavel.zakharov@gmail.com >
Signed-off-by: fai <fangzhouai@gmail.com >
Signed-off-by: Stu Cao <stucao@Stus-MacBook-Pro.local >
Signed-off-by: <>
Signed-off-by: Zhewen Li <zhewenli@inferact.ai >
Signed-off-by: CedricHuang <38417461+CedricHwong@users.noreply.github.com >
Signed-off-by: siyu <mg21330037@smail.nju.edu.cn >
Signed-off-by: Wang Zupeng <zupenwang@gmail.com >
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in >
Signed-off-by: Isotr0py <2037008807@qq.com >
Signed-off-by: specture724 <specture724@gmail.com >
Signed-off-by: lxy-alexander <lxy_alexander@outlook.com >
Signed-off-by: BWAAEEEK <jooho414@gmail.com >
Signed-off-by: Jared Wen <jaredwen@inferact.ai >
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com >
Signed-off-by: jiang1.li <jiang1.li@intel.com >
Signed-off-by: Jared Wen <w13431838023@gmail.com >
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com >
Signed-off-by: liuqihao <liuqihao@myhexin.com >
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com >
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Signed-off-by: reidliu41 <reid201711@gmail.com >
Signed-off-by: Xiaozhen Bi <xiaozhen.bi@gmail.com >
Signed-off-by: shen-shanshan <467638484@qq.com >
Signed-off-by: R <Ganesh.R@amd.com >
Signed-off-by: Alex <jihui.huang@daocloud.io >
Signed-off-by: Ronald1995 <ronaldautomobile@163.com >
Signed-off-by: arkohut <39525455+arkohut@users.noreply.github.com >
Signed-off-by: Russell Bryant <rbryant@redhat.com >
Signed-off-by: Orestis Zambounis <23146389+orestis-z@users.noreply.github.com >
Signed-off-by: Orestis Zambounis <orestis.zambounis@gmail.com >
Signed-off-by: Claude <noreply@anthropic.com >
Signed-off-by: Orestis Zambounis <orestis-z@users.noreply.github.com >
Signed-off-by: Speculators Bot <bot@speculators.ai >
Signed-off-by: Speculators Bot <speculatorsbot@gmail.com >
Signed-off-by: zqlcode <lizongqiang@kanzhun.com >
Signed-off-by: zql <37731799+zqlcode@users.noreply.github.com >
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com >
Signed-off-by: ElizaWszola <ewszola@redhat.com >
Signed-off-by: snordmann <snordmann@nvidia.com >
Signed-off-by: Ianniu <985683179yzy@gmail.com >
Signed-off-by: Luossu <zhluosuu@outlook.com >
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com >
Signed-off-by: Shiyang Chen <shiychen@nvidia.com >
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com >
Signed-off-by: Michele Campi <michele.campi@outlook.com >
Signed-off-by: xiaguan <751080330@qq.com >
Signed-off-by: zhaoguochun1995 <zhaoguochun1995@163.com >
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com >
Signed-off-by: aoshen02 <aoshen@inferact.ai >
Signed-off-by: Liran Schour <lirans@il.ibm.com >
Signed-off-by: Liqian Lin <jacklin78911@gmail.com >
Signed-off-by: wuhangxian <1391938827@qq.com >
Signed-off-by: Yongye Zhu <yongye@inferact.ai >
Signed-off-by: Miguel Garcia <miguelgarciaroman8@gmail.com >
Signed-off-by: Mario <404mario@users.noreply.github.com >
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com >
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com >
Co-authored-by: Cenab Batu Bora <40250311+cenab@users.noreply.github.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: Itay Alroy <75032521+itayalroy@users.noreply.github.com >
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Co-authored-by: Rita Brugarolas <Rita.BrugarolasBrufau@amd.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Josiah Davis <josiah.j.davis@gmail.com >
Co-authored-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com >
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com >
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com >
Co-authored-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster >
Co-authored-by: Matt <156021403+mawong-amd@users.noreply.github.com >
Co-authored-by: Micah Williamson <micah.williamson@amd.com >
Co-authored-by: Jiatai Wang <wangjiatai@proton.me >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: shaohuaxi <huaxi.shx@alibaba-inc.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Colin McNamara <colin@2cups.com >
Co-authored-by: Marceli Fylcek <marceli.fylcek@intel.com >
Co-authored-by: 焦恺文 <15529091557@163.com >
Co-authored-by: James E T Smith <jamesETsmith@users.noreply.github.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: YukioZzz <Yichao.Zhu@amd.com >
Co-authored-by: Yicong Wang <wangyicong@bytedance.com >
Co-authored-by: Kushal <72650064+kushaldabbe@users.noreply.github.com >
Co-authored-by: Tianyu Guo <guoty@inferact.ai >
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com >
Co-authored-by: Summer Yang <girasoleyang@gmail.com >
Co-authored-by: Hung Hoang (黄兴） <hungh@nvidia.com >
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io >
Co-authored-by: Zhicheng Liu <2084597944@qq.com >
Co-authored-by: Andrii Skliar <andreyws96@gmail.com >
Co-authored-by: Andrii Skliar <askliar@nvidia.com >
Co-authored-by: Alexander <Salikov57@gmail.com >
Co-authored-by: lucamotz <luca.motz@icloud.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
Co-authored-by: pmanczak <pawel.manczak@intel.com >
Co-authored-by: Fadi Arafeh <115173828+fadara01@users.noreply.github.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
Co-authored-by: JulienDarve <86800349+JulienDarve@users.noreply.github.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com >
Co-authored-by: Kevin H. Luu <khluu000@gmail.com >
Co-authored-by: Tony Lin <tony.lin@intel.com >
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com >
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: andyluo7 <andy.luo@amd.com >
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: JinYan Su <751080330@qq.com >
Co-authored-by: Nicole LiHui 🥜 <nicole.li@daocloud.io >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
Co-authored-by: waizuichougou <105572299+waizuichougou@users.noreply.github.com >
Co-authored-by: Isotr0py <2037008807@qq.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Yuxuan Zhang <Yuxuan.Zhang2@liverpool.ac.uk >
Co-authored-by: 김재억 <gadian88@gmail.com >
Co-authored-by: labAxiaoming <34019940+labAxiaoming@users.noreply.github.com >
Co-authored-by: Guy Stone <guys@spotify.com >
Co-authored-by: djramic <djoramic@amd.com >
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com >
Co-authored-by: Lucain <lucain@huggingface.co >
Co-authored-by: Sören Dréano <71752785+SorenDreano@users.noreply.github.com >
Co-authored-by: Chris Eastwood <106503529+eastwood-c@users.noreply.github.com >
Co-authored-by: Andy Lo <andy@mistral.ai >
Co-authored-by: Misha Goin <mgoin64@gmail.com >
Co-authored-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com >
Co-authored-by: Lyle Lai <lyle.lai@cienet.com >
Co-authored-by: mevince <26759093+mevince@users.noreply.github.com >
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com >
Co-authored-by: amd-xavierwang <xavier.wang@amd.com >
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com >
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com >
Co-authored-by: Fangzhou Ai <fangzhou@semianalysis.ai >
Co-authored-by: Yizheng Jiao <jyizheng@gmail.com >
Co-authored-by: Tahsin Tunan <tahsintunan@gmail.com >
Co-authored-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com >
Co-authored-by: liuzhenwei <zhenweiliu@habana.ai >
Co-authored-by: Biswa Panda <biswa.panda@gmail.com >
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai >
Co-authored-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com >
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
Co-authored-by: junuxyz <216036880+junuxyz@users.noreply.github.com >
Co-authored-by: Walter Beller-Morales <walterbm@users.noreply.github.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
Co-authored-by: Srijan Keshri <srijan.keshri@mindbodyonline.com >
Co-authored-by: Shengqi Chen <harry-chen@outlook.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
Co-authored-by: JartX <sagformas@epdcenter.es >
Co-authored-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com >
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com >
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com >
Co-authored-by: jcotant-inferact <joe@inferact.ai >
Co-authored-by: Zeyu Yang <532183776@qq.com >
Co-authored-by: Ayushman Singh <40520701+ayush1399@users.noreply.github.com >
Co-authored-by: Raphaël Rialland <36076211+TQCB@users.noreply.github.com >
Co-authored-by: Simon Veitner <sveitner@redhat.com >
Co-authored-by: Tomas Ruiz <tomas.ruiz.te@gmail.com >
Co-authored-by: PatrykSaffer <patryk.saffer@mistral.ai >
Co-authored-by: patryk.saffer <patryk.saffer@blc-login-1.blc1.mistralcompute.ai >
Co-authored-by: patryk.saffer <patryk.saffer@blc-login-0.blc1.mistralcompute.ai >
Co-authored-by: Patryk Saffer <PatrykSaffer@users.noreply.github.com >
Co-authored-by: Chao Lei <leichao139636@163.com >
Co-authored-by: Ayushman Singh <ayush1399@users.noreply.github.com >
Co-authored-by: Markus Hartikainen <markus.hartikainen@amd.com >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
Co-authored-by: Suraj <surajm20061998@gmail.com >
Co-authored-by: Kimi Code <noreply@moonshot.ai >
Co-authored-by: Roger Wang <hey@rogerw.io >
Co-authored-by: Ylean <61880605+Woolgathererer@users.noreply.github.com >
Co-authored-by: Juntian Liu <Juntianl777@gmail.com >
Co-authored-by: Kebe <mail@kebe7jun.com >
Co-authored-by: linitra24 <renshuang.zhou@daocloud.io >
Co-authored-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com >
Co-authored-by: Pavel Zakharov <pavel.zakharov@gmail.com >
Co-authored-by: stu-cao <stu@primeintellect.ai >
Co-authored-by: Stu Cao <stucao@Stus-MacBook-Pro.local >
Co-authored-by: Zhewen Li <zhewenli@meta.com >
Co-authored-by: Zhewen Li <zhewenli@inferact.ai >
Co-authored-by: CedricHuang <38417461+CedricHwong@users.noreply.github.com >
Co-authored-by: siyu <mg21330037@smail.nju.edu.cn >
Co-authored-by: Zupeng Wang <zupenwang@gmail.com >
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com >
Co-authored-by: Hotragn Pettugani <103170876+Hotragn@users.noreply.github.com >
Co-authored-by: Anjie Hou <149605198+specture724@users.noreply.github.com >
Co-authored-by: Alexander Lee <lxy_alexander@outlook.com >
Co-authored-by: JooHo Lee <96564470+BWAAEEEK@users.noreply.github.com >
Co-authored-by: Jared Wen <w13431838023@gmail.com >
Co-authored-by: Chinmay-Kulkarni-AMD <Chinmay.Kulkarni@amd.com >
Co-authored-by: Matthias Gehre <matthias.gehre@amd.com >
Co-authored-by: BruceLoveDecimal <39156883+BruceLoveDecimal@users.noreply.github.com >
Co-authored-by: liuqihao <liuqihao@myhexin.com >
Co-authored-by: Martin Hickey <martin.hickey@ie.ibm.com >
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com >
Co-authored-by: Juan Pérez de Algaba <124347725+jperezdealgaba@users.noreply.github.com >
Co-authored-by: Reid <61492567+reidliu41@users.noreply.github.com >
Co-authored-by: Xiaozhen Bi <xiaozhen.bi@gmail.com >
Co-authored-by: Ganesh R <ganesh.r@amd.com >
Co-authored-by: AlexHuang <jihui.huang@daocloud.io >
Co-authored-by: Or Ozeri <oro@il.ibm.com >
Co-authored-by: Kimi Code <noreply@moonshot.cn >
Co-authored-by: Ronald <ronaldautomobile@163.com >
Co-authored-by: arkohut <39525455+arkohut@users.noreply.github.com >
Co-authored-by: Russell Bryant <rbryant@redhat.com >
Co-authored-by: Orestis Zambounis <23146389+orestis-z@users.noreply.github.com >
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com >
Co-authored-by: Orestis Zambounis <orestis-z@users.noreply.github.com >
Co-authored-by: Speculators Bot <speculatorsbot@gmail.com >
Co-authored-by: zql <37731799+zqlcode@users.noreply.github.com >
Co-authored-by: zqlcode <lizongqiang@kanzhun.com >
Co-authored-by: Thillai Chithambaram <79466435+thillai-c@users.noreply.github.com >
Co-authored-by: Mark McLoughlin <markmc@redhat.com >
Co-authored-by: Samuel Nordmann <snordmann@nvidia.com >
Co-authored-by: ElizaWszola <ewszola@redhat.com >
Co-authored-by: Zhiyao(Ian) Yu <105995086+Ianniu123@users.noreply.github.com >
Co-authored-by: 鐘天楽 <zhluosuu@outlook.com >
Co-authored-by: Jorge Gallego Feliciano <jorge.gallego@mistral.ai >
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com >
Co-authored-by: sychen52 <41452870+sychen52@users.noreply.github.com >
Co-authored-by: Michele Campi <215741962+MicheleCampi@users.noreply.github.com >
Co-authored-by: Sherlock <sherlock@raft.ai >
Co-authored-by: zhaoguochun1995 <109069909+zhaoguochun1995@users.noreply.github.com >
Co-authored-by: JohnQinAMD <yanyuan.qin@amd.com >
Co-authored-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: Bhushan Asati <bhushanasati25@gmail.com >
Co-authored-by: Megha Agarwal <19240983+meghaagr13@users.noreply.github.com >
Co-authored-by: liranschour <liranschour@users.noreply.github.com >
Co-authored-by: Liqian Lin <jacklin78911@gmail.com >
Co-authored-by: wuhangxian <1391938827@qq.com >
Co-authored-by: Yongye Zhu <yongye@inferact.ai >
Co-authored-by: Miguel <60073809+migarci2@users.noreply.github.com >
Co-authored-by: 404mario <18063257856@163.com >
Co-authored-by: Mario <404mario@users.noreply.github.com >
Co-authored-by: Sherlock <sherlock@openai.com >
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com >
2026-09-14 23:35:13 -07:00
jiangkuaixue123
1678b39627
[Bugfix][EPD] Preserve media processing options in encoder requests ( #56786 )
...
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com >
2026-09-14 10:05:13 +00:00
Martin Hickey
934b1fcbcb
[Frontend] Replace VLLM_ENABLE_SCALE_OUT_ENDPOINTS with --enable-scale-out ( #55176 )
...
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
2026-09-14 10:02:14 +00:00
Tianyu Guo
319cc5ef19
[Performance][EPD] Reduce Python proxy serialization overhead ( #56657 )
...
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
2026-09-13 15:07:12 -07:00
junuxyz
372477d2d9
[Bugfix][Examples] Launch prefill and decode concurrently in NixlPushConnector demo ( #55088 )
...
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com >
2026-09-12 06:22:34 +00:00
Yunzhu Lu and Isotr0py
442d36031c
[MM][CG] Enable encoder CUDA Graph for MiniCPM-V ( #42785 )
...
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-10 06:28:48 +00:00
Tianyu Guo
479611c0c6
[Frontend][EPD] Use JSON arrays for multimodal metadata ( #56090 )
...
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
2026-09-10 05:04:14 +00:00
ea40bb9e90
[feature] Watermarked generation and detection (Gumbel-max algorithm) ( #54053 )
...
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-09 21:00:15 -07:00
weihan
9ea8f3ffc3
[Bugfix] Honor STEP token pooling in DispatchPooler.for_seq_cls ( #55307 )
...
Signed-off-by: weihan <130119942+krsish@users.noreply.github.com >
2026-09-08 04:13:09 +00:00
6fbb00b188
[EPD] Add ECMooncakeConnector for encoder cache over Mooncake TransferEngine ( #41567 )
...
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com >
Signed-off-by: Tianyu Guo <guoty@inferact.ai >
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com >
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Tianyu Guo <guoty@inferact.ai >
Co-authored-by: Zhou ziheng <jiaranran2@gmail.com >
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-07 06:21:43 +00:00
omerpaz95 and Claude Opus 5
8a0a7ee40a
[EC Connector] P2P NIXL + CPU EC Connector ( #47941 )
...
Signed-off-by: omerpaz95 <omerpaz95@gmail.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-09-04 11:23:56 +08:00
d9e2b5238d
[Core][KV Events] Echo session_id on GPU BlockStored events ( #51381 )
...
Signed-off-by: liuguangli <liuguangli35@gmail.com >
Signed-off-by: jinx-machinepulse <2679622408@qq.com >
Co-authored-by: liuguangli <liuguangli35@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-04 02:22:50 +00:00
Francisco Javier Arceo
c00091e026
[Frontend] Gate scale-out endpoints behind opt-in flag ( #54579 )
...
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com >
2026-09-02 14:31:14 +08:00
Isotr0py
555ea65e8c
[Frontend] Add video embeds input support ( #54242 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-08-31 03:20:47 +00:00
Hert4
4a6a3272e8
[Bugfix][Frontend] Let pooling requests set padding ( #51157 )
...
Signed-off-by: Hert4 <ductransa01@gmail.com >
2026-08-27 11:06:20 +00:00
6c4aa8bec3
[RL] Support checkpoint-coordinate sparse NCCL weight updates ( #53751 )
...
Signed-off-by: aoshen02 <aoshen@inferact.ai >
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com >
Co-authored-by: aoshen02 <aoshen@inferact.ai >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-27 18:19:51 +08:00
QWERQWERQWE86
15baeaee98
[Doc] Fix local input path in run-batch examples across docs ( #53220 )
2026-08-26 12:17:56 +00:00
7ca336929c
[Model] Remove ten deprecated model architectures ( #53608 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 17:06:00 -07:00
Wentao Ye
f59bb0bd8c
[Refactor] Refactor batch invariance folder ( #53619 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-08-24 14:31:36 -07:00
wang.yuqi
9cef631f30
[Frontend] Move run_batch.py out openai folder ( #53500 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-08-24 15:04:10 +00:00
