Commit Graph
2745 Commits
Author SHA1 Message Date
Yousafandsfeng33 83db8c8390 [Feature][Frontend] Add granite_thinking_parser reasoning parser for Granite 4.2 (#55957)
Signed-off-by: Yousaf shah <yousaf.shah@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
2026-09-25 20:43:08 +00:00
73a78e6f1f [SpecDecode] Add LiLiCorr drafter (#57934)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Andrii Skliar <andreyws96@gmail.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
2026-09-25 10:08:28 -04:00
Isotr0py 24928a4d62 [UX][Frontend] Introduce vllm preload cli for fast restart (#56680)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-09-25 06:56:39 +00:00
8a269919f4 [MM] Add Triton kernel for mm_input_normal. (#56798)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
2026-09-25 04:31:20 +00:00
Zijing LiuYifan QiaoCodexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
7a9406690e [KV Connector] Fix DecodeBench fp8 fill values and add a startup fill mode (#58472)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-24 23:55:47 +00:00
fxmarty-amdmgoinmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
90a9515006 [Cleanup] Remove online quantization support in fp8.py in favor of online shorthands (#53585)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-24 12:48:14 -07:00
Misha Goin 58aa2f1ef1 [Refactor] Move auxiliary files out of the repository root (#58572)
Signed-off-by: mgoin <mgoin64@gmail.com>
2026-09-24 12:38:56 -07:00
Harry MellorandClaude Opus 5.5 d881812500 [Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-24 14:14:10 +00:00
Andreas KaratzasandCodex 153f2ba1b9 [Compile][CI] Honor Triton cache overrides and add AMD timeout headroom (#58474)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-24 01:27:07 -05:00
Lio Einaudi 711fc55c10 [Perf] Use breakable CUDA graphs (no torch.compile) by default under VLLM_BATCH_INVARIANT so the tuned matmul configs see the runtime M (#57586)
Signed-off-by: LioEinaudi <zhao3024667639@gmail.com>
2026-09-23 14:39:38 -04:00
CBPandMisha Goin f9ad9dd6b4 Doc: add DiffusionGemma to supported models (#46466)
Signed-off-by: Bruce <Bruce798858117@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
2026-09-23 17:14:30 +00:00
Yan MaandKunshang Ji e34489a543 [XPU] upgrade to PyTorch 2.14 (#56013)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-23 09:18:52 +00:00
Tianyu GuoandCyrus Leung 3ee2906f47 [EPD] Support metadata-only audio inputs (#57887)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
2026-09-23 09:03:50 +08:00
Kevin H. LuuandClaude Fable 5.1 64a48b19b4 [CI] Emit a kernel symbol map from the csrc build (opt-in, for test selection) (#58097)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-22 01:37:34 -07:00
639461eda4 [RL][Sleep] Retain frozen weights across level-2 sleep (#57891)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-22 12:36:55 +08:00
Nils MattesonTaneem IbrahimelehayymAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
13058faa49 [Frontend] Add reusable TP1 initialized-engine snapshots (#51360)
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: elehayym <52448798+Yuzu23@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-21 23:18:49 +00:00
Nicolò Lucchesi fba33e39cb [Docs] Add an Engram feature page explaining Engram usage in vLLM (#57910)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
2026-09-21 17:15:28 +00:00
LucainandClaude Opus 5 6b858751f6 [docs] Fix legacy hf CLI references (vllm) (#57958)
Signed-off-by: Wauplin <lucainp@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-21 15:32:27 +00:00
Tony Lin dc479a2d83 [Bugfix] Fix external LB DP rank handling when replicas share nodes (#53743)
Signed-off-by: Tony Lin <tony.lin@intel.com>
2026-09-21 17:19:14 +02:00
Martin Hickey 8b98b7d0b4 [Frontend] Add streaming parity tests and docs for derender (#57922)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
2026-09-21 14:13:52 +00:00
czhu-cohere 3918f3c5a3 [Profiler] Unify platform-aware torch profiling (#57460) 2026-09-20 19:17:23 -07:00
Zhou ZihangandJee Jee Li 3e67044972 [Doc] Refresh Kthena integration guide (#57314)
Signed-off-by: Zhou Zihang <z@mcac.cc>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-09-21 01:42:55 +00:00
jiangkuaixue123andCodex 7ddd461a28 [Docs] Add ECMooncakeConnector usage example for EPD (#57742)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-21 09:15:02 +08:00
roikoren755andmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 49ee12d742 [Misc] Rename --enable-mamba-fine-grained-prefix-cache (#53945 follow-up) (#57382)
Signed-off-by: Roi Koren <roik@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-20 09:50:34 -07:00
5302d1fe40 [Model Runner V2] Support custom logits processors (#56497)
Signed-off-by: David Cheung <d7cheung@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-09-19 17:46:49 +00:00
Nicolò Lucchesi 164dca8d1e [Nixl] Separate transport-failure metrics from KV expiry (#55854)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
2026-09-18 18:08:59 +02:00
Martin Hickey 70164bdadc [Frontend] Add stream reasoning and tool calls from the derender endpoint (#50550)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
2026-09-18 16:36:27 +02:00
dee37d8911 [Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: lazymio <mio@lazym.io>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-18 04:32:39 +00:00
092bdd6d57 [Frontend][Core] Add release_kv_cache_memory() API (#44890)
Signed-off-by: Dakai An <dakaian108@gmail.com>
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Dakai An <77474977+andakai@users.noreply.github.com>
Co-authored-by: AlanFokCo <alanfok2868@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-09-18 07:12:12 +08:00
YoungandYoung b78fbab4be [Docs] Fix the typos in the document (#57190)
Co-authored-by: Young <yangchh15@163.com>
2026-09-17 15:52:10 +00:00
Tianmu LiOpenAI CodexLi, Jiang <jiang1.li@intel.com>
23cd0346ce [CPU] Align scheduler and NIXL CPU affinity per local rank (#53636)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
2026-09-17 16:43:08 +08:00
coderfornowandLi, Jiang <jiang1.li@intel.com> 88afb77700 [CPU][s390x] Pin protobuf to 7.36.1 and drop C++ extension removal workaround (#54978)
Signed-off-by: coderfornow <Ritik.Dhiranan@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
2026-09-17 16:35:17 +08:00
2743dc4f92 [Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242)
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-17 13:16:41 +08:00
xinnywinneandBenjamin Chislett fbf2c5e8be [Frontend] Add per-request metrics to Responses API (#55084)
Signed-off-by: wxin <wxin@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
2026-09-16 22:52:05 +00:00
Harry MellorandClaude Opus 5 651a88c09a [CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-16 10:57:24 -07:00
Cyrus Leung 0b9e018fb9 [MM] Further cleanup _apply_hf_processor_main (#53610)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-09-16 10:21:00 -07:00
Harry MellorandClaude Opus 5 8c1557a79c Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-16 16:44:29 +00:00
linitra24 ca542ee154 [Model][LoRA] Enable LoRA support for ModernBertModel (#57148)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
2026-09-16 14:16:09 +00:00
linitra24andJee Jee Li c81eb3e69c [LoRA] Support modules_to_save for sequence classification (#53555)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-09-16 07:15:42 -07:00
f37c550bf6 [Feature][Frontend] Expose effective attention block size for DCP (#56538)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-16 08:29:43 +00:00
danisereb a31ec3a68b [LoRA][Nemotron] Add LoRA support for Nemotron VL models (for the language model only) (#56231)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
2026-09-15 21:20:28 -07:00
alberto 75dc588269 [KV Offload] Add per-request max_load_tokens control (#55885)
Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
2026-09-16 06:57:38 +03:00
Francisco Javier ArceoandOpenAI Codex 7d4bba5498 [Doc] Show how to get Responses prompt token IDs (#55912)
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-16 02:48:18 +00:00
0fefffc934 [KVConnector][NIXL] Support attention-HMA layouts in pipeline-parallel push prefill (#50494)
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-15 15:43:56 -07:00
+174
Jyotirmoy RoyCenab Batu BoraCodexItay AlroyTyler Michael SmithRita Brugarolasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Josiah DavisSimon DanielssonNick Hillcoderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>Shanshan ShenJulien DenizeWei ZhaoWei ZhaoMattMicah WilliamsonJiatai WangOpenAI CodexshaohuaxiClaude Opus 5Colin McNamaraMarceli Fylcek焦恺文James E T SmithCursorYukioZzzYicong WangKushalTianyu GuoLucas WilkinsonSummer YangHung Hoang (黄兴) <hungh@nvidia.com>wang.yuqiZhicheng LiuAndrii SkliarAndrii SkliarAlexanderlucamotzCyrus LeungpmanczakFadi ArafehLi, Jiang <jiang1.li@intel.com>JulienDarveBugen ZhaoNicolò LucchesiAndreas KaratzasLucas WilkinsonKevin H. LuuTony LinYongye ZhuJee Jee Liandyluo7zjy0516Harry MellorJinYan SuNicole LiHui 🥜ChaunceywaizuichougouIsotr0pyIsotr0pyYuxuan Zhang김재억labAxiaomingGuy StonedjramicWentao YeLucainSören DréanoChris EastwoodAndy LoMisha GoinchengchengpeiLyle LaimevinceGiancarlo Delfinamd-xavierwangAlecFangzhou AiFangzhou AiYizheng JiaoTahsin TunanDivakar VermaliuzhenweiBiswa PandaWoosuk KwonRoberto L. CastroMatthew BonanniLucas WilkinsonCanlin GuojunuxyzWalter Beller-MoralesFlora FengSrijan KeshriShengqi ChenKunshang JiTaneem IbrahimJartXClinton ThomasLucas BourtouleArtem Perevedentsevjcotant-inferactZeyu YangAyushman SinghRaphaël RiallandSimon VeitnerTomas RuizPatrykSafferpatryk.safferpatryk.safferPatryk SafferChao LeiAyushman SinghMarkus HartikainenJee Jee LiSurajKimi CodeRoger WangYleanJuntian LiuKebelinitra24Shenglei FuPavel Zakharovstu-caoStu CaoZhewen LiZhewen LiCedricHuangsiyuZupeng WangChaojun ZhangHotragn PettuganiAnjie HouAlexander LeeJooHo LeeJared WenChinmay-Kulkarni-AMDMatthias GehreBruceLoveDecimalliuqihaoMartin Hickeyjiangkuaixue123Juan Pérez de AlgabaReidXiaozhen BiGanesh RAlexHuangOr OzeriKimi CodeRonaldarkohutRussell BryantOrestis ZambounisBenjamin ChislettOrestis ZambounisSpeculators BotzqlzqlcodeThillai ChithambaramMark McLoughlinSamuel NordmannElizaWszolaZhiyao Yu鐘天楽Jorge Gallego FelicianoNetanel Habersychen52Michele CampiSherlockzhaoguochun1995JohnQinAMDaoshen02Bhushan AsatiMegha AgarwalliranschourLiqian LinwuhangxianYongye ZhuMiguel404marioMarioSherlockcjackal
79e205e8cd [Doc] Clarify ITL vs TPOT Prometheus metrics (#55283)
Signed-off-by: Jyotirmoy Roy <jyotirmoyroy649@gmail.com>
Signed-off-by: Cenab Batu Bora <40250311+cenab@users.noreply.github.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
Signed-off-by: Josiah Davis <Josiah.Davis@arm.com>
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Signed-off-by: Colin McNamara <colin@2cups.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Marceli Fylcek <marceli.fylcek@intel.com>
Signed-off-by: LearningMachine621 <147347705+LearningMachine621@users.noreply.github.com>
Signed-off-by: jamesETsmith <james.smith9113@gmail.com>
Signed-off-by: Cursor <cursoragent@cursor.com>
Signed-off-by: Yichao Zhu <Yichao.Zhu@amd.com>
Signed-off-by: wangyicong <wangyicong@bytedance.com>
Signed-off-by: Kushal <72650064+kushaldabbe@users.noreply.github.com>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: hungh <hungh@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: zhicheng Liu <lzc021026@gmail.com>
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Alexander Salikov <salikov57@gmail.com>
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Signed-off-by: pmanczak <pawel.manczak@intel.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Tony Lin <tony.lin@intel.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: JinYan Su <751080330@qq.com>
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Signed-off-by: waizuichougou <2082431897@qq.com>
Signed-off-by: waizuichougou <105572299+waizuichougou@users.noreply.github.com>
Signed-off-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk>
Signed-off-by: 김재억 <gadian88@gmail.com>
Signed-off-by: xiaoming <1259730330@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Guy Stone <guys@spotify.com>
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Lucain Pouget <lucain@huggingface.co>
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Signed-off-by: Sören Dréano <gailenstorm@gmail.com>
Signed-off-by: Chris Eastwood <chris.eastwood@pwn4g3.dev>
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Chengcheng Pei <5881383+chengchengpei@users.noreply.github.com>
Signed-off-by: Lyle Lai <lyle.lai@cienet.com>
Signed-off-by: Vincent <vincexxchan@gmail.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: xawang <xawang@amd.com>
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Signed-off-by: Fangzhou Ai <fangzhou@semianalysis.ai>
Signed-off-by: Yizheng Jiao <jyizheng@gmail.com>
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Matthew Bonanni <matthew@neuralmagic.com>
Signed-off-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
Signed-off-by: arcusbuilds <srijankeshri007@gmail.com>
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Signed-off-by: Joe Cotant <joe@inferact.ai>
Signed-off-by: yangzeyu <532183776@qq.com>
Signed-off-by: Ayushman Singh <40520701+ayush1399@users.noreply.github.com>
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Signed-off-by: Simon Veitner <sveitner@redhat.com>
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
Signed-off-by: patryk.saffer <patryk.saffer@blc-login-1.blc1.mistralcompute.ai>
Signed-off-by: patryk.saffer <patryk.saffer@blc-login-0.blc1.mistralcompute.ai>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Signed-off-by: Chao Lei <leichao139636@163.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Ayushman Singh <ayush1399@users.noreply.github.com>
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: surajm20061998 <surajm20061998@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Ylean <61880605+Woolgathererer@users.noreply.github.com>
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
Signed-off-by: Shenglei Fu <sfu@confluent.io>
Signed-off-by: pavelzak <pavel.zakharov@gmail.com>
Signed-off-by: fai <fangzhouai@gmail.com>
Signed-off-by: Stu Cao <stucao@Stus-MacBook-Pro.local>
Signed-off-by: <>
Signed-off-by: Zhewen Li <zhewenli@inferact.ai>
Signed-off-by: CedricHuang <38417461+CedricHwong@users.noreply.github.com>
Signed-off-by: siyu <mg21330037@smail.nju.edu.cn>
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: specture724 <specture724@gmail.com>
Signed-off-by: lxy-alexander <lxy_alexander@outlook.com>
Signed-off-by: BWAAEEEK <jooho414@gmail.com>
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Signed-off-by: liuqihao <liuqihao@myhexin.com>
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Xiaozhen Bi <xiaozhen.bi@gmail.com>
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: R <Ganesh.R@amd.com>
Signed-off-by: Alex <jihui.huang@daocloud.io>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: arkohut <39525455+arkohut@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Orestis Zambounis <23146389+orestis-z@users.noreply.github.com>
Signed-off-by: Orestis Zambounis <orestis.zambounis@gmail.com>
Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Orestis Zambounis <orestis-z@users.noreply.github.com>
Signed-off-by: Speculators Bot <bot@speculators.ai>
Signed-off-by: Speculators Bot <speculatorsbot@gmail.com>
Signed-off-by: zqlcode <lizongqiang@kanzhun.com>
Signed-off-by: zql <37731799+zqlcode@users.noreply.github.com>
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: snordmann <snordmann@nvidia.com>
Signed-off-by: Ianniu <985683179yzy@gmail.com>
Signed-off-by: Luossu <zhluosuu@outlook.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Signed-off-by: Michele Campi <michele.campi@outlook.com>
Signed-off-by: xiaguan <751080330@qq.com>
Signed-off-by: zhaoguochun1995 <zhaoguochun1995@163.com>
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: Liqian Lin <jacklin78911@gmail.com>
Signed-off-by: wuhangxian <1391938827@qq.com>
Signed-off-by: Yongye Zhu <yongye@inferact.ai>
Signed-off-by: Miguel Garcia <miguelgarciaroman8@gmail.com>
Signed-off-by: Mario <404mario@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: Cenab Batu Bora <40250311+cenab@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Itay Alroy <75032521+itayalroy@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Rita Brugarolas <Rita.BrugarolasBrufau@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Josiah Davis <josiah.j.davis@gmail.com>
Co-authored-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
Co-authored-by: Wei Zhao <weizha@oci-aga-slurm-1-vscode-02.cm.cluster>
Co-authored-by: Matt <156021403+mawong-amd@users.noreply.github.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Jiatai Wang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: shaohuaxi <huaxi.shx@alibaba-inc.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Colin McNamara <colin@2cups.com>
Co-authored-by: Marceli Fylcek <marceli.fylcek@intel.com>
Co-authored-by: 焦恺文 <15529091557@163.com>
Co-authored-by: James E T Smith <jamesETsmith@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: YukioZzz <Yichao.Zhu@amd.com>
Co-authored-by: Yicong Wang <wangyicong@bytedance.com>
Co-authored-by: Kushal <72650064+kushaldabbe@users.noreply.github.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Hung Hoang (黄兴) <hungh@nvidia.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Zhicheng Liu <2084597944@qq.com>
Co-authored-by: Andrii Skliar <andreyws96@gmail.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Alexander <Salikov57@gmail.com>
Co-authored-by: lucamotz <luca.motz@icloud.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: pmanczak <pawel.manczak@intel.com>
Co-authored-by: Fadi Arafeh <115173828+fadara01@users.noreply.github.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: JulienDarve <86800349+JulienDarve@users.noreply.github.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Tony Lin <tony.lin@intel.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: JinYan Su <751080330@qq.com>
Co-authored-by: Nicole LiHui 🥜 <nicole.li@daocloud.io>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: waizuichougou <105572299+waizuichougou@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Yuxuan Zhang <Yuxuan.Zhang2@liverpool.ac.uk>
Co-authored-by: 김재억 <gadian88@gmail.com>
Co-authored-by: labAxiaoming <34019940+labAxiaoming@users.noreply.github.com>
Co-authored-by: Guy Stone <guys@spotify.com>
Co-authored-by: djramic <djoramic@amd.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Lucain <lucain@huggingface.co>
Co-authored-by: Sören Dréano <71752785+SorenDreano@users.noreply.github.com>
Co-authored-by: Chris Eastwood <106503529+eastwood-c@users.noreply.github.com>
Co-authored-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: Lyle Lai <lyle.lai@cienet.com>
Co-authored-by: mevince <26759093+mevince@users.noreply.github.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: amd-xavierwang <xavier.wang@amd.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: Fangzhou Ai <fangzhou@semianalysis.ai>
Co-authored-by: Yizheng Jiao <jyizheng@gmail.com>
Co-authored-by: Tahsin Tunan <tahsintunan@gmail.com>
Co-authored-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com>
Co-authored-by: liuzhenwei <zhenweiliu@habana.ai>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
Co-authored-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
Co-authored-by: Walter Beller-Morales <walterbm@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Srijan Keshri <srijan.keshri@mindbodyonline.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: jcotant-inferact <joe@inferact.ai>
Co-authored-by: Zeyu Yang <532183776@qq.com>
Co-authored-by: Ayushman Singh <40520701+ayush1399@users.noreply.github.com>
Co-authored-by: Raphaël Rialland <36076211+TQCB@users.noreply.github.com>
Co-authored-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
Co-authored-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: patryk.saffer <patryk.saffer@blc-login-1.blc1.mistralcompute.ai>
Co-authored-by: patryk.saffer <patryk.saffer@blc-login-0.blc1.mistralcompute.ai>
Co-authored-by: Patryk Saffer <PatrykSaffer@users.noreply.github.com>
Co-authored-by: Chao Lei <leichao139636@163.com>
Co-authored-by: Ayushman Singh <ayush1399@users.noreply.github.com>
Co-authored-by: Markus Hartikainen <markus.hartikainen@amd.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Suraj <surajm20061998@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Ylean <61880605+Woolgathererer@users.noreply.github.com>
Co-authored-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Kebe <mail@kebe7jun.com>
Co-authored-by: linitra24 <renshuang.zhou@daocloud.io>
Co-authored-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com>
Co-authored-by: Pavel Zakharov <pavel.zakharov@gmail.com>
Co-authored-by: stu-cao <stu@primeintellect.ai>
Co-authored-by: Stu Cao <stucao@Stus-MacBook-Pro.local>
Co-authored-by: Zhewen Li <zhewenli@meta.com>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: CedricHuang <38417461+CedricHwong@users.noreply.github.com>
Co-authored-by: siyu <mg21330037@smail.nju.edu.cn>
Co-authored-by: Zupeng Wang <zupenwang@gmail.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Hotragn Pettugani <103170876+Hotragn@users.noreply.github.com>
Co-authored-by: Anjie Hou <149605198+specture724@users.noreply.github.com>
Co-authored-by: Alexander Lee <lxy_alexander@outlook.com>
Co-authored-by: JooHo Lee <96564470+BWAAEEEK@users.noreply.github.com>
Co-authored-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Chinmay-Kulkarni-AMD <Chinmay.Kulkarni@amd.com>
Co-authored-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: BruceLoveDecimal <39156883+BruceLoveDecimal@users.noreply.github.com>
Co-authored-by: liuqihao <liuqihao@myhexin.com>
Co-authored-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Juan Pérez de Algaba <124347725+jperezdealgaba@users.noreply.github.com>
Co-authored-by: Reid <61492567+reidliu41@users.noreply.github.com>
Co-authored-by: Xiaozhen Bi <xiaozhen.bi@gmail.com>
Co-authored-by: Ganesh R <ganesh.r@amd.com>
Co-authored-by: AlexHuang <jihui.huang@daocloud.io>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: Ronald <ronaldautomobile@163.com>
Co-authored-by: arkohut <39525455+arkohut@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Orestis Zambounis <23146389+orestis-z@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Orestis Zambounis <orestis-z@users.noreply.github.com>
Co-authored-by: Speculators Bot <speculatorsbot@gmail.com>
Co-authored-by: zql <37731799+zqlcode@users.noreply.github.com>
Co-authored-by: zqlcode <lizongqiang@kanzhun.com>
Co-authored-by: Thillai Chithambaram <79466435+thillai-c@users.noreply.github.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Samuel Nordmann <snordmann@nvidia.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Zhiyao(Ian) Yu <105995086+Ianniu123@users.noreply.github.com>
Co-authored-by: 鐘天楽 <zhluosuu@outlook.com>
Co-authored-by: Jorge Gallego Feliciano <jorge.gallego@mistral.ai>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: sychen52 <41452870+sychen52@users.noreply.github.com>
Co-authored-by: Michele Campi <215741962+MicheleCampi@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@raft.ai>
Co-authored-by: zhaoguochun1995 <109069909+zhaoguochun1995@users.noreply.github.com>
Co-authored-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Bhushan Asati <bhushanasati25@gmail.com>
Co-authored-by: Megha Agarwal <19240983+meghaagr13@users.noreply.github.com>
Co-authored-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Liqian Lin <jacklin78911@gmail.com>
Co-authored-by: wuhangxian <1391938827@qq.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Miguel <60073809+migarci2@users.noreply.github.com>
Co-authored-by: 404mario <18063257856@163.com>
Co-authored-by: Mario <404mario@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@openai.com>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
2026-09-14 23:35:13 -07:00
caf56ce9da [CI] Pass the scale-out endpoint flag in EC E2E (#56819)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
2026-09-15 12:25:30 +08:00
liranschour 17bc3e106a [KVConnector][P2P] Configurable unbound-store timeout and one-RTT rejection of a late fetch (#53453)
Signed-off-by: Liran Schour <lirans@il.ibm.com>
2026-09-15 05:38:18 +03:00
Andreas Karatzas bdad63c90a [CI] Check target branch freshness before starting CI (#56169)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-09-14 14:40:35 -07:00
Netanel Haber d4ee7fe7a9 [Quantization] Select linear backends per quantization (#51204)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
2026-09-14 16:24:18 -04:00
鐘天楽andNick Hill 0a5747d410 [Profiler] Add Proton CUDA graph attribution for MRV2 (#51084)
Signed-off-by: Luossu <zhluosuu@outlook.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-09-14 19:02:07 +00:00