iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
20,406 Commits 3 Branches 0 Tags
d125b540b71a6d406ff6ceed53aaa028005c7fe9
Commit Graph
2631 Commits
Author SHA1 Message Date
Misha GoinandOpenAI Codex c9331d8064 [CI] Preserve Rust Docker cache across commits (#53290) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-25 11:13:36 -07:00
Yan Ma 10ade93979 [XPU] update key supported models (#53494) 
Signed-off-by: Yan Ma <yan.ma@intel.com>
 2026-08-25 15:10:48 +00:00
Naveenraj KamalakannanandBenjamin Chislett d5cadcee86 [Feature][DSpark]: Logprobs adaptive verification (#52242) 
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
 2026-08-25 10:22:33 -04:00
wang.yuqi 735daf8ef6 [Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-08-25 07:02:32 +00:00
Harry MellorXianbao QIANClaude Opus 5Cyrus Leung
 		48d7132962 [Model] Migrate FlexOlmo, Olmo3 and Hunyuan V1/VL to the Transformers modeling backend (#53615) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-08-24 22:39:05 -07:00
Harry MellorXianbao QIANClaude Opus 5
 		7ca336929c [Model] Remove ten deprecated model architectures (#53608) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-24 17:06:00 -07:00
Juan Pérez de Algaba 0d7d5ed0b2 fix(security): enforce VLLM_MAX_AUDIO_CLIP_FILESIZE_MB on all audio paths (#53561) 
Signed-off-by: jperezde <jperezde@redhat.com>
 2026-08-24 21:37:02 +00:00
wang.yuqi 9cef631f30 [Frontend] Move run_batch.py out openai folder (#53500) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-08-24 15:04:10 +00:00
Juan Pérez de Algaba 9f295fe8ce [Docs][Security] Document multimodal media UUID security implications (#53582) 
Signed-off-by: jperezde <jperezde@redhat.com>
 2026-08-24 07:19:18 -07:00
Louie Tsai cc40c3673b [Xeon][doc]add Xeon recipes into table (#53226) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-08-24 06:42:28 +00:00
Clinton ThomasandLucas Bourtoule 2ec6f0d71e Reject oversized media before fully downloading it (#51896) 
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
 2026-08-24 01:15:09 +00:00
Aaron Hao 6cd9713463 [RL] P2P RDT weight sync (#43375) 2026-08-23 09:42:22 -07:00
Cyrus LeungandQwen Code ebcd606467 [MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
 2026-08-23 14:50:32 +08:00
Cyrus Leung 0b19ebcacd [MM] Simplify _apply_hf_processor_main (#53275) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-08-22 01:49:37 -07:00
Lucas Wilkinson 8bdc70ec7b [6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-08-21 17:47:49 -07:00
Maroon Ayoub a556f3fccb Forward Anthropic vllm_xargs to sampling params (#53308) 
Signed-off-by: Maroon Ayoub <mayoub@redhat.com>
 2026-08-21 15:23:21 -07:00
Kevin H. LuuandAndreas Karatzas e3f6026503 Revert "Remove native Hunyuan V1 and VL implementations" (#53296) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-21 13:39:58 -07:00
Tiezhen WANGandOpenAI Codex d53b1c2efc Remove native Hunyuan V1 and VL implementations (#53272) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-08-21 09:07:10 -07:00
Russell Bryant 6d8cd88e8d [Docs] document cache salting for prefix cache timing side-channel mitigation (#39082) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2026-08-21 09:06:49 -07:00
Luke Alonsoandmgoin 2740c817ff [Kernel] Add b12x FP4 MoE backend (#52018) 
Signed-off-by: Luke Alonso <lalonso@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2026-08-21 08:04:36 -07:00
Cyrus Leung b00f475f09 [MM] Remove text components from ProcessorInputs (#53093) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-08-20 20:42:53 -07:00
Kevin H. LuuandOpenAI Codex 0a5a55136f [CI][Docker] Pin remaining manylinux builder images (#53172) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-20 23:17:02 +00:00
Matthew KotilaReed MeyersonClaude Opus 4.8
 		7cfb97e337 [Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915) 
Signed-off-by: Matthew Kotila <7692737+matthewkotila@users.noreply.github.com>
Co-authored-by: Reed Meyerson <31574681+reed-meyerson@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-08-20 15:42:49 -07:00
SeonjinandMisha Goin bd8865a299 [Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204) 
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
 2026-08-20 10:07:22 -04:00
Prudhvi Vuda de216b6e64 [Bugfix] Skip MM processor cache inserts larger than capacity (#53016) 
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com>
 2026-08-20 13:42:50 +00:00
Turner JabbourandClaude Sonnet 5 1eab6fef01 [CI] replace shellcheck script with shellcheck-py hook (#52572) 
Signed-off-by: Turner <doubleujabbour@gmail.com>
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-08-20 10:09:59 +00:00
Zhixia LiuianzxliuClaudeaoshen02CodexNick Hill
 		a1c5b1fd9f [Core][V1] Support trace_decode_token_ids for deterministic decode replay (#46701) 
Signed-off-by: ianzxliu <ianzxliu@tencent.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Zhixia Liu <liuzhixia.nju@gmail.com>
Co-authored-by: ianzxliu <ianzxliu@tencent.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-20 15:12:43 +08:00
pmanczakandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> f85e060ec2 [Doc] Update Gaudi HPU committers (#52726) 
Signed-off-by: pmanczak <pawel.manczak@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-20 10:59:22 +08:00
Guanyi Chenandz-zanez bf2866f8bf [KV Connector] Add decode offloading to Mooncake Store consumers (#52466) 
Signed-off-by: z-zanez <zhouzh93@mail2.sysu.edu.cn>
Signed-off-by: Guanyi Chen <939416532@qq.com>
Co-authored-by: z-zanez <zhouzh93@mail2.sysu.edu.cn>
 2026-08-19 17:40:35 -07:00
jcotant-inferactClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		c205726108 [CI] Fix and extend PR/issue auto-labeling (#51459) 
Signed-off-by: Joe Cotant <joe@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-19 21:45:44 +00:00
Harry Mellor 2f54100a59 [CI] Fix docs build (#52937) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-19 05:25:46 -07:00
QWERQWERQWE86 58302b4591 [Doc] Fix group numbering in Case 3 of hybrid_kv_cache_manager.md (#52160) 
Signed-off-by: qwerqwerqwe8688-jpg <xuuuuu2021@163.com>
 2026-08-19 11:38:34 +00:00
wang.yuqi eac636a7fa [Frontend] Move api_server.py out openai folder (#52131) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-08-19 09:43:46 +00:00
Davis WertheimerClaudeHarry Mellor
 		3130573630 [Model] Add GraniteSWA and GraniteMoeSWA via existing Granite (#52706) 
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-08-18 20:32:46 -07:00
Russell BryantandClaude Opus 4.8 ef47a897e2 [Core] Make prefix-cache NONE_HASH deterministic by default (#51875) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-08-18 23:14:39 +00:00
Andreas Karatzas 203926c477 [ROCm][CI] Add AMD CI Pull-Request Commands (#52822) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-18 15:16:25 -07:00
karthik 241ff8c443 [Model] Enable LoRA support for tower and connector in LlavaNextForConditionalGeneration (#49788) 
Signed-off-by: gangula-karthik <gkarthik923@gmail.com>
 2026-08-18 15:53:49 +00:00
Bo Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> c296851a7d [MoE] Refine FlashInfer one-sided All2All integration (#51924) 
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-18 00:18:14 +00:00
Roberto L. CastroandCodex 49905ad94d [3/N][Feat][Perf] Add new warmup infrastructure for JITs. Add provider registry and orchestration for JIT warmup (#50174) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
 2026-08-17 10:11:14 -07:00
OlaandOpenAI Codex 95901ce70a fix(pooling): validate BGE-M3 combined task ownership (#51823) 
Signed-off-by: Zhe Li <2843409461@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-08-17 10:30:35 +00:00
TJian c05d923f18 [Doc] [ROCm] Update installation documentation (#52303) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-08-17 01:56:44 -07:00
Amal Sebastian 0ff370b51c docs: fix incorrect --custom-skip-chat-template flag reference (#52588) 2026-08-17 01:48:11 -07:00
Yiting Jiang 502af5ed00 [Doc] Add MatrixHub as a model loading source (#50492) 
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
 2026-08-17 02:32:23 +00:00
Shanshan ShenandAndreas Karatzas 0ad04cff1b [ROCm][CI] Enable ViT CUDA graph tests on AMD gfx950 GPUs (#52256) 
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-17 09:52:02 +08:00
Shane Widanagama d4801990a4 [CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901) 2026-08-15 07:01:52 -07:00
Connor CarpenterandNick Hill f473870ecf [Rust Frontend][gRPC] Add RL lifecycle control (#51316) 
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-14 11:32:39 -07:00
Jee Jee Li 69e0e58da1 [Doc] Update model support information (#52289) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-08-14 09:47:30 +00:00
Kunshang Ji 8e6d8e4f6a [XPU][CI/Release][3/N] Add xpu wheel release to release pipeline (#52108) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
 2026-08-14 14:00:17 +08:00
Tzu-Ling KanandClaude Opus 4.8 653cc6faca [Bugfix][NIXL] Include transfer mode (push/pull) in the compatibility hash (#50620) 
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-08-14 12:11:22 +08:00
Luke Alonso 3c79b1a8bf [Kernel] Add B12X dense linear backends (#52016) 
Signed-off-by: Luke Alonso <lalonso@gmail.com>
 2026-08-13 19:48:33 -07:00