iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
22,316 Commits 3 Branches 0 Tags
bcee730b1a9d25f0fd283a0ef6c19133ebeebf4f
Commit Graph
288 Commits
Author SHA1 Message Date
Andrii SkliarandAndrii Skliar deb148e730 [Mamba] Add FlashInfer ReplaySSM support for MTP (#52928) 
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
 2026-09-30 21:41:17 +00:00
TaimysCodexLuyi XiaoTaimysHarry MellorClaude Opus 5.5
 		5225f1bacb [MyPy][3/N] Fix MyPy errors in test groups (part 3) (#55939) 
Signed-off-by: Taimys <ffy2281693949@gmail.com>
Signed-off-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com>
Co-authored-by: Taimys <ffy2281693949@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 11:06:07 +00:00
Martin HickeyHarry MellorClaude Opus 5.5
 		5dd693122c [MyPy][2/N] Fix mypy errors in small tests/ dirs (#51043) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-29 21:27:45 +01:00
Ashraf BhuiyanWentao YeHarry Mellor
 		9a190f142c [Mypy] Fix mypy typing for Zamba2 models (#58255) 
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-29 18:13:52 +00:00
Ashraf BhuiyanandWentao Ye 2454b5a4f0 [Mypy] Fix mypy typing for Whisper models (#58254) 
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-29 17:10:28 +01:00
Ashraf BhuiyanandWentao Ye 2619b6b72b [Mypy] Fix mypy typing for Voxtral and vision models (#58251) 
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-28 15:52:50 -04:00
Louie Tsai ccfd1cea75 [CPU] Include vLLM Recipes tooling in release image to deploy models using vLLM Recipes (#58796) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-09-28 16:46:53 +08:00
Turner JabbourandClaude Sonnet 5 2407f405b5 [CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055) 
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-09-27 22:23:46 -07:00
Ashraf Bhuiyan b9e2903b89 [Mypy] Fix mypy typing for Ultravox and Unlimited-OCR models (#58239) 
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
 2026-09-27 21:19:04 -04:00
Ashraf Bhuiyan 5113cf9d16 [Mypy] Fix mypy typing for Qwen and Qianfan models (#58046) 
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
 2026-09-26 14:31:51 +00:00
Misha Goin 58aa2f1ef1 [Refactor] Move auxiliary files out of the repository root (#58572) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-09-24 12:38:56 -07:00
Harry MellorandClaude Opus 5.5 d881812500 [Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
 2026-09-24 14:14:10 +00:00
Kevin H. LuuandClaude Fable 5.1 64a48b19b4 [CI] Emit a kernel symbol map from the csrc build (opt-in, for test selection) (#58097) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-22 01:37:34 -07:00
Turner JabbourClaude Sonnet 5Kevin H. LuuNick Hill
 		e9f169d16b [CI] Add pre-commit check that new tests are tethered to Buildkite jobs (#54867) 
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Signed-off-by: Turner <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-09-21 18:36:45 -07:00
Nils MattesonTaneem IbrahimelehayymAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		13058faa49 [Frontend] Add reusable TP1 initialized-engine snapshots (#51360) 
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: elehayym <52448798+Yuzu23@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-21 23:18:49 +00:00
Kevin H. LuuOpenAI CodexJee Jee Li
 		eb87980585 [Build] Fix DeepGEMM CUDA 12.9 release builds (#57554) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-09-20 20:14:00 -07:00
Louie Tsai 03f8301387 Add one-step recipe serving (#57306) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-09-20 11:24:09 +08:00
Taneem Ibrahim 2b8a5495a8 [Mypy] Fix mypy typing for N/O models (#54142) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-18 12:50:01 +01:00
Taneem IbrahimandHarry Mellor e960ead0aa [Mypy] Fix mypy typing for Transformers models (#54320) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-17 12:11:31 -04:00
Ziyang MaBugen ZhaoCodex
 		d7e755c230 [Bugfix] Fix wrong vLLM version reported by pip install (proto-v* tag collision) (#57295) 
Signed-off-by: RyanMa29 <ziyang.ma@intel.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-17 08:50:14 -07:00
Yongye Zhu 929aa2a7ed [Build] Bump DeepGEMM pin to a6bbb80 (#57218) 2026-09-16 14:49:35 -07:00
Harry MellorandClaude Opus 5 651a88c09a [CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 10:57:24 -07:00
Misha Goin 1085b64425 [Benchmark] Retire stale benchmarks and consolidate RMSNorm (#57083) 
Signed-off-by: Misha Goin <mgoin64@gmail.com>
 2026-09-16 13:21:43 -04:00
Harry MellorandClaude Opus 5 8c1557a79c Add pydocstyle to the ruff rules (#52136) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 16:44:29 +00:00
Yongye ZhuandClaude Opus 5 8263ea12bd [Build] Move DeepGEMM pin to the vLLM fork and update the Mega MoE call convention (#56876) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-15 00:57:18 -07:00
Tahsin Tunan 80650454dc [CI] Give every Buildkite step an explicit key, and a hook to enforce it (#56329) 
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
 2026-09-11 18:08:05 -07:00
Taneem Ibrahim f9083cb83a [Mypy] Fix typing for R/S models (#54157) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-10 09:43:08 -04:00
Taneem IbrahimandHarry Mellor 784cac7c42 [Mypy] Fix mypy typing for P models (#54169) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-04 20:47:11 +00:00
siyuliusy58Isotr0py
 		a69e75b9b6 Fast Start (#54921) 
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
 2026-09-04 06:32:06 -07:00
Taneem Ibrahim c615b1fd67 [Mypy] Fix mypy typing for L models (#54177) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-04 07:50:43 -04:00
Taneem Ibrahim 76f3249fbd [Mypy] Fix typing for M models (#54262) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-01 11:26:00 -04:00
Taneem Ibrahim fd5d3aea94 [Mypy] Fix typing for J models (#54130) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-29 08:50:15 -04:00
Taneem IbrahimandWentao Ye 21fa2c5a2a [Mypy] Fix mypy typing for model interfaces and H/I models (#54079) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-08-28 16:49:19 -04:00
Shang Wangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 9650dc73e2 [CI/Build][Hardware][NVIDIA] Add opt-in Rubin Docker builds (#53443) 
Signed-off-by: Shang Wang <samshang.wang@mail.utoronto.ca>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-27 16:06:44 +00:00
Louie Tsai 79651d6085 [Tools][Recipes] Improve sweep recommendations and short-alias parsing (#53946) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-08-27 06:58:23 +00:00
Jensen ChenClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		c47ca4aaeb [Mypy Fix] Mypy fix for "vllm/model_executor/models/[tT]" (#53466) 
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-26 14:12:11 +00:00
Wentao Ye 70021a0081 [Mypy Fix] Mypy fix for "vllm/model_executor/models/[gG]" (#53616) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-08-25 09:47:16 -07:00
Louie Tsai 4af586e185 Vllm recipes tool improve (#53325) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-08-25 05:53:47 +00:00
Aaron Hao 6cd9713463 [RL] P2P RDT weight sync (#43375) 2026-08-23 09:42:22 -07:00
Wentao Ye 811d12ee26 [Mypy Fix] Mypy fix for "vllm/model_executor/models/[eE][fF]" (#53381) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-08-22 15:41:27 -04:00
Bugen ZhaoOpenAI CodexNick Hill
 		83c5d59209 [Rust Frontend] Replace external protoc with pure Rust lib protox (#52892) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-20 18:43:51 -07:00
Turner JabbourandClaude Sonnet 5 1eab6fef01 [CI] replace shellcheck script with shellcheck-py hook (#52572) 
Signed-off-by: Turner <doubleujabbour@gmail.com>
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-08-20 10:09:59 +00:00
jcotant-inferactClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		c205726108 [CI] Fix and extend PR/issue auto-labeling (#51459) 
Signed-off-by: Joe Cotant <joe@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-19 21:45:44 +00:00
Bugen ZhaoNick HillAndreas Karatzas
 		c89d692cb5 [Build] Propagate vLLM version to Rust binaries (#52593) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-17 23:37:37 -07:00
fxmarty-amdAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		c5b7c069a4 [ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-13 13:12:40 -05:00
Wentao Ye 9a276d6375 [Mypy Fix] Mypy fix for "vllm/model_executor/models/[cC][dD]" (#52003) 2026-08-13 11:33:55 +08:00
Yongye ZhuandKimi Code 025d56a11e [Build] Update DeepGEMM pin to deepseek-ai nv_dev tip (#52035) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
 2026-08-12 13:49:04 -07:00
Tyler Michael Smith 34735aceda [Bugfix] Pin DeepEP by its full commit hash (#52028) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-08-12 20:01:32 +00:00
Louie Tsai 9b3382685e [Tools] vLLM Recipes conversion : support different data types variants and strategies (#51878) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-08-12 01:42:08 +00:00
Louie Tsai 5b184f775a connects vLLM Recipes with vLLM's native config-based deployment and benchmark (#51308) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-08-11 13:53:51 +00:00