iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
20,845 Commits 3 Branches 0 Tags
78300cdabffbaaffe7625ed34412ec2aec75535c
Commit Graph
137 Commits
Author SHA1 Message Date
Kevin H. Luu c0ff33404b Revert compile-cache device index regression on CPU (#53304) 2026-08-21 16:08:13 -04:00
Frederik Gossen 47cd1c8885 [Core] Add dynamo_timed tracing for print_readable (#40834) 
Signed-off-by: Frederik Gossen <frgossen@meta.com>
 2026-08-21 09:07:21 -07:00
Neil SchemenauerandTyler Michael Smith 6dcc5d7cae [Bugfix] Include device index in compile cache paths (#38962) 
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-08-21 09:07:16 -07:00
nemanjaudovic 81e13a0591 [Compilation] Skip x.size(dim) in _decompose_size_nodes (#42543) 
Signed-off-by: nemanjaudovic <nudovic@amd.com>
 2026-07-15 17:59:14 -07:00
emricksini-handSimon Mo fec64fea75 [BugFix] Correct OTEL span start time for Dynamo compilation (#40698) 
Signed-off-by: emricksini-h <emrick.birivoutin@hcompany.ai>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2026-07-13 16:25:03 -07:00
Tyler Michael SmithandClaude Opus 4.6 e9de72fe6c [Bugfix] Guard model_config access in _log_compilation_config (#46198) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-06-20 19:26:38 +00:00
Lucas Kabela 213f10bfdd [Bugfix] Fix codegen for unqualified names (#40726) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-05-06 01:11:37 -07:00
Luka Govedič d58c42e19c [vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823) 
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2026-05-01 23:41:15 -04:00
Frederik Gossen a05848e255 [Bugfix] Report compile time for in-memory cache hit path (#41023) 
Signed-off-by: Frederik Gossen <frgossen@meta.com>
 2026-04-29 15:32:03 +00:00
Zhengxu Chen 98a242ff61 [compile] Skip FX graph deserialiaztion on loading, further reducing warm compile time. (#40151) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
 2026-04-23 13:43:18 +08:00
Lucas Kabela 0283f303d8 [BE] Fix compile time message to be consistent (use monitoring) (#40641) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-04-23 00:12:08 +00:00
Wentao Yeandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 8f87eb4622 [Refactor] Clean up log once scope="local" (#40540) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-22 16:42:43 -04:00
Zhengxu Chen 951dca8019 [compile] Invoke split FX graph by codegen. (#38657) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
 2026-04-15 21:03:41 -07:00
Lucas Kabela c08f3b2a62 Measure encoder compile time seperate from llm backbone (#39240) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-04-14 10:52:49 -04:00
Animesh Jain f00c5539d7 [compile] Bug fix for _decompose_size_nodes (#38360) 
Signed-off-by: Animesh Jain <anijain@umich.edu>
 2026-04-12 20:20:24 +00:00
Maral 2e9034c998 [W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892) 
Signed-off-by: maral <maralbahari.98@gmail.com>
Signed-off-by: Maral <maralbahari.98@gmail.com>
 2026-04-09 08:50:39 +08:00
Frederik GossenandBoyuan Feng d74a306c4b [Core] Use tuple_return in split_module for tuple-conformant subgraphs (#38752) 
Signed-off-by: Frederik Gossen <frgossen@meta.com>
Co-authored-by: Boyuan Feng <boyuan@meta.com>
 2026-04-08 09:09:58 -07:00
Angela Yi aceadb5ee1 Use lazy graph module during split_module to defer recompile() (#37609) 
Signed-off-by: angelayi <yiangela7@gmail.com>
 2026-03-23 11:21:29 -04:00
Simon Mo 1fa1e53a73 Revert "[compile] Initialize passes at VllmBackend init" (#37733) 2026-03-20 21:35:49 -07:00
Angela Yi 12fd17eb51 [compile] Initialize passes at VllmBackend init (#35216) 
Signed-off-by: angelayi <yiangela7@gmail.com>
 2026-03-20 11:40:33 -07:00
Xiao ea2c148fa7 [compile][graph_partition]Add tensor size handling (#36038) 
Signed-off-by: Xiao Fu <xiaofu@meta.com>
 2026-03-19 19:55:25 -07:00
Wentao Ye c373b5c00d [Log] Reduce duplicate log (#37313) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-03-18 10:57:44 -04:00
Jiangyun Zhu ca5fb4bbd8 [Bugfix] Avoid merging empty-only partitions into splitting-op subgraphs (#36595) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-03-10 07:39:01 -07:00
Copilotcopilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>ProExpertProgLuka Govedič
 		4b87ffbefb [torch.compile] Rename compile_ranges_split_points to compile_ranges_endpoints (#36027) 
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2026-03-09 18:04:40 +00:00
Jiangyun Zhu e5ff140216 [cudagraph] fix cudagraph warning in deepseekv32 (#28044) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-03-08 20:27:41 -04:00
PatchyTIS a6be75dbd2 [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) 2026-03-07 13:51:37 -08:00
Zhengxu Chen dd6dbd93f8 [compile] Fix extra cache save on warm start. (#35921) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
 2026-03-05 12:56:30 +08:00
Richard Zou 5569f5218d [torch.compile] Stop lazily compiling (#35472) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-03-04 12:13:17 -08:00
Zhengxu ChenandCyrus Leung f863994084 [compile] Fix torch.compile time discrepancy in logging. (#34912) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-20 08:47:14 -08:00
Manrique Vargas ad5aa6bd9f fix(docs): fix typos in comments and docstrings (#34836) 
Signed-off-by: machov <mv1742@nyu.edu>
 2026-02-18 23:17:41 -08:00
Richard Zou e30cedd44b [torch.compile] Stop doing unnecessary FakeTensorProp in PiecewiseCompileInterpreter (#34093) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-02-10 19:15:40 -08:00
Richard Zou 81fe69cae5 [torch.compile] Stop compiling identical artifacts (#34003) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-02-07 05:24:48 -08:00
Wentao Ye 67a746e87f [Log] Optimize duplicate startup log (#33944) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-02-06 17:49:56 +00:00
Luka Govedič ac32e66cf9 [torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731) 
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2026-02-06 04:19:49 -08:00
emricksini-h 325ab6b0a8 [Feature] OTEL tracing during loading (#31162) 2026-02-05 16:59:28 -08:00
Richard Zou 9f14c9224d Revert "[torch.compile] Significantly speed up cold start times" (#33820) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-02-04 21:59:59 +00:00
Richard Zou b1bb18de8d [torch.compile] Significantly speed up cold start times (#33641) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-02-03 09:12:11 -08:00
Luka GovedičandRichard Zou 15f40b20aa [fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441) 
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>
 2026-01-31 06:48:34 -08:00
Angela Yi 608b556507 [ez] Add structured torch.compile logs (#33213) 
Signed-off-by: angelayi <yiangela7@gmail.com>
 2026-01-31 21:00:54 +08:00
Angela Yi 4197168ea5 [ez] Remove checks for torch version <= 2.8 (#33209) 
Signed-off-by: angelayi <yiangela7@gmail.com>
 2026-01-28 16:03:56 -05:00
Lucas Kabela 15e302dfce [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-01-22 15:12:26 +00:00
dolpm 7c5dedc247 [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) 
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
 2026-01-20 19:45:59 +00:00
Richard Zou bd292be0c0 [BugFix] Python file source reading can fail on UnicodeDecodeError (#32416) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-01-15 20:01:41 +00:00
Kevin McKayClaude Opus 4.5Cyrus Leung
 		4dc0d606b7 [Bugfix] Narrow broad exceptions in compilation backends (#31616) 
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-01-09 21:39:22 -05:00
Lucas Kabela aaf4b70aae [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) 2026-01-09 18:30:38 -05:00
Lucas Kabela 873480d133 [Misc][BE] Type coverage for vllm/compilation [1/3] (#31554) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-01-06 20:37:51 -05:00
Nick Hill bd877162eb [BugFix] Support online dense model DP without overhead (#30739) 
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
 2026-01-02 23:36:38 +08:00
Lucas KabelaandCyrus Leung 0db5439ded [Bugfix][torch2.10] Fix test_qwen2_5_vl_compilation with 2.10 RC (#30822) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-18 08:23:31 -08:00
Ilya Markov 3224ea9915 [torch.compile] Add encoder tag for compilation (#30489) 
Signed-off-by: ilmarkov <markovilya197@gmail.com>
 2025-12-14 18:15:11 +08:00
Zhengxu Chen fe1787107e [compile] Parse compile range cache keys as Range during cache loading. (#30516) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
 2025-12-12 04:30:51 +00:00