[Bugfix][V2] Warm up kernels before capturing CUDA graphs (#55341)

Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
This commit is contained in:
aoshen02
2026-09-04 22:44:18 +00:00
committed by GitHub
co-authored by aoshen02 Nick Hill
parent 8f269a93bb
commit 685074cd61
7 changed files with 129 additions and 16 deletions
+1 -1
View File
@@ -67,7 +67,7 @@ class MMEncoderModelRunner(GPUModelRunner):
def get_kv_cache_spec(self) -> dict[str, KVCacheSpec]:
return {}
def capture_model(self) -> int:
def capture_model(self, *, profile_only: bool = False) -> int:
return 0
def _dummy_run(