[Bugfix][V2] Warm up kernels before capturing CUDA graphs (#55341)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com> Signed-off-by: Nick Hill <nickhill123@gmail.com> Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com> Co-authored-by: Nick Hill <nickhill123@gmail.com>
This commit is contained in:
co-authored by
aoshen02
Nick Hill
parent
8f269a93bb
commit
685074cd61
@@ -67,7 +67,7 @@ class MMEncoderModelRunner(GPUModelRunner):
|
||||
def get_kv_cache_spec(self) -> dict[str, KVCacheSpec]:
|
||||
return {}
|
||||
|
||||
def capture_model(self) -> int:
|
||||
def capture_model(self, *, profile_only: bool = False) -> int:
|
||||
return 0
|
||||
|
||||
def _dummy_run(
|
||||
|
||||
Reference in New Issue
Block a user