[MM][CG] Enable encoder Cudagraph for Step3VL (#42224)

Signed-off-by: JisoLya <523420504@qq.com>
Signed-off-by: Soyaazz <523420504@qq.com>
This commit is contained in:
Soyaazz
2026-05-17 20:19:13 -07:00
committed by GitHub
parent 107210442d
commit 990f49bdcb
8 changed files with 384 additions and 22 deletions
+1
View File
@@ -500,6 +500,7 @@ class StepVLForConditionalGeneration(Step3VLForConditionalGeneration):
quant_config = vllm_config.quant_config
self.config = config
self.model_config = vllm_config.model_config
self.multimodal_config = multimodal_config
self.use_data_parallel = multimodal_config.mm_encoder_tp_mode == "data"