[Bugfix][MoE] Snapshot max_cudagraph_capture_size into FusedMoEConfig (#44613)

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
aoshen02
2026-06-05 23:14:41 -07:00
committed by GitHub
co-authored by Claude Opus 4.8
parent eafbb06331
commit f87df1df9e
5 changed files with 7 additions and 16 deletions
@@ -326,6 +326,7 @@ class FusedMoE(PluggableLayer):
moe_backend=vllm_config.kernel_config.moe_backend,
router_logits_dtype=router_logits_dtype,
max_num_tokens=max_num_batched_tokens,
max_capture_size=compilation_config.max_cudagraph_capture_size,
has_bias=has_bias,
is_act_and_mul=is_act_and_mul,
is_lora_enabled=vllm_config.lora_config is not None,