[PLE] The pull wait/copy op is a graph splitting op

With the wait/copy inside a compiled piece, Inductor's post-grad
auto-functionalization decomposition failed on the stage-0 ranks.

Co-Authored-By: Hinata <hinata@idihore.id>
Signed-off-by: MOVZX <movzx@yahoo.com>
This commit is contained in:
2026-10-09 19:55:22 +07:00
co-authored by Hinata
parent 2e68aba2a7
commit 6705330924
2 changed files with 7 additions and 0 deletions
+6
View File
@@ -775,6 +775,12 @@ class CompilationConfig:
"vllm::qwen4_exp_ple_finalize_prefetch",
"vllm::qwen4_exp_ple_short_conv",
"vllm::qwen4_exp_qsa_with_output",
# Fork (pull transport with the compile-profile guard, found on the reference host): the PLE pull transport's wait+DMA
# mutates a module-owned buffer; inside an Inductor graph it failed
# post-grad with "auto_functionalized was not removed" on the stage-0
# ranks. As a split point it runs between pieces, like attention.
"vllm::ple_offload_wait_copy",
"vllm::ple_offload_wait",
"vllm::linear_attention",
"vllm::qwen_gdn_attention_core",
"vllm::qwen_gdn_attention_core_fused_norm_packed",
+1
View File
@@ -61,6 +61,7 @@ REQUIRED_SPLITTING_OPS = (
"vllm::qwen4_exp_ple_finalize_prefetch",
"vllm::qwen_gdn_attention_core",
"vllm::qwen_gdn_attention_core_fused_norm_packed",
"vllm::ple_offload_wait_copy",
)
#: Upstream v0.30.0 auto-enabled breakable cudagraphs for these; this tree