docs: note that enforce_eager also disables torch.compile (#55271)

Signed-off-by: Anshul Desai <36732940+AnshulDesai@users.noreply.github.com>
This commit is contained in:
Anshul Desai
2026-09-03 21:25:30 -07:00
committed by GitHub
parent 78300cdabf
commit da55494a12
+4 -1
View File
@@ -242,7 +242,10 @@ class ModelConfig:
"""Whether to always use eager-mode PyTorch. If True, we will disable CUDA
graph and always execute the model in eager mode. If False, we will use
CUDA graph and eager execution in hybrid for maximal performance and
flexibility."""
flexibility.
NOTE: This disables both `torch.compile` and CUDA graphs, and is
equivalent to setting `-cc.mode=none -cc.cudagraph_mode=none`."""
enable_return_routed_experts: bool = False
"""Whether to return routed experts."""
return_sampling_mask: bool = False