docs: note that enforce_eager also disables torch.compile (#55271)
Signed-off-by: Anshul Desai <36732940+AnshulDesai@users.noreply.github.com>
This commit is contained in:
@@ -242,7 +242,10 @@ class ModelConfig:
|
||||
"""Whether to always use eager-mode PyTorch. If True, we will disable CUDA
|
||||
graph and always execute the model in eager mode. If False, we will use
|
||||
CUDA graph and eager execution in hybrid for maximal performance and
|
||||
flexibility."""
|
||||
flexibility.
|
||||
|
||||
NOTE: This disables both `torch.compile` and CUDA graphs, and is
|
||||
equivalent to setting `-cc.mode=none -cc.cudagraph_mode=none`."""
|
||||
enable_return_routed_experts: bool = False
|
||||
"""Whether to return routed experts."""
|
||||
return_sampling_mask: bool = False
|
||||
|
||||
Reference in New Issue
Block a user