[Bugfix][MoE] Size the permute scratch from its inputs (#60447)

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
This commit is contained in:
Misha Goin
2026-10-08 15:32:07 -04:00
committed by GitHub
co-authored by Claude
parent fff10d2072
commit e3a29aa9b3
7 changed files with 128 additions and 191 deletions
+2 -1
View File
@@ -139,7 +139,8 @@ class WorkspaceManager:
AssertionError.
Keys must identify the resource type and configuration. Callers must not
resize or replace tensor storage held by a cached resource. Uses of the
resize or replace tensor storage held by a cached resource once the
manager is locked. Uses of the
same resource must not overlap; include the CUDA stream in the key when
streams can execute concurrently.