[K3] support recoverssm for K3 (#51855)

Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
Jiangyun Zhu
2026-08-17 19:34:14 +08:00
committed by GitHub
co-authored by OpenAI Codex Benjamin Chislett mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent f27ae25473
commit 70afdedc10
19 changed files with 2235 additions and 75 deletions
+8 -2
View File
@@ -75,6 +75,12 @@ MambaStateShapes: TypeAlias = (
| tuple[tuple[int, int, int]]
| tuple[tuple[int, int], tuple[int, int]]
| tuple[tuple[int, int], tuple[int, int, int]]
| tuple[
tuple[int, int],
tuple[int, int, int],
tuple[int, int, int],
tuple[int, int, int],
]
)
@@ -1099,8 +1105,8 @@ def supports_mamba_prefix_caching(
@runtime_checkable
class SupportsReplaySSM(Protocol):
"""The interface for models whose Mamba2 layers support ReplaySSM cached
standard decode.
"""The interface for models whose recurrent layers support ReplaySSM
cached decode.
This is currently experimental.
"""