Files
vLLM-4x-RTX-3090/patches/0075-recoverssm-read-the-GDN-RecoverSSM-flag-defensively-.patch
T
MOVZX 777e910dd0 Initial commit
Signed-off-by: MOVZX <movzx@yahoo.com>
2026-10-15 01:01:52 +07:00

29 lines
1.3 KiB
Diff

From 1954885e52446a5979dd514c004fe5d76bb5ed12 Mon Sep 17 00:00:00 2001
From: halt95 <halt95@users.noreply.github.com>
Date: Tue, 29 Sep 2026 18:40:22 -0700
Subject: [PATCH 075/103] recoverssm: read the GDN RecoverSSM flag defensively
in _forward_core (port of upstream #58863, c1d2da8773)
Port of the upstream vLLM change #58863 (Apache-2.0). One check read use_gdn_recoverssm directly; it now uses getattr with a False
default like its neighbours, so layers built without __init__ in tests work.
---
vllm/model_executor/layers/mamba/gdn/qwen_gdn_linear_attn.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/vllm/model_executor/layers/mamba/gdn/qwen_gdn_linear_attn.py b/vllm/model_executor/layers/mamba/gdn/qwen_gdn_linear_attn.py
index 2d6b675..80b1344 100644
--- a/vllm/model_executor/layers/mamba/gdn/qwen_gdn_linear_attn.py
+++ b/vllm/model_executor/layers/mamba/gdn/qwen_gdn_linear_attn.py
@@ -1470,7 +1470,7 @@ class QwenGatedDeltaNetAttention(GatedDeltaNetAttention):
if (
spec_sequence_masks is not None
and mixed_qkv_spec is not None
- and self.use_gdn_recoverssm
+ and getattr(self, "use_gdn_recoverssm", False)
):
query_spec, key_spec, value_spec, verify_views = (
self._recoverssm_verify_qkv(mixed_qkv_spec)
--
2.43.0