Add Medusa speculative decoding e2e test (#41396)

Signed-off-by: Anshika Ojha <anshikao@nvidia.com>
Signed-off-by: Rishi Puri <riship@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Anshika Ojha <215760622+ojhaanshika@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
This commit is contained in:
Rishi Puri
2026-06-30 18:02:22 +00:00
committed by GitHub
co-authored by Anshika Ojha Claude gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Stefano Castagnetta
parent 25671cb520
commit 727971f1c1
4 changed files with 85 additions and 3 deletions
+1 -1
View File
@@ -126,7 +126,7 @@ _CONFIG_REGISTRY: dict[str, type[PretrainedConfig]] = LazyConfigDict(
**{"unlimited-ocr": "UnlimitedOCRConfig"},
)
_SPECULATIVE_DECODING_CONFIGS: set[str] = {"eagle", "speculators"}
_SPECULATIVE_DECODING_CONFIGS: set[str] = {"eagle", "speculators", "medusa"}
_PATCH_HF_VALIDATE_ROPE: set[str] = {"sarvam_mla"}