iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Speculative Decoding] Propagate norm_output and fc_norm config for Eagle3 speculators (#46488)

Browse Source 
Signed-off-by: Orestis Zambounis <orestis.zambounis@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
Orestis Zambounis
2026-06-25 00:51:33 +00:00
committed by GitHub
co-authored by Claude Opus 4.6 mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent 23aed9b0ee
commit dda3aca47f
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
vllm/transformers_utils/configs/speculators/algos.py
+2
View File
@@ -36,6 +36,8 @@ def update_eagle3(config_dict: dict, pre_trained_config: dict) -> None:
"norm_before_residual", True
)
pre_trained_config["norm_before_fc"] = config_dict.get("norm_before_fc", False)
pre_trained_config["fc_norm"] = config_dict.get("fc_norm", False)
pre_trained_config["norm_output"] = config_dict.get("norm_output", False)
eagle3_arch_map = {
"qwen3": "Eagle3Qwen3ForCausalLM",
"llama": "Eagle3LlamaForCausalLM",