Files
vLLM/vllm/model_executor
MOVZXandHinata e7cf27cc6f [Model] Fix runtime abliteration for Qwen3.5 models and Qwen3-Next MTP
Qwen3_5Model.__init__ skips Qwen3NextModel.__init__, so the abliteration
projector was never installed and embedding lookup raised AttributeError
when VLLM_ABLITERATION was set. Install it in Qwen3_5Model. Project the
MTP token embeddings of Qwen3NextMultiTokenPredictor too, matching the
abliterated releases, which edit the MTP embed_tokens rows.

Co-Authored-By: Hinata <hinata@idihore.id>
Signed-off-by: MOVZX <movzx@yahoo.com>
2026-10-14 08:12:14 +00:00
..
2026-10-09 17:41:13 +00:00
2026-10-09 17:41:13 +00:00