Runtime Draft Weight Update for Speculative Decoding (#46725)

Signed-off-by: vx120 <893600387@qq.com>
Signed-off-by: vx120 <57470515+vx120@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: crp0128 <191679376@qq.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
vx120
2026-07-11 22:51:53 -07:00
committed by GitHub
co-authored by crp0128 aoshen02 Claude Opus 4.8
parent 481e481be7
commit fc1c548093
12 changed files with 129 additions and 1 deletions
+4
View File
@@ -248,6 +248,10 @@ class EngineClient(ABC):
"""Start a new weight update."""
raise NotImplementedError
async def start_draft_weight_update(self) -> None:
"""Start a new weight update targeting the speculative draft model."""
raise NotImplementedError
async def update_weights(self, request: WeightTransferUpdateRequest) -> None:
"""Batched weight update for RL training."""
raise NotImplementedError