[watermarking] Add DFlash support to dual-key gumbel-max watermarking (#59554)
Signed-off-by: Shern Shiou Tan <shernshiou@gmail.com> Signed-off-by: Simon Veitner <sveitner@redhat.com> Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: Simon Veitner <sveitner@redhat.com> Co-authored-by: Raphael Rialland <raphael.rialland@mistral.ai> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
This commit is contained in:
co-authored by
Claude Opus 5.5
Simon Veitner
Raphael Rialland
Lucas Wilkinson
parent
e711723352
commit
d92a4f25f2
@@ -125,8 +125,10 @@ generation.
|
||||
## Speculative decoding
|
||||
|
||||
Watermarking requires speculative decoding to use probabilistic draft sampling,
|
||||
standard rejection sampling, and an autoregressive model-based method (`dspark`,
|
||||
`eagle`, `eagle3`, or `mtp`). Parallel drafting is supported only by `dspark`.
|
||||
standard rejection sampling, and a model-based method (`dflash`, `dspark`,
|
||||
`eagle`, `eagle3`, or `mtp`). Parallel drafting is supported only by `dflash`
|
||||
and `dspark`. DFlash drafters with a candidate head (`DFlash2DraftModel`,
|
||||
`LiLiCorrDraftModel`) are not supported.
|
||||
|
||||
A watermarking algorithm without native speculative-decoding support is
|
||||
rejected before model loading. Set
|
||||
|
||||
Reference in New Issue
Block a user