From 443fa5aca0253fd6b27ae94bd4b232418612ac51 Mon Sep 17 00:00:00 2001 From: QWERQWERQWE86 Date: Thu, 13 Aug 2026 18:56:27 +0800 Subject: [PATCH] [Doc] Fix stale rejection_sample_method and synthetic_acceptance_rate (#51611) Signed-off-by: qwerqwerqwe8688-jpg --- docs/features/speculative_decoding/README.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/docs/features/speculative_decoding/README.md b/docs/features/speculative_decoding/README.md index 8f3ac9fa13..7858fff2d4 100644 --- a/docs/features/speculative_decoding/README.md +++ b/docs/features/speculative_decoding/README.md @@ -86,8 +86,9 @@ only apply to model-based methods such as `draft_model`, `mtp`, `eagle3`, and | `draft_tensor_parallel_size` | `integer >= 1` | `None` | Tensor parallel size for the draft model. | | `max_model_len` | `integer >= 1` | `None` | Maximum context length for the draft model. | | `parallel_drafting` | `boolean` | `false` | Enable parallel draft token generation. Only compatible with EAGLE and draft-model methods. | -| `rejection_sample_method` | `string` | `strict` | `strict`, `probabilistic`, or `synthetic`. | -| `synthetic_acceptance_rate` | `float` | `None` | Average acceptance rate to target when `rejection_sample_method` is `synthetic`. Valid range is `[0, 1]`. | +| `rejection_sample_method` | `string` | `standard` | `standard`, `synthetic`, or `block`. | +| `synthetic_acceptance_rates` | `list[float]` | `None` | Per-position unconditional acceptance rates for `synthetic` rejection sampling. Each entry in `[0, 1]`; length must equal `num_speculative_tokens`; must be non-increasing. | +| `synthetic_acceptance_length` | `float` | `None` | Target mean acceptance length for `synthetic`; in `[1, num_speculative_tokens + 1]`. Mutually exclusive with `synthetic_acceptance_rates`. | | `use_heterogeneous_vocab` | `boolean` | `false` | Allow draft and target models with different vocabularies. Builds a token-level intersection at initialisation and constrains draft logits to shared tokens only. Only compatible with `method=draft_model`. Probabilistic draft sampling (`draft_sample_method='probabilistic'`) is not yet supported when this option is enabled. | !!! note