[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)
Signed-off-by: Matthew Kotila <7692737+matthewkotila@users.noreply.github.com> Co-authored-by: Reed Meyerson <31574681+reed-meyerson@users.noreply.github.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
co-authored by
Reed Meyerson
Claude Opus 4.8
parent
2f41c894e3
commit
7cfb97e337
@@ -19,6 +19,7 @@ vLLM supports a variety of methods of speculative decoding. Model-based methods
|
||||
- [Custom Proposer Backend (Experimental)](#custom-proposer-backend-experimental)
|
||||
- [Dynamic Speculative Decoding](dynamic_speculative_decoding.md)
|
||||
- [Adaptive Verification](adaptive_verification.md)
|
||||
- [Per-Request Acceptance Metrics](acceptance_metrics.md)
|
||||
|
||||
## Method Selection at a Glance
|
||||
|
||||
|
||||
Reference in New Issue
Block a user