Fix docs build warning (#34686)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
@@ -70,7 +70,6 @@ class PPHandler:
|
|||||||
|
|
||||||
Args:
|
Args:
|
||||||
num_reqs: Number of requests in the batch.
|
num_reqs: Number of requests in the batch.
|
||||||
device: Device to create tensors on.
|
|
||||||
max_sample_len: Maximum number of tokens sampled per request
|
max_sample_len: Maximum number of tokens sampled per request
|
||||||
(1 for regular decode, >1 for speculative decoding).
|
(1 for regular decode, >1 for speculative decoding).
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user