[Platform] Replace torch.cuda.Event with torch.Event (#47140)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com> Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
co-authored by
Harry Mellor
parent
fcaa84efa7
commit
e840f0d3f5
@@ -17,7 +17,7 @@ from vllm.v1.worker.gpu.input_batch import InputBatch
|
||||
class PendingRecv:
|
||||
"""Per-step slot data for a deferred postprocess on the main stream."""
|
||||
|
||||
event: torch.cuda.Event
|
||||
event: torch.Event
|
||||
|
||||
sampled_tokens: torch.Tensor # [num_reqs, max_sample_len]
|
||||
num_sampled: torch.Tensor # [num_reqs]
|
||||
|
||||
Reference in New Issue
Block a user