[MRV2] Buffer util simplifications (#56888)

Signed-off-by: Nick Hill <nickhill123@gmail.com>
This commit is contained in:
Nick Hill
2026-09-15 20:36:51 +00:00
committed by GitHub
parent b6ce714354
commit f2aad6aa70
21 changed files with 125 additions and 112 deletions
-1
View File
@@ -255,7 +255,6 @@ class SpecDecodeBaseProposer:
self.backup_next_token_ids = CpuGpuBuffer(
self.max_batch_size,
dtype=torch.int32,
pin_memory=PIN_MEMORY,
device=device,
with_numpy=True,
)