[BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
This commit is contained in:
@@ -166,9 +166,7 @@ def _make_metadata_with_slice(
|
||||
assert start_locs[first_req] <= first_tok < start_locs[first_req + 1], (
|
||||
"Token slice start outside of first request"
|
||||
)
|
||||
assert start_locs[last_req] <= last_tok < start_locs[last_req + 1], (
|
||||
"Token slice end outside of last request"
|
||||
)
|
||||
# NOTE: last token can be outside of the last request if we have CG padding.
|
||||
|
||||
# If the "middle" request has tokens in both ubatches, we have to split it.
|
||||
# If ubatch_slice is the first ubatch then we will be splitting the last
|
||||
|
||||
Reference in New Issue
Block a user