[Model] Support Unlimited OCR (#46564)

Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
This commit is contained in:
Tianyu Guo
2026-06-27 23:09:18 -07:00
committed by GitHub
co-authored by Isotr0py Roger Wang
parent a65f93fb2e
commit c6741b2ad4
35 changed files with 1084 additions and 49 deletions
+3
View File
@@ -96,6 +96,9 @@ class InputBatch:
# Whether any requests in batch use structured output.
has_structured_output_reqs: bool
# [num_reqs_after_padding] per-request prompt length for R-SWA (optional).
rswa_prefix_lens: torch.Tensor | None = None
@classmethod
def make_dummy(
cls,