[V1] guidance backend for structured output + auto fallback mode (#14779)

Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <jc1da.3011@gmail.com>
Co-authored-by: Michal Moskal <michal@moskal.me>
This commit is contained in:
Russell Bryant
2025-03-24 21:02:33 -07:00
committed by GitHub
co-authored by Loc Huynh Michal Moskal
parent 10b34e36b9
commit a09ad90a72
9 changed files with 344 additions and 110 deletions
+1 -1
View File
@@ -239,7 +239,7 @@ def choice_as_grammar(choice: list[str]) -> str:
return grammar
def validate_structured_output_request(
def validate_structured_output_request_xgrammar(
sampling_params: SamplingParams) -> None:
"""Validate that the request is supported by structured output.