[Bugfix][Frontend] Build tool-call grammars from the tools the prompt renders (#59879)
Signed-off-by: Rongjie Jiang <j1870831863@outlook.com> Signed-off-by: sfeng33 <4florafeng@gmail.com> Co-authored-by: Flora Feng <4florafeng@gmail.com>
This commit is contained in:
@@ -472,7 +472,7 @@ def _assemble_tag(
|
||||
return StructuralTag(format=SequenceFormat(elements=tags))
|
||||
|
||||
|
||||
@register_vllm_structural_tag("harmony")
|
||||
@register_vllm_structural_tag("harmony", builtin_tools=True)
|
||||
def get_harmony_structural_tag(
|
||||
tools: list[FunctionToolParam],
|
||||
builtin_tools: list[BuiltinToolParam],
|
||||
|
||||
Reference in New Issue
Block a user