[Refactor] Rename WAITING_FOR_FSM to WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR (#38048)

Signed-off-by: yewentao256 <zhyanwentao@126.com>
This commit is contained in:
Wentao Ye
2026-03-25 11:41:44 -04:00
committed by GitHub
parent e7221180e1
commit 1bf2ddd0ee
5 changed files with 34 additions and 25 deletions
+2 -1
View File
@@ -42,7 +42,8 @@ class StructuredOutputManager:
# When in external_launcher mode, async grammar compilation causes deadlocks
# due to external_launcher mode having a scheduler for each TP rank.
# Async grammar compilation causes the WAITING_FOR_FSM → WAITING transition to
# Async grammar compilation causes the
# WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR → WAITING transition to
# happen at different times on different TP ranks,
# breaking the determinism assumption that external_launcher relies on.
self._use_async_grammar_compilation = (