[Refactor] Rename WAITING_FOR_FSM to WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR (#38048)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
This commit is contained in:
@@ -42,7 +42,8 @@ class StructuredOutputManager:
|
||||
|
||||
# When in external_launcher mode, async grammar compilation causes deadlocks
|
||||
# due to external_launcher mode having a scheduler for each TP rank.
|
||||
# Async grammar compilation causes the WAITING_FOR_FSM → WAITING transition to
|
||||
# Async grammar compilation causes the
|
||||
# WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR → WAITING transition to
|
||||
# happen at different times on different TP ranks,
|
||||
# breaking the determinism assumption that external_launcher relies on.
|
||||
self._use_async_grammar_compilation = (
|
||||
|
||||
Reference in New Issue
Block a user