[Realtime] Add Qwen3-ASR realtime streaming support (#34613)

Signed-off-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
This commit is contained in:
pougetat
2026-02-20 19:59:42 -08:00
committed by GitHub
co-authored by Thomas Pouget-Abadie Claude Opus 4.6 Nicolò Lucchesi
parent 7a5adad480
commit 11be2c74dc
5 changed files with 256 additions and 1 deletions
@@ -205,7 +205,7 @@ class RealtimeConnection:
sampling_params = SamplingParams.from_optional(
temperature=0.0,
max_tokens=1,
max_tokens=self.serving.model_cls.realtime_max_tokens,
output_kind=RequestOutputKind.DELTA,
skip_clone=True,
)