7 people 02e55d2af3 [KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169) ...

Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

2026-10-09 15:48:37 -04:00

..

__init__.py

[Feature] add session based streaming input support to v1 (#28973)

2026-01-24 12:06:28 -08:00

test_async_llm_streaming.py

[Bugfix][Frontend] Avoid generation for empty streaming input (#59015)

2026-10-02 18:48:43 +00:00

test_gpu_model_runner_streaming.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_gpu_model_runner_v2_streaming.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_scheduler_streaming.py

[Bugfix][Core] Drop stale block hashes when a session truncates tokens (#59103)

2026-10-06 02:51:03 +00:00