3 people 1463501553 [Bugfix] Terminate streaming sessions on ABORT/ERROR and prevent zombie sessions (#58942) ...

Signed-off-by: David Cheung <d7cheung@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Benedikt Falk <bfalk@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-10-15 13:32:19 +00:00

..

__init__.py

[Feature] add session based streaming input support to v1 (#28973)

2026-01-24 12:06:28 -08:00

test_async_llm_streaming.py

[Bugfix] Terminate streaming sessions on ABORT/ERROR and prevent zombie sessions (#58942)

2026-10-15 13:32:19 +00:00

test_gpu_model_runner_streaming.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_gpu_model_runner_v2_streaming.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

test_scheduler_streaming.py

[Bugfix][Core] Drop stale block hashes when a session truncates tokens (#59103)

2026-10-06 02:51:03 +00:00