3 people d486219fc2 [Bugfix][Core] Uncount stop-trimmed spec tokens from num_computed_tokens (#58668) ...

Signed-off-by: David Cheung <d7cheung@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-10-15 12:50:06 -07:00

..

__init__.py

[Feature] add session based streaming input support to v1 (#28973)

2026-01-24 12:06:28 -08:00

test_async_llm_streaming.py

[Bugfix] Terminate streaming sessions on ABORT/ERROR and prevent zombie sessions (#58942)

2026-10-15 13:32:19 +00:00

test_gpu_model_runner_streaming.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_gpu_model_runner_v2_streaming.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

test_scheduler_streaming.py

[Bugfix][Core] Uncount stop-trimmed spec tokens from num_computed_tokens (#58668)

2026-10-15 12:50:06 -07:00