4 people 1a3a7a8f01 [Bugfix] Treat max_tokens as output upper bound, not input-space reservation (#57035) ...

Signed-off-by: YuvrajSinghBhadoria2 <245782664+YuvrajSinghBhadoria2@users.noreply.github.com>
Signed-off-by: YuvrajSinghBhadoria2 <yuvrajsinghbhado2030@gmail.com>
Signed-off-by: Yuvraj Singh Bhadoria <yuvrajsinghbhado2030@gmail.com>
Co-authored-by: YuvrajSinghBhadoria2 <245782664+YuvrajSinghBhadoria2@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-10-10 01:15:22 +08:00

..

__init__.py

[Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395)

2026-01-16 06:17:04 +00:00

io_processor.py

[Bugfix][Frontend] Preserve caller parameters in offline pooling (#58842)

2026-09-29 05:02:59 +00:00

protocol.py

[Bugfix] Treat max_tokens as output upper bound, not input-space reservation (#57035)

2026-10-10 01:15:22 +08:00

serving.py

[Bugfix][Pooling] Handle multimodal cache misses without crashing (#58975)

2026-10-02 10:14:33 -04:00