3 people fa312090cb [Frontend] Accept each connection on the least loaded API worker (#60723) ...

Signed-off-by: hao-aaron <aaronhao@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-09 04:40:13 +00:00

..

anthropic

[Bugfix][Frontend] Apply output_config and thinking in Anthropic count_tokens (#59180)

2026-10-08 00:24:20 +00:00

cli

[Bugfix] Load reasoning parser plugins before headless engine config (#53124)

2026-09-15 18:31:25 +08:00

cohere

[Bugfix][Frontend] Return 4xx for client errors in /cohere/v2/chat (#60309)

2026-10-07 04:55:34 +00:00

generate

[Frontend] Expose /v1/systemone without an opt-in flag (#60677)

2026-10-08 20:21:05 +00:00

launchers

[Frontend] Accept each connection on the least loaded API worker (#60723)

2026-10-09 04:40:13 +00:00

llm

[Structured Outputs] Parse Lark grammars natively in the xgrammar backend (#58321)

2026-09-25 04:35:10 +00:00

multimodal

[Frontend] Move offline_utils.py to entrypoints/common. (#58052)

2026-10-08 09:56:05 +00:00

openai

[Bugfix][Frontend] Keep streamed completion text_offset in step with tokens (#60668)

2026-10-08 21:20:43 -07:00

pooling

[Bugfix][Frontend] Do not modify caller params in LLM.score() (#59959)

2026-10-08 09:03:08 +08:00

rl

[Frontend] Consolidate rl entrypoints. (#57849)

2026-10-07 21:37:11 -07:00

scale_out

[CI][RL] Consolidate RL entrypoint tests under tests/entrypoints/rl (#59948)

2026-10-07 08:29:09 +00:00

serve

[CI][RL] Consolidate RL entrypoint tests under tests/entrypoints/rl (#59948)

2026-10-07 08:29:09 +00:00

speech_to_text

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

tool_parsers

[Feat][Mamba2] Enable internal prefill checkpoints (#57329)

2026-10-06 07:53:51 +00:00

unit_tests

[Frontend] Move offline_utils.py to entrypoints/common. (#58052)

2026-10-08 09:56:05 +00:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

[Refactor] Remove dead tests code (#58916)

2026-09-30 04:39:03 +00:00