3 people 1bc6e072b0 [Rust Frontend] Add per-request timing metrics to chat and completions (#59314) ...

Signed-off-by: wxin <wxin@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-12 15:39:10 -07:00

..

anthropic

[Bugfix][Frontend] Apply output_config and thinking in Anthropic count_tokens (#59180)

2026-10-08 00:24:20 +00:00

cli

[Bugfix] Load reasoning parser plugins before headless engine config (#53124)

2026-09-15 18:31:25 +08:00

cohere

[Bugfix][Frontend] Return 4xx for client errors in /cohere/v2/chat (#60309)

2026-10-07 04:55:34 +00:00

generate

[Frontend] Serve LiquidAI/d1-3B on /v1/systemone (#60676)

2026-10-12 13:00:47 -04:00

launchers

[Security] Restrict default CORS origins (#61009)

2026-10-11 08:26:02 +00:00

llm

[Bugfix][Frontend] Support scalar priority and wire priority into LLM.chat() (#57243)

2026-10-11 10:03:33 +00:00

multimodal

[Bugfix] Respect the configured offline chat template (#61061)

2026-10-11 16:27:21 +00:00

openai

[Rust Frontend] Add per-request timing metrics to chat and completions (#59314)

2026-10-12 15:39:10 -07:00

pooling

[Misc] mv chat_utils.py to renderers. (#60522)

2026-10-10 06:50:34 +00:00

rl

[RL] Release weight-transfer communicators without stopping inference (#61060)

2026-10-11 21:15:14 +08:00

scale_out

[Bugfix][Rust Frontend] Omit unset sampling params in render output (#61220)

2026-10-12 19:31:03 +00:00

serve

[Metrics] Add admission rejection metrics (#55812)

2026-10-12 08:31:07 +00:00

speech_to_text

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

tool_parsers

[Feat][Mamba2] Enable internal prefill checkpoints (#57329)

2026-10-06 07:53:51 +00:00

unit_tests

[Bugfix][Frontend] Support scalar priority and wire priority into LLM.chat() (#57243)

2026-10-11 10:03:33 +00:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

[Refactor] Remove dead tests code (#58916)

2026-09-30 04:39:03 +00:00