Amy (Yu-Hsuan) Lin 923949e6e3 [Feat] Add request-level preemption count histogram metric (#49984)

2026-08-31 23:04:54 -04:00

..

dev

[ROCm][CI] Warm up the RLHF dev server before the pause/resume timing checks (#53594)

2026-08-28 09:07:04 +00:00

exception_handling

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

instrumentator

[Feat] Add request-level preemption count histogram metric (#49984)

2026-08-31 23:04:54 -04:00

lora

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

middleware

[Frontend] Consolidate entrypoint middleware (#52309)

2026-08-17 06:17:15 +00:00

sagemaker

Make bare hugging_face imports forbidden (#49726)

2026-07-25 04:18:39 -07:00

tokenize

[Bugfix] Return 4xx for client-caused errors in /detokenize (#52622)

2026-08-18 07:07:15 +00:00

utils

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

__init__.py

[Refactor] Relocate endpoint tests to mirror serving code directory structure (#37504)

2026-03-19 07:19:36 +00:00