Vasiliy Kuznetsov 7b1a7423be [Frontend] new online quantization frontend (#38138) ...

Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>

2026-04-03 11:58:39 -04:00

..

anthropic

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

cli

[Misc] Move --grpc CLI argument into make_arg_parser (#38570)

2026-03-31 03:24:05 -07:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[Frontend] Re-enable running MaxSim on GPU (#38620)

2026-04-03 00:03:13 +08:00

pooling

[Frontend] Re-enable running MaxSim on GPU (#38620)

2026-04-03 00:03:13 +08:00

sagemaker

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

serve

[Frontend] feat: add streaming support for token generation endpoint (#37171)

2026-04-03 10:20:32 +00:00

__init__.py

…

api_server.py

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

2025-12-24 14:35:57 -08:00

chat_utils.py

[bugfix] do not add extra linebreak for score/rerank with chat template (#38617)

2026-04-01 04:50:07 +00:00

constants.py

…

grpc_server.py

[Bugfix] Preserve original ImportError in gRPC server entrypoint (#38673)

2026-04-01 22:16:44 +00:00

launcher.py

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666)

2026-03-13 12:10:06 -07:00

llm.py

[Frontend] new online quantization frontend (#38138)

2026-04-03 11:58:39 -04:00

logger.py

[Doc] Improve UX of --enable-log-requests (#35723)

2026-03-02 08:24:09 -08:00

ssl.py

…

utils.py

[ROCm][CI] Fix flaky Cohere/OpenAI embedding parity test (#37616)

2026-03-25 10:55:51 +00:00