Nick Hill 2dbe8c0774 [Perf] API-server scaleout with many-to-many server-engine comms (#17546)

2025-05-30 08:17:00 -07:00

..

cli

[Perf] API-server scaleout with many-to-many server-engine comms (#17546)

2025-05-30 08:17:00 -07:00

openai

[Perf] API-server scaleout with many-to-many server-engine comms (#17546)

2025-05-30 08:17:00 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Bugfix] Fix AttributeError: 'State' object has no attribute 'engine_client' (#17434)

2025-04-30 00:11:04 -07:00

chat_utils.py

[Bugfix]: correctly propagate errors message caught at the chat_templating step to the client (#18769)

2025-05-28 03:35:43 +00:00

launcher.py

[V1][Frontend] Improve Shutdown And Logs (#11737)

2025-04-16 19:48:34 -07:00

llm.py

[Deprecation] Disallow pos-args other than model when initializing LLM (#18802)

2025-05-29 09:36:58 -07:00

logger.py

Feature/vllm/input embedding completion api (#17590)

2025-05-18 20:18:05 -07:00

score_utils.py

Truncation control for embedding models (#14776)

2025-04-30 09:24:57 +08:00

ssl.py

Support SSL Key Rotation in HTTP Server (#13495)

2025-02-22 05:17:44 -08:00

utils.py

decrement server_load on listen for disconnect (#18784)

2025-05-28 22:15:12 +08:00