Sebastian Schoennenbeck f8e7adda21 Fix/async chat serving (#2727)

2024-05-03 11:04:14 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[BugFix] Prevent the task of _force_log from being garbage collected (#4567)

2024-05-03 01:35:18 +00:00

cli_args.py

[Bugfix] Allow "None" or "" to be passed to CLI for string args that default to None (#4586)

2024-05-03 10:32:21 -07:00

protocol.py

[Bugfix] Add validation for seed (#4529)

2024-05-01 19:31:22 +00:00

serving_chat.py

Fix/async chat serving (#2727)

2024-05-03 11:04:14 -07:00

serving_completion.py

[Bugfix][Core] Fix get decoding config from ray (#4335)

2024-04-27 11:30:08 +00:00

serving_engine.py

Fix/async chat serving (#2727)

2024-05-03 11:04:14 -07:00