3 people 703e42ee4b Add guided decoding for OpenAI API server (#2819) ...

Co-authored-by: br3no <breno@veltefaria.de>
Co-authored-by: simon-mo <simon.mo@hey.com>

2024-02-29 22:13:08 +00:00

..

openai

Add guided decoding for OpenAI API server (#2819)

2024-02-29 22:13:08 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

Add warning to prevent changes to benchmark api server (#2858)

2024-02-18 21:36:19 -08:00

llm.py

set&get llm internal tokenizer instead of the TokenizerGroup (#2741)

2024-02-04 14:25:36 -08:00