Woosuk Kwon 6c5af09b39 [V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

..

__init__.py

[Core] [Frontend] Priority scheduling for embeddings and in the OpenAI-API (#8965)

2024-10-01 09:58:06 +00:00

client.py

[Frontend] Don't log duplicate error stacktrace for every request in the batch (#9023)

2024-10-21 14:49:41 -07:00

engine.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00