Antoni Baum fb96c1e98c Asynchronous tokenization (#2879)

2024-03-15 23:37:01 +00:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Asynchronous tokenization (#2879)

2024-03-15 23:37:01 +00:00

async_llm_engine.py

Fixes the misuse/mixuse of time.time()/time.monotonic() (#3220)

2024-03-15 18:25:43 +00:00

llm_engine.py

Asynchronous tokenization (#2879)

2024-03-15 23:37:01 +00:00

metrics.py

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

ray_utils.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00