Cade Daniel 93deb0b38f [Speculative decoding 4/9] Lookahead scheduling for speculative decoding (#3250)

2024-04-01 22:55:24 +00:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Speculative decoding 4/9] Lookahead scheduling for speculative decoding (#3250)

2024-04-01 22:55:24 +00:00

async_llm_engine.py

Usage Stats Collection (#2852)

2024-03-28 22:16:12 -07:00

llm_engine.py

[BugFix] Fix tokenizer out of vocab size (#3685)

2024-03-29 08:18:59 -07:00

metrics.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

ray_utils.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00