This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
2e0d3143844303136c8aefa4c7e7bac30fd26850
vLLM
/
vllm
/
engine
T
History
Zhuohan Li
2e0d314384
fix-ray (
#193
)
2023-06-22 00:21:41 +08:00
..
__init__.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
arg_utils.py
Reduce GPU memory utilization to make sure OOM doesn't happen (
#153
)
2023-06-18 17:33:50 +08:00
async_llm_engine.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
llm_engine.py
fix-ray (
#193
)
2023-06-22 00:21:41 +08:00
ray_utils.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
tokenizer_utils.py
Use slow tokenizer for open llama models (
#168
)
2023-06-20 14:19:47 +08:00
