This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
b7e62d3454afc807ddcc2fe3a56ce075461f1bc4
vLLM
/
vllm
/
engine
T
History
Zhuohan Li
bf5f121c02
Reduce GPU memory utilization to make sure OOM doesn't happen (
#153
)
2023-06-18 17:33:50 +08:00
..
__init__.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
arg_utils.py
Reduce GPU memory utilization to make sure OOM doesn't happen (
#153
)
2023-06-18 17:33:50 +08:00
async_llm_engine.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
llm_engine.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
ray_utils.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
tokenizer_utils.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
