Specify python package dependencies in requirements.txt (#78)

This commit is contained in:
Woosuk Kwon
2023-05-07 16:30:43 -07:00
committed by GitHub
parent c84e924287
commit 7addca5935
3 changed files with 57 additions and 36 deletions
+3 -8
View File
@@ -1,10 +1,10 @@
# CacheFlow
## Installation
## Build from source
```bash
pip install ninja psutil numpy sentencepiece ray torch transformers xformers
pip install -e .
pip install -r requirements.txt
pip install -e . # This may take several minutes.
```
## Test simple server
@@ -21,11 +21,6 @@ python simple_server.py --help
## FastAPI server
Install the following additional dependencies:
```bash
pip install fastapi uvicorn
```
To start the server:
```bash
ray start --head