Support OpenAI API server in benchmark_serving.py (#2172)

This commit is contained in:
Harry Mellor
2024-01-18 20:34:08 -08:00
committed by GitHub
parent dd7e8f5f64
commit 2709c0009a
2 changed files with 51 additions and 32 deletions
+3
View File
@@ -181,3 +181,6 @@ _build/
# hip files generated by PyTorch
*.hip
*_hip*
# Benchmark dataset
*.json