Add Model Revision Support (#1014)

Co-authored-by: Jasmond Loh <Jasmond.Loh@hotmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
This commit is contained in:
Jasmond L
2023-09-13 15:20:02 -07:00
committed by GitHub
co-authored by Jasmond Loh Zhuohan Li
parent 9841d48a10
commit ab019eea75
20 changed files with 75 additions and 35 deletions
+2
View File
@@ -38,6 +38,8 @@ class LLM:
However, if the `torch_dtype` in the config is `float32`, we will
use `float16` instead.
seed: The seed to initialize the random number generator for sampling.
revision: The specific model version to use. It can be a branch name,
a tag name, or a commit id.
"""
def __init__(