Commit Graph
9 Commits
Author SHA1 Message Date
e3e79e9e8a Implement AWQ quantization support for LLaMA (#1032)
Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>
2023-09-16 00:03:37 -07:00
ab019eea75 Add Model Revision Support (#1014)
Co-authored-by: Jasmond Loh <Jasmond.Loh@hotmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
2023-09-13 15:20:02 -07:00
Zhuohan Li c957c741d9 Enable safetensors loading for all models (#974) 2023-09-07 15:49:52 -07:00
JFDuan 0d93f15694 Accelerate LLaMA model loading (#234) 2023-08-30 01:00:13 -07:00
Xinyu Yang 73b3de79ea explicitly del state (#784) 2023-08-17 12:56:04 -07:00
Fazlul Shahriar 75beba29b5 Don't try to load training_args.bin (#373) 2023-07-08 15:26:28 -07:00
Zhuohan Li d6fa1be3a8 [Quality] Add code formatter and linter (#326) 2023-07-03 11:31:55 -07:00
Zhuohan Li 598dc4b79a [Fix] Weight loading for GPTBigCode (#313) 2023-06-29 22:14:17 -07:00
Woosuk Kwon 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00