8 Commits

Include renames

Author	SHA1	Message	Date
Zhuohan Li	7076fa1c9f	TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622) ... Refactor the tensor parallelism, quantization, and weight-loading codes. Summary of the new features enabled by this PR: - **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580). - Model loading code became much simpler. - Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.	2023-11-15 22:50:41 -08:00
Zhuohan LiandYunmo Chen	9d9072a069	Implement prompt logprobs & Batched topk for computing logprobs (#1328) ... Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>	2023-10-16 10:56:50 -07:00
Zhuohan Li	ba0bfd40e2	TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181)	2023-10-02 15:36:09 -07:00
Zhuohan Li	90979c38f8	[FIX] Don't initialize parameter by default (#1067)	2023-09-17 17:15:38 -07:00
5 people	e3e79e9e8a	Implement AWQ quantization support for LLaMA (#1032) ... Co-authored-by: Robert Irvine <robert@seamlessml.com> Co-authored-by: root <rirv938@gmail.com> Co-authored-by: Casper <casperbh.96@gmail.com> Co-authored-by: julian-q <julianhquevedo@gmail.com>	2023-09-16 00:03:37 -07:00
Zhuohan Li	1b0bd0fe8a	Add Falcon support (new) (#592)	2023-08-02 14:04:39 -07:00
MoeedDar	2d867b55fa	fixed tensor parallel is not defined (#564)	2023-07-25 14:16:51 -07:00
Woosuk Kwon	0b98ba15c7	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00