iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
2acd76f346efcdff4f6ca1d92fe1575c448e4b70
vLLM/vllm/model_executor/models
T
History
CHU Tianxiang 0fbfc4b81b Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
..
__init__.py
Optimize Mixtral with expert parallelism (#2090)
2023-12-13 23:55:07 -08:00
aquila.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
baichuan.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
bloom.py
Refactor Worker & InputMetadata (#1843)
2023-11-29 22:16:37 -08:00
chatglm.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
falcon.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
gpt2.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
gpt_bigcode.py
Refactor Worker & InputMetadata (#1843)
2023-11-29 22:16:37 -08:00
gpt_j.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
gpt_neox.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
internlm.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
llama.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
mistral.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
mixtral.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
mpt.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
opt.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
phi_1_5.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
qwen.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00
yi.py
Add GPTQ support (#916)
2023-12-15 03:04:22 -08:00