This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
2a543d6efecc4e0fe391cbccb68d99ab42e37c33
vLLM
/
vllm
/
model_executor
/
layers
/
quantization
T
History
Rex
and
Chunan Zeng
563836496a
Refactor 2 awq gemm kernels into m16nXk32 (
#2723
)
...
Co-authored-by: Chunan Zeng <
chunanzeng@Chunans-Air.attlocal.net
>
2024-02-12 11:02:17 -08:00
..
__init__.py
Add GPTQ support (
#916
)
2023-12-15 03:04:22 -08:00
awq.py
Refactor 2 awq gemm kernels into m16nXk32 (
#2723
)
2024-02-12 11:02:17 -08:00
base_config.py
Add AWQ support for all models (
#1714
)
2023-11-18 17:56:47 -08:00
gptq.py
Remove hardcoded
device="cuda"
to support more devices (
#2503
)
2024-02-01 15:46:39 -08:00
squeezellm.py
Remove hardcoded
device="cuda"
to support more devices (
#2503
)
2024-02-01 15:46:39 -08:00