This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
6ffa3f314c59e42238f1c5f923ff2839e0af9698
vLLM
/
vllm
/
model_executor
/
layers
/
quantization
/
utils
T
History
Cyrus Leung
6ffa3f314c
[CI/Build] Avoid CUDA initialization (
#8534
)
2024-09-18 10:38:11 +00:00
..
__init__.py
Add marlin unit tests and marlin benchmark script (
#4815
)
2024-05-16 09:36:49 -04:00
marlin_utils_fp8.py
[CI/Build] Avoid CUDA initialization (
#8534
)
2024-09-18 10:38:11 +00:00
marlin_utils_test_24.py
[Misc] Disambiguate quantized types via a new ScalarType (
#6396
)
2024-08-02 13:51:58 -07:00
marlin_utils_test_qqq.py
Support W4A8 quantization for vllm (
#5218
)
2024-07-31 07:55:21 -06:00
marlin_utils_test.py
[Misc] Fused MoE Marlin support for GPTQ (
#8217
)
2024-09-09 23:02:52 -04:00
marlin_utils.py
[CI/Build] Avoid CUDA initialization (
#8534
)
2024-09-18 10:38:11 +00:00
quant_utils.py
[Misc] Fused MoE Marlin support for GPTQ (
#8217
)
2024-09-09 23:02:52 -04:00
w8a8_utils.py
[CI/Build] Avoid CUDA initialization (
#8534
)
2024-09-18 10:38:11 +00:00
