This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
40468b13faa1ebde366e7002c5752b59e1368d10
vLLM
/
vllm
/
model_executor
/
layers
/
quantization
/
utils
T
History
Michael Goin
0eb0757bef
[Misc] Add ignored layers for
fp8
quantization (
#6657
)
2024-07-23 14:04:04 -04:00
..
__init__.py
Add marlin unit tests and marlin benchmark script (
#4815
)
2024-05-16 09:36:49 -04:00
marlin_utils_fp8.py
[ Bugfix ] Fix AutoFP8 fp8 marlin (
#6609
)
2024-07-20 17:25:56 -06:00
marlin_utils_test_24.py
[ Misc ] Refactor Marlin Python Utilities (
#6082
)
2024-07-11 15:40:11 +00:00
marlin_utils_test.py
[Kernel][Core] Add AWQ support to the Marlin kernel (
#6612
)
2024-07-21 19:41:42 -04:00
marlin_utils.py
[Kernel][Core] Add AWQ support to the Marlin kernel (
#6612
)
2024-07-21 19:41:42 -04:00
quant_utils.py
[Misc] Add ignored layers for
fp8
quantization (
#6657
)
2024-07-23 14:04:04 -04:00
w8a8_utils.py
[Misc] Fix input_scale typing in w8a8_utils.py (
#6579
)
2024-07-20 23:11:13 +00:00