This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
2eb9f4ff262bb39859baebf8d2109abcdadee860
vLLM
/
vllm
/
model_executor
/
layers
/
quantization
/
utils
T
History
Robert Shaw
and
mgoin
889da130e7
[ Misc ]
fp8-marlin
channelwise via
compressed-tensors
(
#6524
)
...
Co-authored-by: mgoin <
michael@neuralmagic.com
>
2024-07-25 09:46:04 -07:00
..
__init__.py
Add marlin unit tests and marlin benchmark script (
#4815
)
2024-05-16 09:36:49 -04:00
marlin_utils_fp8.py
[ Misc ]
fp8-marlin
channelwise via
compressed-tensors
(
#6524
)
2024-07-25 09:46:04 -07:00
marlin_utils_test_24.py
[ Misc ] Refactor Marlin Python Utilities (
#6082
)
2024-07-11 15:40:11 +00:00
marlin_utils_test.py
[Kernel][Core] Add AWQ support to the Marlin kernel (
#6612
)
2024-07-21 19:41:42 -04:00
marlin_utils.py
[Kernel][Core] Add AWQ support to the Marlin kernel (
#6612
)
2024-07-21 19:41:42 -04:00
quant_utils.py
[Misc] Add ignored layers for
fp8
quantization (
#6657
)
2024-07-23 14:04:04 -04:00
w8a8_utils.py
[Misc] Fix input_scale typing in w8a8_utils.py (
#6579
)
2024-07-20 23:11:13 +00:00