This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
4ffffccb7eca8a8911ab37b7e15e5d0210838ceb
vLLM
/
vllm
/
model_executor
/
layers
/
quantization
/
utils
T
History
Tyler Michael Smith
4ffffccb7e
[Kernel] Implement fallback for FP8 channelwise using torch._scaled_mm (
#6552
)
2024-07-18 23:52:22 +00:00
..
__init__.py
Add marlin unit tests and marlin benchmark script (
#4815
)
2024-05-16 09:36:49 -04:00
marlin_utils_fp8.py
[ Misc ] Refactor Marlin Python Utilities (
#6082
)
2024-07-11 15:40:11 +00:00
marlin_utils_test_24.py
[ Misc ] Refactor Marlin Python Utilities (
#6082
)
2024-07-11 15:40:11 +00:00
marlin_utils_test.py
[ Misc ] Refactor Marlin Python Utilities (
#6082
)
2024-07-11 15:40:11 +00:00
marlin_utils.py
[ Misc ] More Cleanup of Marlin (
#6359
)
2024-07-13 10:21:37 +00:00
quant_utils.py
Add marlin unit tests and marlin benchmark script (
#4815
)
2024-05-16 09:36:49 -04:00
w8a8_utils.py
[Kernel] Implement fallback for FP8 channelwise using torch._scaled_mm (
#6552
)
2024-07-18 23:52:22 +00:00
