Logo
Explore Help
Sign In
iHore/vLLM
Watch 8
Star 0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
7379b3d4b2e0b85de43e7c5145ff26c8200aac8a
vLLM/vllm/model_executor/layers/quantization/utils
T
History
Tyler Michael Smith 5a9da2e6e9 [Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (#11311)
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
2024-12-19 02:43:30 +00:00
..
__init__.py
[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)
2024-09-23 13:46:26 -04:00
layer_utils.py
[Bugfix] Fix torch dynamo fixes caused by replace_parameters (#8748)
2024-09-24 14:33:21 -04:00
machete_utils.py
[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)
2024-09-23 13:46:26 -04:00
marlin_utils_fp8.py
[CI/Build] Avoid CUDA initialization (#8534)
2024-09-18 10:38:11 +00:00
marlin_utils_test_24.py
[Misc] Disambiguate quantized types via a new ScalarType (#6396)
2024-08-02 13:51:58 -07:00
marlin_utils_test_qqq.py
Support W4A8 quantization for vllm (#5218)
2024-07-31 07:55:21 -06:00
marlin_utils_test.py
[Misc] Fused MoE Marlin support for GPTQ (#8217)
2024-09-09 23:02:52 -04:00
marlin_utils.py
[Model][Quantization] HQQ support through Marlin kernel expansion (#9766)
2024-11-19 13:31:12 -08:00
quant_utils.py
[Kernel] Initial Machete W4A8 support + Refactors (#9855)
2024-11-18 12:59:29 -07:00
w8a8_utils.py
[Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (#11311)
2024-12-19 02:43:30 +00:00
Powered by Gitea Version: 1.27.2 Page: 163ms Template: 15ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API