Logo
Explore Help
Sign In
iHore/vLLM
Watch 8
Star 0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
f1599ca55d79cb686cb94dc3ff2f65d82db94940
vLLM/csrc/quantization/w8a8
T
History
Wentao Ye 541a2ef892 [Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2025-12-07 20:31:14 +08:00
..
cutlass
[Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242)
2025-11-25 06:59:07 -08:00
fp8
[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
2025-12-07 20:31:14 +08:00
int8
[Bugfix] Fix test fused quant layernorm tests (#27865)
2025-11-08 14:31:33 -08:00
per_token_group_quant_8bit.h
[Refactor] Refactor FP8 & INT8 Quant Folder inside w8a8 (#25293)
2025-10-08 10:20:48 -04:00
Powered by Gitea Version: 1.27.2 Page: 208ms Template: 6ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API