[Doc] Add documentation for FP8 W8A8 (#5388)

This commit is contained in:
Michael Goin
2024-06-10 18:55:12 -06:00
committed by GitHub
parent 114332b88e
commit 77c87beb06
2 changed files with 203 additions and 0 deletions
+1
View File
@@ -96,6 +96,7 @@ Documentation
:caption: Quantization
quantization/auto_awq
quantization/fp8
quantization/fp8_e5m2_kvcache
quantization/fp8_e4m3_kvcache