[Doc] Add documentation for FP8 W8A8 (#5388)
This commit is contained in:
@@ -96,6 +96,7 @@ Documentation
|
||||
:caption: Quantization
|
||||
|
||||
quantization/auto_awq
|
||||
quantization/fp8
|
||||
quantization/fp8_e5m2_kvcache
|
||||
quantization/fp8_e4m3_kvcache
|
||||
|
||||
|
||||
Reference in New Issue
Block a user