[CPU][s390x] Optimize inference perf and add oneDNN INT8 GEMM for s390x (#50219)

Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
This commit is contained in:
Rehan Khan
2026-07-31 17:49:31 +08:00
committed by GitHub
co-authored by Li, Jiang <jiang1.li@intel.com>
parent 482cfc20f0
commit 88bc8fb56f
6 changed files with 182 additions and 27 deletions
+1 -1
View File
@@ -315,7 +315,7 @@ vLLM CPU supports data parallel (DP), tensor parallel (TP) and pipeline parallel
- vLLM CPU supports quantizations:
- AWQ (x86 only)
- GPTQ (x86 only)
- compressed-tensor INT8 W8A8 (x86 only)
- compressed-tensor INT8 W8A8 (x86, s390x only)
### Why do I see `get_mempolicy: Operation not permitted` when running in Docker?