[ROCm][CI] Add the MI355 TurboQuant t3nc mirror (#58432)

Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
This commit is contained in:
Andreas Karatzas
2026-09-24 02:16:09 -05:00
committed by GitHub
co-authored by OpenAI Codex
parent 67ddac3ea8
commit c3f5270270
4 changed files with 62 additions and 0 deletions
@@ -0,0 +1,6 @@
model_name: "Qwen/Qwen3-4B"
accuracy_threshold: 0.75
num_questions: 1319
num_fewshot: 5
# Triton serves the unquantized boundary layers with TurboQuant-compatible layout.
server_args: "--kv-cache-dtype turboquant_3bit_nc --max-model-len 4096 --attention-backend TRITON_ATTN"
@@ -0,0 +1 @@
Qwen3-4B-TQ-t3nc-ROCm.yaml