2067297b2f
[ROCm][Perf] Use AITER tuned configs to select a4w4 gemm kernel instead of env var ( #61278 )
...
Signed-off-by: Andy Friedrich <afriedri@amd.com >
Signed-off-by: afriedri <afriedri@amd.com >
Co-authored-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com >
Co-authored-by: Kevin H. Luu <khluu000@gmail.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-10-17 04:00:28 -05:00
cc2e4fecf2
[ROCm] [fusion] support ROCm aiter fusion of per tensor quant + rmsnorm ( #52831 )
...
Signed-off-by: Andy Friedrich <afriedri@amd.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-16 15:19:07 -05:00
874a6b5a06
[ROCm] Refactor tuned gemms ( #55001 )
...
Signed-off-by: Andy Friedrich <afriedri@amd.com >
Signed-off-by: afriedri <afriedri@amd.com >
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com >
Co-authored-by: Shanshan Shen <467638484@qq.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-21 16:30:16 +00:00
afriedri
a9a7e45f31
[ROCm] Restore VLLM_ROCM_USE_AITER_FP4_ASM_GEMM and default w4a4 ASM GEMM back to off ( #57055 )
...
Signed-off-by: Andy Friedrich <afriedri@amd.com >
2026-09-17 13:39:52 -05:00
afriedri and Andreas Karatzas
dc9114b201
[ROCm][MoE] Split AITER CK and Triton MXFP4 W4A16 into separate backends ( #50622 )
...
Signed-off-by: afriedri <afriedri@amd.com >
Signed-off-by: Andy Friedrich <afriedri@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-08-31 23:14:14 -05:00
afriedri and Andreas Karatzas
2f1cba799e
[ROCm] remove VLLM_ROCM_USE_AITER_FP4_ASM_GEMM environment variable; make w4a4 use the preshuffle triton+asm by default ( #53141 )
...
Signed-off-by: Andy Friedrich <afriedri@amd.com >
Signed-off-by: afriedri <afriedri@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-08-28 18:59:53 +00:00
afriedri
98f86b9c02
[ROCm] [bugfix] Chunked prefill paged decode masked load perf ( #50017 )
...
Signed-off-by: Andy Friedrich <afriedri@amd.com >
2026-08-12 23:04:01 +00:00
afriedri
f472ab0a4c
Remove triton per group quant [ROCm] [Bugfix] ( #49621 )
...
Signed-off-by: Andy Friedrich <afriedri@amd.com >
2026-07-28 05:53:46 +00:00
