 Simon Danielsson
|
3f729dafcc
|
[Perf][ROCm][GLM-5.3-Flash] AITER prefill indexer topk (#60753)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-10-14 13:48:56 -05:00 |
|
|
Simon DanielssonandDouglas Lehr
|
87d9996abe
|
[ROCm][Perf][GLM-5.3-Flash] BF16 splitk kernel for sparse MLA decode (#58584)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-10-07 21:37:51 -05:00 |
|
|
Simon Danielsson
|
947dd62c07
|
[CI] Fix failing test_deepseek_v4_rocm_dspark* tests (#60462)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-10-07 14:18:19 -07:00 |
|
|
Simon Danielssonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
98b29aa99a
|
[ROCm][Perf][GLM-5.3-Flash] Add AITER topk backend for decodes (#58167)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-02 11:47:41 +01:00 |
|
|
Simon Danielssonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
751fa96a49
|
[ROCm][Perf][GLM-5.3-Flash] Remove redundant copy after ragged sparse MLA (#58569)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-02 11:45:51 +01:00 |
|
|
Simon Danielssonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2df122e65e
|
[ROCm][Perf][GLM-5.3-Flash] "Fit kpool top-k indices to AITER" with a single Triton kernel (#58008)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-30 09:45:00 -05:00 |
|
|
Simon Danielsson
|
3627a6a124
|
[ROCm][Perf][GLM-5.3-Flash] Stride-aware decode KDA (#57979)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-30 08:16:29 +00:00 |
|
|
Simon Danielsson
|
b5ea0c7107
|
[Bugfix][ROCm] Fix startup OOM in AITER MLA FP8 prefill workspace sizing (#57923)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-23 11:44:12 -05:00 |
|
|
Simon Danielsson
|
70df48dc3d
|
[Bugfix][KV Cache][GLM-5.3-Flash] Disable slot mapping kernel for the kpool tail buffer (#57317)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-17 22:42:54 -04:00 |
|
|
Simon Danielsson
|
667b26e50b
|
[Bugfix][ROCm][GLM-5.3-Flash] Apply deferred tilelang.jit already on attribute access (#57192)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-17 12:02:39 +00:00 |
|
|
Simon Danielsson
|
1d0d1081c4
|
[ROCm][Connector] SWA+HMA-support in MoRI-IO connector (Gemma4) (#53721)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-14 20:52:56 +08:00 |
|
|
Simon Danielsson
|
ae48466cf3
|
[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-11 13:19:57 +08:00 |
|
|
|
8359e15aae
|
[ROCm][Feature] Support KV connectors with ROCM_AITER_UNIFIED_ATTN (#53695)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Signed-off-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-10 12:48:42 -05:00 |
|
|
Simon Danielsson
|
7470082f57
|
[ROCm][Perf] Add bpreshuffled blockscaled fp8 GEMM (#51692)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-10 16:18:37 +00:00 |
|
|
|
b205750fe0
|
[Bugfix][ROCm][Build] fix profiler hang due to queue interposition bug (#54171)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-02 08:59:23 +00:00 |
|
|
|
2c7d7dd64a
|
[Perf][ROCm] Dual-stream decode with hipgraphs (#52033)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-08-30 08:24:20 +00:00 |
|
|
Simon DanielssonandAndreas Karatzas
|
3d204dfdaa
|
Revert "[Perf][ROCm] Dual-stream decode with hipgraphs" (#52024)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-13 04:38:34 +00:00 |
|
|
Simon Danielsson
|
47ececb58e
|
[Perf][ROCm] Dual-stream decode with hipgraphs (#48223)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-08-12 09:32:24 +08:00 |
|
|
Simon Danielssonandnnyrhila
|
482e5524fe
|
[Bugfix][ROCm] Fix memory access fault in AITER MLA backend for DPA+FP8 KV (#47276)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: nnyrhila <niko.nyrhila@amd.com>
|
2026-07-06 21:30:02 +00:00 |
|
|
Simon Danielsson
|
b7fb747d8d
|
[CI][ROCm] Don't skip MoRI-IO Connector tests (#43703)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-05-29 17:06:23 +08:00 |
|
|
Simon Danielsson
|
552eb81918
|
[Bugfix][ROCm] Resolve MoRI connector hangs at high concurrency (#40344)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-05-28 14:30:21 +00:00 |
|
|
Simon Danielssonandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
d565357a90
|
[Docs][ROCm] MoRI-IO Connector Usage Guide (#43603)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Signed-off-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-05-26 21:52:30 +08:00 |
|
|
Simon DanielssonandTJian
|
681d7dd38b
|
[Misc][Refactor][ROCm] Convert MoRI-related envvars to extra config args (#43303)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-05-26 03:33:35 -07:00 |
|
|
Simon Danielsson
|
86ccef7d44
|
[ROCm] Add XGMI backend for MoRI Connector (#41753)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-05-22 03:06:40 +00:00 |
|
|
Simon Danielsson
|
f9b9bf3bbb
|
[CI][ROCm] Ship RIXL with vllm/vllm-openai-rocm (#41634)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-05-08 07:05:17 +00:00 |
|
|
Simon DanielssonandMatvei Pashkovskii
|
ac58e2a170
|
[Fix][MoRI] Align MoRI-IO message format with P2pNcclConnector and vllm-router (#39565)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com>
|
2026-04-23 08:06:31 +09:00 |
|
|
Simon Danielsson
|
4292c90a2a
|
[Bugfix] Support RotaryEmbedding CustomOp for gpt-oss (#33800)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-02-04 20:17:41 +00:00 |
|
|
Simon DanielssonandHarry Mellor
|
92be3f3517
|
[Feature] Use pydantic validation in parallel.py config (#26417)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-10-09 12:41:31 +00:00 |
|
|
Simon Danielsson
|
e4791438ed
|
[Feature] Use pydantic validation in lora.py and load.py configs (#26413)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2025-10-09 02:38:33 -07:00 |
|
|
Simon DanielssonandCyrus Leung
|
432e1cbc23
|
[Bugfix]: Assertion error when using FlashInfer backend (#25933)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2025-10-05 16:46:36 +08:00 |
|
|
Simon Danielsson
|
e23cacda35
|
[Bugfix]: Clean up chunked prefill logging when using whisper (#25075)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2025-09-30 08:17:49 +00:00 |
|
|
Simon Danielsson
|
9aea7373ff
|
[Bugfix] Typos in error message for missing model config file (#25339)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2025-09-21 04:36:47 -07:00 |
|