5 people 35dc273072 [ROCm][Spec Decode] Add Aiter MLA decode support non-causal draft block (#55966) ...

Signed-off-by: Poovaiah Palangappa <poovaiah.palangappa@amd.com>
Co-authored-by: Poovaiah Palangappa <poovaiah.palangappa@amd.com>
Co-authored-by: John Qin <zhengsheng1997@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

2026-09-15 12:18:09 -05:00

..

conftest.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

test_amx_mla.py

[CPU] Add AMX-only high-performance MLA backend for DeepSeek V2/V3/R1 (#52616)

2026-08-19 10:28:52 +08:00

test_attention_selector.py

[Attention] Add Triton/FlashInfer composite for multimodal prefix attention (#56305)

2026-09-13 14:29:41 +00:00

test_attention.py

[Bugfix][ROCm] Mask paged attention V cache padding (#53856)

2026-09-08 14:39:23 +08:00

test_cache.py

[Kimi Perf] Group fp8 mla cahche insertion, 4~6x kernel level performance improvement for small batch (#55356)

2026-09-11 08:16:57 -07:00

test_cascade_flash_attn.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

test_cpu_attn.py

[CPU] [Feat] Add native AMX-FP8 attention impl for Diamond Rapids (#49410)

2026-09-06 11:06:56 +08:00

test_cutlass_mla_decode.py

[Bugfix] Gate sm_100-only kernel tests on the capability family, not >= (#54306)

2026-09-01 11:29:15 -04:00

test_deepgemm_attention.py

[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)

2026-08-14 10:09:51 +00:00

test_flash_attn.py

[SM100] Hdim 256 optimized (#52980)

2026-08-25 20:28:40 -07:00

test_flashinfer_mla_decode.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

test_flashinfer_trtllm_attention.py

[Test] Dequantize NVFP4 KV cache scales in the layout the kernel writes (#55908)

2026-09-08 17:13:39 +00:00

test_flashinfer.py

[Perf] Ensure async h2d copies are pinned in more places (#55202)

2026-09-04 17:17:01 -07:00

test_flashmla_sparse.py

[Bugfix][SM120] DSv4: pass contiguous C128A decode topk indices on SM120 (#53574)

2026-08-31 09:44:42 +00:00

test_flashmla.py

[ROCM][CI] Attention test speedup (#52763)

2026-08-18 16:40:30 -05:00

test_kimi_k3_mla_fused_epilogue.py

[Perf][Kimi-K3] Cut MLA decode concat/cache epilogue latency (#54896)

2026-09-03 15:39:58 -07:00

test_kimi_k3_mla_key_concat_kv_cache.py

[Kimi-K3] DCP support (#50484)

2026-08-10 12:54:26 -07:00

test_lightning_attn.py

[Kernel][Test] Extend lightning_attn and awq_triton kernel tests to XPU (#43307)

2026-06-04 14:25:59 -04:00

test_merge_attn_states.py

[XPU][Tests] Make tests device-agnostic (#51968)

2026-08-20 02:25:41 -07:00

test_mha_attn.py

[ROCm][CI] Restore Torch defaults and type DSV4 scratch buffers (#52566)

2026-08-17 18:32:04 +00:00

test_minimax_m3_msa_cutlass_sparse_decode.py

[Bugfix][MiniMax-M3] Keep FP8 query allocation stable across CUDA graph replay (#51203)

2026-08-20 10:45:28 -07:00

test_minimax_m3.py

[ROCm][Perf] Tune MiniMax-M3 decode top-k for short contexts (#55235)

2026-09-13 21:36:27 -05:00

test_mixed_causal_attn.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

test_mla_cross_layer_kernel_equivalence.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

test_mla_decode_cpu.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

test_pack_unpack_triton.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_prefix_prefill.py

[Kernel] Make prefix-prefill tiling independent of the KV page size (#54194)

2026-09-01 09:19:55 +08:00

test_rocm_aiter_candidate_mask.py

[ROCm][DSV4.1][Perf] Stride the DSA decode candidate mask over the live context (#56628)

2026-09-14 20:47:32 +00:00

test_rocm_aiter_fa.py

[ROCm][Bugfix] Support shared KV prefill in AITER attention (#55887)

2026-09-09 14:51:34 -07:00

test_rocm_aiter_mla_causal_verify_mask.py

[ROCm][MLA][DCP] Support causal multi-token verification (#51705)

2026-08-31 10:42:28 -07:00

test_rocm_aiter_mla_decode_metadata.py

[Bugfix][ROCm][CI] Give the AITER MLA decode metadata stub its MLA dims (#52139)

2026-08-13 13:35:00 -05:00

test_rocm_aiter_mla_decode.py

[ROCm][CI] Add MLA decode accuracy and determinism tests (#50480)

2026-08-05 20:35:56 -05:00

test_rocm_aiter_mla_fp8_prefill.py

[ROCm][K3] Extend FP8 asm MLA prefill to non-divisor small head counts (#51040)

2026-08-26 17:47:16 +00:00

test_rocm_aiter_mla_fp8_support.py

[ROCm][Spec Decode] Add Aiter MLA decode support non-causal draft block (#55966)

2026-09-15 12:18:09 -05:00

test_rocm_aiter_mla_head_padding.py

[ROCm][MLA][DCP] Support causal multi-token verification (#51705)

2026-08-31 10:42:28 -07:00

test_rocm_aiter_mla_op_registration.py

[ROCm][CI] Add attention-sink support to ROCm AITER sparse MLA (#54404)

2026-09-07 09:26:47 +00:00

test_rocm_aiter_mla_sink.py

[ROCm][CI] Add attention-sink support to ROCm AITER sparse MLA (#54404)

2026-09-07 09:26:47 +00:00

test_rocm_aiter_mla_sparse_metadata_sync.py

[Deprecation] Deprecate items scheduled for 0.29 (#55353)

2026-09-11 08:17:02 -07:00

test_rocm_aiter_unified_attn.py

Fix ROCm AITER FP8 KV test tolerances. (#53590)

2026-09-09 12:22:25 -05:00

test_rocm_attention_selector.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_rocm_triton_attn_dsv4.py

[Model][ROCm] Enable DeepSeek V4 Vision (#55107)

2026-09-11 09:17:30 -07:00

test_triton_decode_attention.py

[ROCM][CI] Attention test speedup (#52763)

2026-08-18 16:40:30 -05:00

test_triton_prefill_attention.py

[XPU] enable triton attention test on XPU by removing cuda device binding (#39627)

2026-04-20 20:57:11 +08:00

test_triton_unified_attention_diffkv.py

[ROCM][CI] Attention test speedup (#52763)

2026-08-18 16:40:30 -05:00

test_triton_unified_attention.py

[Kernel][Gemma4] Prune Triton sliding-window tiles for multimodal prefixes (#53147)

2026-08-31 22:21:22 +00:00

test_trtllm_kvfp8_dequant.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

2026-08-21 17:47:49 -07:00

test_use_trtllm_attention.py

[Attention] Add FlashInfer XQA decode support on SM12x (#49718)

2026-08-11 16:32:49 -07:00

test_xpu_mla_sparse.py

[Bugfix] Prevent NaN poisoning in xpu_mla_sparse for fully-masked index chunks (#48366)

2026-07-27 09:06:07 +08:00