5 people 35dc273072 [ROCm][Spec Decode] Add Aiter MLA decode support non-causal draft block (#55966) ...

Signed-off-by: Poovaiah Palangappa <poovaiah.palangappa@amd.com>
Co-authored-by: Poovaiah Palangappa <poovaiah.palangappa@amd.com>
Co-authored-by: John Qin <zhengsheng1997@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

2026-09-15 12:18:09 -05:00

..

test_attention_backends_selection.py

[Model] Remove MiniMaxText01, MiniMaxVL01, MiniMaxForCausalLM (#45993)

2026-06-22 15:20:46 +08:00

test_attention_backends.py

[Attention] Extend XQA decode support on SM90 (#50439)

2026-09-11 06:19:55 +00:00

test_attention_splitting.py

[Core] Add MRV2 virtual-batch PCP for MLA (#46570)

2026-07-19 02:53:15 +00:00

test_b12x.py

[Kernel] Add B12X causal paged attention backend (#52017)

2026-09-01 10:42:02 -04:00

test_backend_per_kind.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

test_batch_reordering.py

[Attention] Support distinguishing between short extends and decodes (#37303)

2026-03-20 10:49:36 -07:00

test_chunked_local_attention.py

[Deprecation] Deprecate items scheduled for 0.29 (#55353)

2026-09-11 08:17:02 -07:00

test_cpu_mla_backend.py

[CPU][MLA] Fix prefill backend selection so MLA runs end-to-end on CPU (#51471)

2026-08-28 12:36:55 +08:00

test_cuda_backend_probe_errors.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

test_dcp_a2a_pack_mask.py

[Bugfix][Attention] Stabilize sparse-MLA DCP for GLM PCP evals (#55879)

2026-09-15 09:58:30 -07:00

test_deepseek_v4_swa_visible.py

[New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support (#54566)

2026-09-02 11:09:09 -07:00

test_dspark_noncausal_sparse_mla.py

[Bugfix][MLA] Read sparse model settings from text config (#56160)

2026-09-11 18:02:13 +00:00

test_flashinfer_dcp_spec_reorder.py

[Attention] Extend XQA decode support on SM90 (#50439)

2026-09-11 06:19:55 +00:00

test_flashinfer_mla_dcp.py

[Attention][DCP] Enable FlashInfer MLA for DSpark drafting (#54277)

2026-08-28 21:11:28 -07:00

test_flashinfer_mla_sparse_sm90.py

[Bugfix] Prevent out-of-bounds access in FlashInfer SM90 sparse MLA mixed batches (#56969)

2026-09-15 15:03:58 +00:00

test_flashinfer_sparse_mla_sm120_api.py

[Bugfix][SM120][MLA] Disable dense prefill for FlashInfer sparse MLA (#51395)

2026-08-17 16:58:02 -07:00

test_flashinfer_sparse_mla_workspace.py

[Bugfix][Attention] Stabilize sparse-MLA DCP for GLM PCP evals (#55879)

2026-09-15 09:58:30 -07:00

test_gdn_metadata_builder.py

[Bugfix] Avoid racy accepted counts in async spec decode (#45100)

2026-06-22 08:53:16 +00:00

test_group_head_counts.py

[Bugfix][CPU] Fix several bugs (#54042)

2026-08-31 15:33:06 +08:00

test_group_sliding_window.py

[Bugfix] Take the sliding window from the layer, not the KV cache group (#51756)

2026-08-11 09:10:46 -07:00

test_indexer_dcp_localize.py

[Bugfix][Attention] Stabilize sparse-MLA DCP for GLM PCP evals (#55879)

2026-09-15 09:58:30 -07:00

test_indexer_deepseek_v4_slot_mapping.py

[Bugfix][Attention] Stabilize sparse-MLA DCP for GLM PCP evals (#55879)

2026-09-15 09:58:30 -07:00

test_indexer_native_next_n.py

[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)

2026-08-14 10:09:51 +00:00

test_kpool_tail_slot_mapping.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

test_kv_head_stride_canonicalization.py

[Attention] Make FlexAttention and FlashAttention use num-blocks first layouts (#42095)

2026-05-26 19:55:56 -07:00

test_linear_attention_metadata_builder.py

[Feature] Support MTP speculative decoding for Bailing hybrid models (#44880)

2026-07-06 10:38:50 +08:00

test_mamba_update_block_table.py

[Kernel] ReplaySSM: cache SSM inputs for faster Mamba2 standard decode (#48018)

2026-07-24 09:39:49 -07:00

test_mla_backends.py

[Perf][GLM-5.3-Flash] Dense/masked-MHA sparse prefill for the NoPE (256, 0, 256) layout + skip the NoPE K concat (#55738)

2026-09-14 09:36:39 +00:00

test_mla_context_chunks.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

test_mla_noncausal.py

[Bugfix][MLA] Restore DSpark cache-group capability under optimized Python (#55234)

2026-09-04 10:24:31 -07:00

test_mla_prefill_quant_output.py

[3/N][warmup][DSv4] Migrate FA4 MLA and shared CuTeDSL kernels (#53565)

2026-09-07 09:36:35 -04:00

test_mla_prefill_registry.py

[Attention][MLA] Fuse Kimi-K3 chunked-context K/V packing (#51772)

2026-08-12 22:42:57 -07:00

test_mla_prefill_selector.py

[Perf][GLM-5.3-Flash] Dense/masked-MHA sparse prefill for the NoPE (256, 0, 256) layout + skip the NoPE K concat (#55738)

2026-09-14 09:36:39 +00:00

test_mm_prefix.py

[Attention] Add Triton/FlashInfer composite for multimodal prefix attention (#56305)

2026-09-13 14:29:41 +00:00

test_replayssm_metadata_builder.py

[Mamba] Add FlashInfer ReplaySSM backend (#52506)

2026-09-01 10:26:43 -04:00

test_rocm_aiter_mla_fp8_decode_routing.py

[ROCm][Spec Decode] Add Aiter MLA decode support non-causal draft block (#55966)

2026-09-15 12:18:09 -05:00

test_rocm_aiter_mla_mtp_split.py

[ROCm][Spec Decode] Add Aiter MLA decode support non-causal draft block (#55966)

2026-09-15 12:18:09 -05:00

test_rocm_attention_backends_selection.py

[ROCm][Feature] Support KV connectors with ROCM_AITER_UNIFIED_ATTN (#53695)

2026-09-10 12:48:42 -05:00

test_rocm_glm5next_sparse.py

[ROCm][Bugfix] Route GLM-5.3-Flash MTP through ragged sparse MLA (#55239)

2026-09-10 20:13:14 -05:00

test_sparse_indexer_decode_seq_lens.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

test_sparse_mla_backends.py

[Bugfix][SparseMLA] Fix piecewise cudagraph capture crash in index group (#56825)

2026-09-15 06:51:35 +00:00

test_sparse_mla_mask.py

[Attention] Vectorize sparse MLA mask loads (#52217)

2026-08-18 20:32:41 -07:00

test_trtllm_attention_integration.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

2026-08-21 17:47:49 -07:00

utils.py

[Deprecation] Deprecate items scheduled for 0.29 (#55353)

2026-09-11 08:17:02 -07:00