3 people 87a4bf664f [Perf][GDN] Slice pure spec-decode rows instead of a host-mask gather (#58763) ...

Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

2026-10-01 06:53:06 +00:00

..

test_attention_backends_selection.py

[Mamba] Add FlashInfer ReplaySSM support for MTP (#52928)

2026-09-30 21:41:17 +00:00

test_attention_backends.py

[Perf][Pooling] Avoid blocking seq_lens GPU-to-CPU copy for pooling in FlashInfer metadata builder (#57214)

2026-09-27 16:06:38 +00:00

test_attention_splitting.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_b12x.py

[Kernel] Add B12X causal paged attention backend (#52017)

2026-09-01 10:42:02 -04:00

test_backend_per_kind.py

[Kernel] Resubmit PR 48666 - Gemma4 FP8 KV FA4 head dim 512 backend selection (#53175)

2026-09-23 20:29:06 -07:00

test_batch_reordering.py

[Attention] Support distinguishing between short extends and decodes (#37303)

2026-03-20 10:49:36 -07:00

test_chunked_local_attention.py

[Deprecation] Deprecate items scheduled for 0.29 (#55353)

2026-09-11 08:17:02 -07:00

test_cpu_mla_backend.py

[Attention][CPU] Use zentorch SDPA for CPU MLA prefill (#54967)

2026-09-27 08:30:55 +00:00

test_cuda_backend_probe_errors.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

test_dcp_a2a_pack_mask.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_deepseek_v4_rocm_adaptive.py

[ROCm][DSv4] Enable DSpark adaptive verification (#52362)

2026-09-21 10:03:41 -05:00

test_deepseek_v4_swa_visible.py

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

test_dspark_noncausal_sparse_mla.py

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

test_flashinfer_dcp_spec_reorder.py

[Attention] Extend XQA decode support on SM90 (#50439)

2026-09-11 06:19:55 +00:00

test_flashinfer_mla_dcp.py

[Spec decode] Support variable-length decode for Kimi-K3 adaptive ver (#52988)

2026-09-22 20:43:32 -07:00

test_flashinfer_mla_sparse_sm90.py

[Bugfix] GLM-5.3-Flash: fp8 plan dtype on SM90 sparse MLA, and right-size the indexer prefill workspace (#55222)

2026-09-29 22:36:39 +00:00

test_flashinfer_sparse_mla_sm120_api.py

[Bugfix][SM120][MLA] Disable dense prefill for FlashInfer sparse MLA (#51395)

2026-08-17 16:58:02 -07:00

test_flashinfer_sparse_mla_workspace.py

[Bugfix][Attention] Stabilize sparse-MLA DCP for GLM PCP evals (#55879)

2026-09-15 09:58:30 -07:00

test_flashmla_nope_sm90_backend_selection.py

[perf] wire FA and FlashMLA for sm90 GLM5Next NoPE SparseMLA (#55385)

2026-09-22 02:03:59 -07:00

test_gdn_metadata_builder.py

[Perf][GDN] Slice pure spec-decode rows instead of a host-mask gather (#58763)

2026-10-01 06:53:06 +00:00

test_group_head_counts.py

[PCP][DCP] Support DCP target model with non-DCP Dspark (#56723)

2026-09-26 18:12:35 -04:00

test_group_sliding_window.py

[Bugfix] Take the sliding window from the layer, not the KV cache group (#51756)

2026-08-11 09:10:46 -07:00

test_indexer_dcp_localize.py

[Perf][Attention] Reduce GLM sparse MLA preparation overhead (#57458)

2026-09-21 17:24:25 -07:00

test_indexer_deepseek_v4_slot_mapping.py

[Bugfix] GLM-5.3-Flash: fp8 plan dtype on SM90 sparse MLA, and right-size the indexer prefill workspace (#55222)

2026-09-29 22:36:39 +00:00

test_indexer_native_next_n.py

[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)

2026-08-14 10:09:51 +00:00

test_kpool_tail_slot_mapping.py

[Bugfix][GLM-5.3-Flash] kpool corruption with speculative decoding (#58454)

2026-09-25 12:51:34 -04:00

test_kv_head_stride_canonicalization.py

[Attention] Make FlexAttention and FlashAttention use num-blocks first layouts (#42095)

2026-05-26 19:55:56 -07:00

test_linear_attention_metadata_builder.py

[Feature] Support MTP speculative decoding for Bailing hybrid models (#44880)

2026-07-06 10:38:50 +08:00

test_mamba_update_block_table.py

[Perf] Batch Mamba2 prefill SSM state saves, removing GPU<->CPU syncs (#49371)

2026-09-25 01:11:19 +00:00

test_mla_backends.py

[Bugfix][KV Cache][MLA] Align packed block strides for V3.2 sparse MLA (#55528)

2026-09-25 05:33:36 +00:00

test_mla_context_chunks.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

test_mla_noncausal.py

[Bugfix][MLA] Restore DSpark cache-group capability under optimized Python (#55234)

2026-09-04 10:24:31 -07:00

test_mla_prefill_quant_output.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_mla_prefill_registry.py

[Attention][MLA] Fuse Kimi-K3 chunked-context K/V packing (#51772)

2026-08-12 22:42:57 -07:00

test_mla_prefill_selector.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

test_mm_prefix.py

[Attention] Add Triton/FlashInfer composite for multimodal prefix attention (#56305)

2026-09-13 14:29:41 +00:00

test_replayssm_metadata_builder.py

[Mamba] Add FlashInfer ReplaySSM support for MTP (#52928)

2026-09-30 21:41:17 +00:00

test_rocm_aiter_mla_dcp_cprr_numerics.py

[ROCm][MLA] Add an AITER ASM round-robin decode route for DCP multi-token verify (#56861)

2026-09-28 14:52:21 -04:00

test_rocm_aiter_mla_dcp_cprr.py

[ROCm][MLA] Add an AITER ASM round-robin decode route for DCP multi-token verify (#56861)

2026-09-28 14:52:21 -04:00

test_rocm_aiter_mla_fp8_decode_routing.py

[CI][ROCM] Add the Fusion E2E TP2 Quick group on MI355, and the AITER MLA fix it needs (#58369)

2026-09-23 21:01:58 -05:00

test_rocm_aiter_mla_mtp_split.py

[ROCm][MLA] Add an AITER ASM round-robin decode route for DCP multi-token verify (#56861)

2026-09-28 14:52:21 -04:00

test_rocm_aiter_triton_sparse_mla.py

[ROCm][MLA] Enable sparse MLA Gluon kernel from Aiter (#53492)

2026-09-29 09:08:18 +08:00

test_rocm_attention_backends_selection.py

[ROCm] Give turboquant boundary layers a layout-compatible backend (#54988)

2026-09-23 22:00:07 -05:00

test_rocm_glm5next_sparse.py

[ROCm][Perf][GLM-5.3-Flash] "Fit kpool top-k indices to AITER" with a single Triton kernel (#58008)

2026-09-30 09:45:00 -05:00

test_rocm_paged_mxfp4_indexer_plan.py

[ROCm][DSv4.1] Paged MXFP4 sparse indexer on aiter's MQA-logits kernel (#58671)

2026-09-29 14:37:57 +08:00

test_sparse_indexer_decode_seq_lens.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_sparse_mla_backends.py

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

test_sparse_mla_kv_cache_layout.py

[Bugfix][KV Cache][MLA] Align packed block strides for V3.2 sparse MLA (#55528)

2026-09-25 05:33:36 +00:00

test_sparse_mla_mask.py

[Attention] Vectorize sparse MLA mask loads (#52217)

2026-08-18 20:32:41 -07:00

test_triton_attn_segments.py

[Attention][SM120] Occupancy-adaptive Triton split-K segment count (#58482)

2026-10-01 02:20:33 +00:00

test_trtllm_attention_integration.py

[Perf][Spec Decode] Enable fused multi-step draft decode for FlashInfer trtllm-gen (#58371)

2026-09-29 06:06:47 +00:00

test_vit_attn_wrappers.py

[MM] Fix compiled ViT attention output layouts (#58182)

2026-09-29 06:27:03 -07:00

utils.py

[Refactor] Remove dead tests utils (#58803)

2026-09-26 09:16:53 -04:00