vLLM/tests/kernels/attention at 751f2ccdd3b7ed2ba65dcb04dbd93187edc25b2d - vLLM

conftest.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908 )

2025-10-18 09:48:22 -07:00

test_aiter_flash_attn.py

[ROCm][AITER] Fix AITER import regression for explicit backend selection (#33749 )

2026-02-06 15:08:16 +00:00

test_attention_selector.py

Add NVFP4 KV 4-over-6 scale search (#45187 )

2026-08-07 13:22:27 -07:00

test_attention.py

Delete PagedAttention (#47361 )

2026-07-02 12:31:26 -07:00

test_cache.py

Add NVFP4 KV 4-over-6 scale search (#45187 )

2026-08-07 13:22:27 -07:00

test_cascade_flash_attn.py

[Platform] Deprecate seed_everything (#31659 )

2026-01-04 18:34:04 -08:00

test_cpu_attn.py

[CPU][BugFix] Remove redundant kv cache write (#50437 )

2026-07-31 15:28:44 +08:00

test_cutlass_mla_decode.py

[Attention] Re-enable cross-layer KV cache layout for MLA via stride-aware kernels (#45111 )

2026-06-22 06:57:02 -07:00

test_deepgemm_attention.py

[Feat] DeepSeek V4 Rebased (#40860 )

2026-04-26 18:31:08 -07:00

test_flash_attn.py

[Platform] Deprecate seed_everything (#31659 )

2026-01-04 18:34:04 -08:00

test_flashinfer_mla_decode.py

[Bugfix] Use int8 workspace for FlashInfer MLA decode (#48046 )

2026-07-08 23:39:40 +00:00

test_flashinfer_trtllm_attention.py

[2/N][KV-Cache Layout Refactor] Pack K/V into the content dim across attention backends (#44455 )

2026-07-11 11:11:16 -04:00

test_flashinfer.py

[Update] Use FlashInfer fast_decode_plan directly instead of replication (#34687 )

2026-02-26 16:31:43 -08:00

test_flashmla_sparse.py

[DSv4 Perf] Remove redundant full kernel for dsv4, 1.88x kernel performance improvement (#50298 )

2026-07-30 11:39:07 -04:00

test_flashmla.py

Add FlashMLA H100 tests to CI, fix them after #32810 (#50322 )

2026-07-29 22:06:18 -07:00

test_kimi_k3_mla_fused_epilogue.py

[Model] Add Kimi K3 support: model files and kernels [1/N] (#50089 )

2026-07-29 14:10:58 +08:00

test_lightning_attn.py

[Kernel][Test] Extend lightning_attn and awq_triton kernel tests to XPU (#43307 )

2026-06-04 14:25:59 -04:00

test_merge_attn_states.py

[Attention][MLA] Per-request scheduling for MLA chunked context (#50613 )

2026-08-06 16:45:44 +00:00

test_mha_attn.py

[ROCm] Add AITER FP8 ViT encoder attention (#49937 )

2026-07-30 06:22:10 +00:00

test_minimax_m3_msa_cutlass_sparse_decode.py

[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032 )

2026-08-02 13:46:55 -07:00

test_minimax_m3.py

[CI] Add M3 MSA tests to CI (#49143 )

2026-07-31 01:01:48 -07:00

test_mixed_causal_attn.py

[Model] Add DiffusionGemma Support (#45163 )

2026-06-11 22:17:35 -07:00

test_mla_cross_layer_kernel_equivalence.py

Add FlashMLA H100 tests to CI, fix them after #32810 (#50322 )

2026-07-29 22:06:18 -07:00

test_mla_decode_cpu.py

[Chore]:Extract math and argparse utilities to separate modules (#27188 )

2025-10-26 04:03:32 -07:00

test_pack_unpack_triton.py

[1/N][Attention] Restructure attention: move files (#31916 )

2026-01-09 13:10:24 -08:00

test_prefix_prefill.py

[ROCm] [CI] Support cached K/V (key/value=None) in Triton prefix-prefill (#48257 )

2026-07-29 23:31:51 -05:00

test_rocm_aiter_mla_causal_verify_mask.py

[ROCm][MLA] Use asm decode for non-divisor small head counts (#50578 )

2026-08-06 14:56:53 -04:00

test_rocm_aiter_mla_decode_metadata.py

[ROCm][CI] Fix AITER MLA fp8 decode metadata regression test (#48845 )

2026-07-21 12:19:45 -05:00

test_rocm_aiter_mla_decode.py

[ROCm][CI] Add MLA decode accuracy and determinism tests (#50480 )

2026-08-05 20:35:56 -05:00

test_rocm_aiter_mla_fp8_prefill.py

[Test] Add ROCm AITER FP8 MLA prefill accuracy test (#51457 )

2026-08-08 19:42:26 -05:00

test_rocm_aiter_mla_head_padding.py

[ROCm][MLA] Use asm decode for non-divisor small head counts (#50578 )

2026-08-06 14:56:53 -04:00

test_rocm_aiter_mla_op_registration.py

[Test] Add ROCm AITER MLA op registration and env gating tests (#50930 )

2026-08-07 14:07:31 -05:00

test_rocm_aiter_mla_sparse_metadata_sync.py

[ROCm] [BugFix] Fix Quark GLM-5.2 Checkpoint inference: indexer wk per-channel FP8 dequant + missing sparse-MLA metadata fields (#48886 )

2026-07-27 22:38:22 +00:00

test_rocm_aiter_unified_attn.py

Enable gfx1250 ROCm architecture (#46516 )

2026-07-31 01:41:12 +00:00

test_rocm_attention_selector.py

[1/N][Attention] Restructure attention: move files (#31916 )

2026-01-09 13:10:24 -08:00

test_rocm_triton_attn_dsv4.py

[ROCm][Bugfix] Sanitize AITER paged-MQA logits before sparse top-k for DeepSeek-V4 (#49714 )

2026-07-28 11:08:50 -07:00

test_triton_decode_attention.py

[Attention] Re-enable cross-layer KV cache layout for MLA via stride-aware kernels (#45111 )

2026-06-22 06:57:02 -07:00

test_triton_prefill_attention.py

[XPU] enable triton attention test on XPU by removing cuda device binding (#39627 )

2026-04-20 20:57:11 +08:00

test_triton_unified_attention_diffkv.py

[Attention] add triton diff-kv backend for mimo (#41797 )

2026-06-11 11:36:31 -04:00

test_triton_unified_attention.py

[Hardware][AMD][CI] Fix Kernels Attention test groups (#46080 )

2026-06-21 17:10:51 -05:00

test_trtllm_kvfp8_dequant.py

[ROCm][CI] Skip trtllm kvfp8 dequant tests on ROCm (#37330 )

2026-03-18 11:12:26 +08:00

test_use_trtllm_attention.py

Add DCP + Eagle support for Tokenspeed MLA backends (#48180 )

2026-07-13 11:46:02 -07:00

test_xpu_mla_sparse.py

[Bugfix] Prevent NaN poisoning in xpu_mla_sparse for fully-masked index chunks (#48366 )

2026-07-27 09:06:07 +08:00