Lucas Wilkinson ce75efeecb [BugFix] FA2 MLA Accuracy Issue (#18807) ...

Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>

2025-05-28 08:59:39 +00:00

..

mla

[BugFix] FA2 MLA Accuracy Issue (#18807)

2025-05-28 08:59:39 +00:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

Allocate kv_cache with stride order (#16605)

2025-04-25 22:03:31 -07:00

blocksparse_attn.py

fix some typos : supported_head_sizes (#14627)

2025-03-11 10:38:24 -07:00

cpu_mla.py

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

dual_chunk_flash_attn.py

Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)

2025-05-12 19:52:47 -07:00

flash_attn.py

[BugFix] Fix vllm_flash_attn install issues (#17267)

2025-04-27 17:27:56 -07:00

flashinfer.py

[Core] [Bugfix] Add Input Embeddings (#15428)

2025-05-02 01:06:39 -07:00

flashmla.py

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

hpu_attn.py

[Hardware][Intel-Gaudi] Support Automatic Prefix Caching on HPU (#17648)

2025-05-07 22:37:03 -07:00

ipex_attn.py

[Hardware][Intel GPU] Upgrade to torch 2.7 (#17444)

2025-04-30 00:03:58 -07:00

pallas.py

[TPU] Add kernel test for moe_pallas (#17496)

2025-05-06 17:59:57 -07:00

placeholder_attn.py

[Model] IBM/NASA Prithvi Geospatial model (#12830)

2025-02-11 20:34:30 -08:00

rocm_aiter_mla.py

[BugFix][AMD] Compatible patch for AITER lib after 04/20 (#17912)

2025-05-13 23:05:20 -07:00

rocm_flash_attn.py

[ROCm][Kernel][V1] Enable AMD Radeon GPU Custom Paged Attention on v1 (#17004)

2025-05-21 08:35:00 -07:00

torch_sdpa.py

Add warning for Attention backends that do not support irope yet (#16212)

2025-04-08 03:59:26 +00:00

triton_mla.py

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

utils.py

[Fix] Support CUDAGraph capture for encoder-decoder on ROCm (#18104)

2025-05-13 19:31:42 -07:00

xformers.py

[BugFix] fix some typos found by typos. (#16314)

2025-04-09 03:43:59 -07:00