6 people cc2a77d7f1 [Core] [Bugfix] Add Input Embeddings (#15428) ...

Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

2025-05-02 01:06:39 -07:00

..

mla

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

Allocate kv_cache with stride order (#16605)

2025-04-25 22:03:31 -07:00

blocksparse_attn.py

fix some typos : supported_head_sizes (#14627)

2025-03-11 10:38:24 -07:00

cpu_mla.py

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

flash_attn.py

[BugFix] Fix vllm_flash_attn install issues (#17267)

2025-04-27 17:27:56 -07:00

flashinfer.py

[Core] [Bugfix] Add Input Embeddings (#15428)

2025-05-02 01:06:39 -07:00

flashmla.py

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

hpu_attn.py

[Hardware][Intel-Gaudi] Update hpu-extension and update bucketing system for HPU device (#17186)

2025-04-26 05:55:14 -07:00

ipex_attn.py

[Hardware][Intel GPU] Upgrade to torch 2.7 (#17444)

2025-04-30 00:03:58 -07:00

pallas.py

Add warning for Attention backends that do not support irope yet (#16212)

2025-04-08 03:59:26 +00:00

placeholder_attn.py

[Model] IBM/NASA Prithvi Geospatial model (#12830)

2025-02-11 20:34:30 -08:00

rocm_aiter_mla.py

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

rocm_flash_attn.py

[Quantization][FP8] Add support for FP8 models with input_scale for output projection and QK quantization (#15734)

2025-04-25 00:45:02 -07:00

torch_sdpa.py

Add warning for Attention backends that do not support irope yet (#16212)

2025-04-08 03:59:26 +00:00

triton_mla.py

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484)

2025-05-02 03:16:26 +00:00

utils.py

[Attention] Update to lastest FA3 code (#13111)

2025-04-17 15:14:07 -07:00

xformers.py

[BugFix] fix some typos found by typos. (#16314)

2025-04-09 03:43:59 -07:00