William LinandCody Yu f366f6339b [spec decode] [4/N] Move update_flash_attn_metadata to attn backend (#7571) ...

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2024-08-16 11:41:56 -07:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[spec decode] [4/N] Move update_flash_attn_metadata to attn backend (#7571)

2024-08-16 11:41:56 -07:00

blocksparse_attn.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

flash_attn.py

[spec decode] [4/N] Move update_flash_attn_metadata to attn backend (#7571)

2024-08-16 11:41:56 -07:00

flashinfer.py

register custom op for flash attn and use from torch.ops (#7536)

2024-08-15 22:38:56 -07:00

ipex_attn.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

openvino.py

[Hardware][Intel] OpenVINO vLLM backend (#5379)

2024-06-28 13:50:16 +00:00

pallas.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

rocm_flash_attn.py

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00

torch_sdpa.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

utils.py

[Misc] Add numpy implementation of compute_slot_mapping (#7377)

2024-08-09 22:52:29 +00:00

xformers.py

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00