youkaichao 614aa51203 [misc][cuda] use nvml to avoid accidentally cuda initialization (#6007)

2024-06-30 20:07:34 -07:00

..

blocksparse_attention

[misc][cuda] use nvml to avoid accidentally cuda initialization (#6007)

2024-06-30 20:07:34 -07:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

ipex_attn.py

[Hardware][Intel] Optimize CPU backend and add more performance tips (#4971)

2024-06-13 09:33:14 -07:00

paged_attn.py

[Model] Support MAP-NEO model (#5081)

2024-05-30 19:24:41 -07:00

prefix_prefill.py

[misc][cuda] use nvml to avoid accidentally cuda initialization (#6007)

2024-06-30 20:07:34 -07:00

triton_flash_attention.py

[ROCm][AMD][Bugfix] adding a missing triton autotune config (#4845)

2024-05-16 10:46:52 -07:00