Isotr0py 58170d6503 [Hardware][CPU] Add embedding models support for CPU backend (#10193) ...

Signed-off-by: Isotr0py <2037008807@qq.com>

2024-11-11 08:54:28 +00:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346)

2024-11-01 16:21:10 -07:00

blocksparse_attn.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346)

2024-11-01 16:21:10 -07:00

flash_attn.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

flashinfer.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346)

2024-11-01 16:21:10 -07:00

hpu_attn.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

ipex_attn.py

[Misc][XPU] Upgrade to Pytorch 2.5 for xpu backend (#9823)

2024-11-06 17:29:03 -08:00

openvino.py

[Model][OpenVINO] Fix regressions from #8346 (#10045)

2024-11-06 04:19:15 +00:00

pallas.py

[Doc] Consistent naming of attention backends (#9498)

2024-10-21 22:29:57 +08:00

placeholder_attn.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346)

2024-11-01 16:21:10 -07:00

rocm_flash_attn.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

torch_sdpa.py

[Hardware][CPU] Add embedding models support for CPU backend (#10193)

2024-11-11 08:54:28 +00:00

utils.py

[Misc] Compute query_start_loc/seq_start_loc on CPU (#9447)

2024-11-04 08:54:37 +00:00

xformers.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00