Pavani Majety 6c1208d083 [Core] Add Sliding Window Support with Flashinfer (#10462) ...

Signed-off-by: Pavani Majety <pmajety@nvidia.com>

2024-11-20 19:56:47 -08:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346)

2024-11-01 16:21:10 -07:00

blocksparse_attn.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346)

2024-11-01 16:21:10 -07:00

flash_attn.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

flashinfer.py

[Core] Add Sliding Window Support with Flashinfer (#10462)

2024-11-20 19:56:47 -08:00

hpu_attn.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

ipex_attn.py

[Misc][XPU] Upgrade to Pytorch 2.5 for xpu backend (#9823)

2024-11-06 17:29:03 -08:00

openvino.py

[Model][OpenVINO] Fix regressions from #8346 (#10045)

2024-11-06 04:19:15 +00:00

pallas.py

[TPU] Implement prefix caching for TPUs (#10307)

2024-11-20 13:54:15 -08:00

placeholder_attn.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346)

2024-11-01 16:21:10 -07:00

rocm_flash_attn.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

torch_sdpa.py

[Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355)

2024-11-20 10:57:39 +00:00

utils.py

[Misc] Compute query_start_loc/seq_start_loc on CPU (#9447)

2024-11-04 08:54:37 +00:00

xformers.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00