Lily LiuandLiuXiaoxuanPKU <llilyliupku@gmail.com>, bong-furiosa <bongwon.jang@furiosa.ai> 7041de4384 [Kernel] Flashinfer for prefill & decode, with Cudagraph support for decode (#4628) ...

Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>, bong-furiosa <bongwon.jang@furiosa.ai>

2024-06-28 15:28:49 -07:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408)

2024-06-25 20:30:03 -07:00

blocksparse_attn.py

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408)

2024-06-25 20:30:03 -07:00

flash_attn.py

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408)

2024-06-25 20:30:03 -07:00

flashinfer.py

[Kernel] Flashinfer for prefill & decode, with Cudagraph support for decode (#4628)

2024-06-28 15:28:49 -07:00

ipex_attn.py

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408)

2024-06-25 20:30:03 -07:00

openvino.py

[Hardware][Intel] OpenVINO vLLM backend (#5379)

2024-06-28 13:50:16 +00:00

pallas.py

[Hardware][TPU] Optimize KV cache swapping (#5878)

2024-06-27 21:12:13 -07:00

rocm_flash_attn.py

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408)

2024-06-25 20:30:03 -07:00

torch_sdpa.py

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408)

2024-06-25 20:30:03 -07:00

xformers.py

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408)

2024-06-25 20:30:03 -07:00