3 people 37ca558103 Optimize model execution with CUDA graph (#1926) ...

Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

2023-12-16 21:12:08 -08:00

..

__init__.py

Optimize Mixtral with expert parallelism (#2090)

2023-12-13 23:55:07 -08:00

aquila.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

baichuan.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

bloom.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

chatglm.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

falcon.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt2.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt_bigcode.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt_j.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt_neox.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

internlm.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

llama.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

mistral.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

mixtral.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

mpt.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

opt.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

phi_1_5.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

qwen.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

yi.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00