vLLM/vllm/model_executor/parallel_utils at 1a2bbc930135cd3b94fbff2aafbdf5c568acc8bd - vLLM

Files

T

Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>

2023-10-16 10:56:50 -07:00

__init__.py

2023-10-02 15:36:09 -07:00

communication_op.py

2023-10-16 10:56:50 -07:00

layers.py

2023-10-16 10:56:50 -07:00

parallel_state.py

2023-10-02 15:36:09 -07:00

README.md

2023-06-17 03:07:40 -07:00

utils.py

2023-10-16 10:56:50 -07:00

The files in this folder are ported from Megatron-LM. We only keep the codes that are used in inference.