3 people 973617ae02 [Speculative decoding][Re-take] Enable TP>1 speculative decoding (#4840) ...

Co-authored-by: Cade Daniel <edacih@gmail.com>
Co-authored-by: Cade Daniel <cade@anyscale.com>

2024-05-16 00:53:51 -07:00

..

device_communicators

[Core][Distributed] refactor custom allreduce to support multiple tp groups (#4754)

2024-05-12 17:47:59 -07:00

__init__.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00

communication_op.py

[Speculative decoding][Re-take] Enable TP>1 speculative decoding (#4840)

2024-05-16 00:53:51 -07:00

parallel_state.py

[Core][Distributed] refactor custom allreduce to support multiple tp groups (#4754)

2024-05-12 17:47:59 -07:00

utils.py

[Misc] centralize all usage of environment variables (#4548)

2024-05-02 11:13:25 -07:00