Cade Daniel 62b8aebc6f [Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[Frontend] Enable support for CPU backend in AsyncLLMEngine. (#3993)

2024-04-22 09:19:51 +00:00

executor_base.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

gpu_executor.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

neuron_executor.py

[CI/CD] add neuron docker and ci test scripts (#3571)

2024-04-18 15:26:01 -07:00

ray_gpu_executor.py

[Core] Some simplification of WorkerWrapper changes (#4183)

2024-04-23 07:49:08 +00:00