Cade DanielandLily Liu 5757d90e26 [Speculative decoding] Adding configuration object for speculative decoding (#3706) ...

Co-authored-by: Lily Liu <lilyliupku@gmail.com>

2024-04-03 00:40:57 +00:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[Hardware][Intel] Add CPU inference backend (#3634)

2024-04-01 22:07:30 -07:00

executor_base.py

[Speculative decoding] Adding configuration object for speculative decoding (#3706)

2024-04-03 00:40:57 +00:00

gpu_executor.py

[Speculative decoding] Adding configuration object for speculative decoding (#3706)

2024-04-03 00:40:57 +00:00

neuron_executor.py

[Speculative decoding] Adding configuration object for speculative decoding (#3706)

2024-04-03 00:40:57 +00:00

ray_gpu_executor.py

[Speculative decoding] Adding configuration object for speculative decoding (#3706)

2024-04-03 00:40:57 +00:00

utils.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00