Roy 515386ef3c [Core] Support multi-node inference(eager and cuda graph) (#3686)

2024-03-28 15:01:55 -07:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

executor_base.py

[Feature] Add vision language model support. (#3042)

2024-03-25 14:16:30 -07:00

gpu_executor.py

[Core][Bugfix]Refactor block manager for better testability (#3492)

2024-03-27 23:59:28 -07:00

neuron_executor.py

[Bugfix] Update neuron_executor.py to add optional vision_language_config (#3695)

2024-03-28 10:43:34 -07:00

ray_gpu_executor.py

[Core] Support multi-node inference(eager and cuda graph) (#3686)

2024-03-28 15:01:55 -07:00

utils.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00