Chen ZhangandCody Yu 69d765f5a5 [V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960) ...

Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2025-01-17 07:39:35 +00:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

abstract.py

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960)

2025-01-17 07:39:35 +00:00

multiproc_executor.py

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960)

2025-01-17 07:39:35 +00:00

ray_executor.py

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960)

2025-01-17 07:39:35 +00:00

ray_utils.py

[platform] add ray_device_key (#11948)

2025-01-13 16:20:52 +08:00

uniproc_executor.py

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960)

2025-01-17 07:39:35 +00:00