Cyrus Leung b311efd0bd [Misc] Fix import error in tensorizer tests and cleanup some code (#10349) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-11-15 09:34:17 +00:00

..

__init__.py

[V1] Use pickle for serializing EngineCoreRequest & Add multimodal inputs to EngineCoreRequest (#10245)

2024-11-12 08:57:14 -08:00

async_llm.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

async_stream.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

core_client.py

[V1] Use pickle for serializing EngineCoreRequest & Add multimodal inputs to EngineCoreRequest (#10245)

2024-11-12 08:57:14 -08:00

core.py

[V1] Support VLMs with fine-grained scheduling (#9871)

2024-11-13 04:53:13 +00:00

detokenizer.py

[V1] Add missing tokenizer options for Detokenizer (#10288)

2024-11-13 11:02:56 +00:00

llm_engine.py

[Misc] Fix import error in tensorizer tests and cleanup some code (#10349)

2024-11-15 09:34:17 +00:00

mm_input_mapper.py

[V1] Support VLMs with fine-grained scheduling (#9871)

2024-11-13 04:53:13 +00:00

processor.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00