Nick HillandRobert Shaw 24b0205f58 [V1][Frontend] Coalesce bunched RequestOutputs (#12298) ...

Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

2025-01-23 17:17:41 -08:00

..

__init__.py

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

async_llm.py

[V1][Frontend] Coalesce bunched RequestOutputs (#12298)

2025-01-23 17:17:41 -08:00

core_client.py

[Frontend][V1] Online serving performance improvements (#12287)

2025-01-22 22:22:12 +00:00

core.py

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

detokenizer.py

[V1] [2/n] Logging and Metrics - OutputProcessor Abstraction (#11973)

2025-01-13 04:54:10 +00:00

llm_engine.py

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

mm_input_mapper.py

[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)

2025-01-06 19:58:16 +00:00

output_processor.py

[Frontend][V1] Online serving performance improvements (#12287)

2025-01-22 22:22:12 +00:00

processor.py

[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)

2025-01-06 19:58:16 +00:00