Yong Hoon Shin ad510309ee Override attention metadata for fast prefill in some KV sharing setups (#21590) ...

Signed-off-by: Yong Hoon Shin <yhshin@meta.com>

2025-07-30 08:54:15 -07:00

..

multiprocessing

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

output_processor

[V0 Deprecation] Remove V0 Spec Decode workers (#21152)

2025-07-18 21:47:50 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Override attention metadata for fast prefill in some KV sharing setups (#21590)

2025-07-30 08:54:15 -07:00

async_llm_engine.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

async_timeout.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

llm_engine.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

metrics_types.py

[V0 Deprecation] Remove V0 Spec Decode workers (#21152)

2025-07-18 21:47:50 -07:00

metrics.py

[V0 Deprecation] Remove V0 Spec Decode workers (#21152)

2025-07-18 21:47:50 -07:00

protocol.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00