3 people a09ad90a72 [V1] guidance backend for structured output + auto fallback mode (#14779) ...

Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <jc1da.3011@gmail.com>
Co-authored-by: Michal Moskal <michal@moskal.me>

2025-03-24 21:02:33 -07:00

..

__init__.py

[V1] Remove input cache client (#14864)

2025-03-16 23:42:06 -07:00

async_llm.py

[V1][Perf] Simpler request output queues (#15156)

2025-03-24 22:44:08 +00:00

core_client.py

[BugFix][Typing] Fix Imprecise Type Annotations (#15208)

2025-03-22 09:05:03 -07:00

core.py

[v1] Refactor KVCacheConfig (#14079)

2025-03-21 04:56:27 -07:00

detokenizer.py

[V1] Detokenizer: Respect Stop Tokens + not include_stop_str_in_output (#14624)

2025-03-13 19:07:34 +00:00

llm_engine.py

[V1] Avoid redundant input processing in n>1 case (#14985)

2025-03-20 22:24:10 -07:00

logprobs.py

[V1] Aggregate chunked prompt logprobs in model runner (#14875)

2025-03-24 12:27:57 -04:00

mm_input_cache.py

[V1] Remove input cache client (#14864)

2025-03-16 23:42:06 -07:00

output_processor.py

[V1][Perf] Simpler request output queues (#15156)

2025-03-24 22:44:08 +00:00

parallel_sampling.py

[V1] Avoid redundant input processing in n>1 case (#14985)

2025-03-20 22:24:10 -07:00

processor.py

[V1] guidance backend for structured output + auto fallback mode (#14779)

2025-03-24 21:02:33 -07:00