3 people 39971db3aa Frontend: Adding LM Format Enforcer support to V1 engine (#22564) ...

Signed-off-by: Noam Gat <noamgat@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2025-08-24 19:31:22 -07:00

..

__init__.py

[Refactor] Allow optional MultiModalKwargsItem in IPC (#23022)

2025-08-16 11:30:49 +00:00

async_llm.py

[Core] Add torch profiler CPU traces for AsyncLLM. (#21794)

2025-08-20 02:32:47 +00:00

coordinator.py

[BugFix] Improve internal DP load balancing (#21617)

2025-08-01 19:45:27 -07:00

core_client.py

[BugFix] Handle case where async utility call is cancelled (#22996)

2025-08-15 17:38:42 -06:00

core.py

[Spec Decode] Make propose_draft_token_ids non-blocking for lower TTFT (#23041)

2025-08-18 17:20:38 -07:00

detokenizer.py

[V1] support min_tokens for detokener (#22014)

2025-08-16 02:28:10 +00:00

exceptions.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

llm_engine.py

[CI/Build] Fix multimodal tests (#22491)

2025-08-08 00:31:19 -07:00

logprobs.py

[Sampler] Support returning all logprobs or logits (#21792)

2025-08-04 03:04:12 -07:00

mm_input_cache.py

[Refactor] Allow optional MultiModalKwargsItem in IPC (#23022)

2025-08-16 11:30:49 +00:00

output_processor.py

[Core] Return final response for aborted requests from AsyncLLM.generate (#22283)

2025-08-14 14:49:02 -07:00

parallel_sampling.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

processor.py

Frontend: Adding LM Format Enforcer support to V1 engine (#22564)

2025-08-24 19:31:22 -07:00

utils.py

[Bugfix] Fix port conflict by obtaining a list of open ports upfront (#21894)

2025-08-21 10:22:18 -07:00