Kris HungandClaude Opus 4.6 766cb65d00 feat(multimodal): support externally processed mm_kwargs with cache injection (#39502) ...

Signed-off-by: Krish Hung <krishung5@gmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-21 11:31:09 +00:00

..

__init__.py

[Core][Metrics][BugFix] Replace num_cached_tokens/num_external_computed_tokens with PrefillStats (#37460)

2026-04-14 09:00:45 +01:00

async_llm.py

[Frontend][4/n] Improve pooling entrypoints | pooling. (#39153)

2026-04-09 10:09:45 +00:00

coordinator.py

Fix DP coordinator ZMQ port TOCTOU (#37452)

2026-03-20 00:58:31 +00:00

core_client.py

[Core] Change max_model_len in EngineCoreReadyResponse to be non-None (#39442)

2026-04-10 14:34:57 +08:00

core.py

Measure encoder compile time seperate from llm backbone (#39240)

2026-04-14 10:52:49 -04:00

detokenizer.py

[CI] Bump mypy version to 1.19.1 (#36104)

2026-03-10 09:18:28 -07:00

exceptions.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_processor.py

feat(multimodal): support externally processed mm_kwargs with cache injection (#39502)

2026-04-21 11:31:09 +00:00

llm_engine.py

[Frontend][4/n] Improve pooling entrypoints | pooling. (#39153)

2026-04-09 10:09:45 +00:00

logprobs.py

[Bugfix] Fix V1 logprobs empty strings for multi-byte UTF-8 tokens when logprobs > 0 (#34875)

2026-04-08 15:30:00 +00:00

output_processor.py

[Metrics] Add request_id to FinishedRequestStats to enable correlation between metrics and requests (#39710)

2026-04-15 11:24:17 +00:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

tensor_ipc.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Core] Simplify API server handshake (#39364)

2026-04-09 18:56:15 +08:00