littlecircle0730 08985351f3 Fix Stale Encoder Cache After Weight Update (#45093) ...

Signed-off-by: littlecircle0730 <littlecircle0730@gmail.com>

2026-06-18 09:32:10 +00:00

..

__init__.py

[Metrics] Add group-aware KV cache capacity to vllm:cache_config_info (#42206)

2026-06-12 11:49:44 +00:00

async_llm.py

Fix Stale Encoder Cache After Weight Update (#45093)

2026-06-18 09:32:10 +00:00

coordinator.py

[UX] Increase DP Coordinator startup timeout from 30s to 120s (#42343)

2026-05-28 03:31:45 -07:00

core_client.py

[Core][AMD] Propagate shutdown timeout to MultiprocExecutor (#43154)

2026-06-12 15:13:31 -05:00

core.py

[Core] Add prefill step cadence for better non-PD DP balancing (#44558)

2026-06-16 13:17:18 -07:00

detokenizer.py

tokenizer: Add fastokens support (#41741)

2026-05-07 22:49:42 +08:00

exceptions.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_processor.py

[BugFix] Fix blocked reasoning parsing with MRV2 (#43808)

2026-05-28 04:59:34 +00:00

llm_engine.py

[Bugfix][V1] Clean up compiled-model bytecode hooks on VllmRunner exit (#45195)

2026-06-16 20:31:17 -07:00

logprobs.py

[Model Runner V2] Add logprob_token_ids support (#40559)

2026-05-01 10:02:03 -07:00

output_processor.py

[RFC] Replace shared-memory routed experts with ModelRunnerOutput transfer and HTTP support (#39568)

2026-05-14 14:12:30 +00:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

tensor_ipc.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Core][Engine] allow DP ray placement groups to be set on specific nodes (#44669)

2026-06-05 20:07:47 +00:00