YAMAMOTO Takashi 5e35a6f4f9 cpu_model_runner.py: skip the warm up if CompilationMode.NONE (#50547) ...

Signed-off-by: YAMAMOTO Takashi <yamamoto@midokura.com>

2026-08-03 04:34:29 +00:00

..

attention

[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032)

2026-08-02 13:46:55 -07:00

core

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

engine

[Core] Offload raw-prompt preprocessing to renderer thread pool in AsyncLLM (#49608)

2026-08-01 15:10:51 +00:00

executor

[Bugfix] Prevent stale multiproc RPC deadlines from becoming unbounded waits (#41357)

2026-07-29 16:41:34 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[KV Connector] Add per-layer canonical KV page mappings for parallelism-agnostic offload (#48408)

2026-07-31 14:42:54 +03:00

metrics

[Front-end] [Messages] Populate num_cache_creation_tokens (#48535)

2026-07-18 13:04:35 -04:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

Enable gfx1250 ROCm architecture (#46516)

2026-07-31 01:41:12 +00:00

simple_kv_offload

[Bugfix][KV Offload] Propagate EAGLE mode to SimpleCPU coordinator (#49071)

2026-07-20 06:39:11 +00:00

spec_decode

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

structured_output

[Bugfix] Restore structured output logger initialization (#49626)

2026-07-23 11:26:03 -07:00

worker

cpu_model_runner.py: skip the warm up if CompilationMode.NONE (#50547)

2026-08-03 04:34:29 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[Bugfix][TurboQuant] Add KV quant mode for turboquant (#50533)

2026-07-31 17:42:32 +00:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

request.py

[BugFix] Fix num_output_placeholders preemption underflow (#48245)

2026-07-29 06:41:54 -07:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[chore] log process manager shutdown with more details (#49437)

2026-07-31 11:55:09 -07:00