siyuandIsotr0py c723a831a8 [Fast Start] Cache the MTP draft model in a separate daemon group (#57312) ...

Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>

2026-09-22 03:13:38 +00:00

..

attention

[Bugfix][GDN] Fix stateless first-chunk classification (#51565)

2026-09-22 09:11:49 +08:00

core

[Bugfix] Annotate MTP draft KV cache groups positionally on the hybrid grouping path (#55390)

2026-09-22 00:31:26 +00:00

cudagraph

[MM][V2] Enable encoder-only ViT CUDA graph capture (#56922)

2026-09-17 16:12:17 +08:00

determinism

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

distributed

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

e2e

[Scheduler] Soften Long Prefill Tokens Threshhold (#57951)

2026-09-21 17:19:42 -07:00

ec_connector

[Feature][EPD] Support dynamic EPD (EC-connector) proxy (#54176)

2026-09-20 12:24:41 +08:00

engine

[Bugfix] Fix external LB DP rank handling when replicas share nodes (#53743)

2026-09-21 17:19:14 +02:00

executor

[AuxOutput] Add block-keyed storage for routed-expert outputs (#45635)

2026-09-21 10:25:05 +00:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_connector

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

kv_offload

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

logits_processors

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

metrics

[Bugfix][Metrics][MFU] Size activation traffic from the model dtype (#57070)

2026-09-17 00:23:28 +00:00

sample

[Bugfix] Fall back to native sampling when FlashInfer cannot target the GPU (#48956)

2026-09-17 12:27:54 +00:00

shutdown

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

simple_kv_offload

[Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810)

2026-09-20 10:58:55 +00:00

spec_decode

[Fast Start] Cache the MTP draft model in a separate daemon group (#57312)

2026-09-22 03:13:38 +00:00

streaming_input

[MM] Move supports_multimodal_inputs and cache out of registry (#57913)

2026-09-21 07:43:07 -07:00

structured_output

[Test] Organize structured output utility tests (#57545)

2026-09-21 13:56:28 +03:00

tracing

[CI] Fix segfault in tracing test (#47299)

2026-07-01 14:00:37 +00:00

worker

[MM] Move supports_multimodal_inputs and cache out of registry (#57913)

2026-09-21 07:43:07 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_kv_cache_spec_registry.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_oracle.py

[Docs] Clean up speculators docs (#34065)

2026-02-18 13:48:11 -08:00

test_outputs.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_request.py

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

test_serial_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_tensor_ipc_queue.py

[CI] Stabilize tensor IPC multiprocessing tests (#50804)

2026-08-12 10:16:43 +08:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00