3 people b3a87b2d04 [Bugfix][KVConnector] Finalize saves on steps without a forward (#57775) ...

Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>

2026-09-25 00:06:36 +00:00

..

attention

[Perf][Attention] Bound FlashInfer prefill dequantization scratch (#57918)

2026-09-24 10:42:08 -04:00

core

[Bugfix][Mamba] Restore prompt-tail prefix-cache hits with MTP (#58368)

2026-09-24 23:46:42 +00:00

cudagraph

[Bugfix] Capture prefill kernels for mixed FULL graphs (#58275)

2026-09-24 02:05:07 -07:00

determinism

[Test][Determinism] Cover chunked prefill in the batch-invariance suite (#55612)

2026-09-23 21:21:56 -04:00

distributed

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

e2e

[Bugfix][CI] Fix the flaky sharded-sampling tests, and the engine teardown need (#58342)

2026-09-24 02:05:11 -07:00

ec_connector

[EPD] Support metadata-only audio inputs (#57887)

2026-09-23 09:03:50 +08:00

engine

[Core] structured generation mode for DiffusionGemma model (Jev-like) (#57250)

2026-09-22 20:51:17 +00:00

executor

[AuxOutput] Add block-keyed storage for routed-expert outputs (#45635)

2026-09-21 10:25:05 +00:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_connector

[Bugfix][KVConnector] Finalize saves on steps without a forward (#57775)

2026-09-25 00:06:36 +00:00

kv_offload

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

logits_processors

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

metrics

[Bugfix][Metrics][MFU] Size activation traffic from the model dtype (#57070)

2026-09-17 00:23:28 +00:00

sample

[Perf] DiffusionGemma: constrained reads over the request's logprob_token_ids (#58216)

2026-09-24 13:15:08 -07:00

shutdown

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

simple_kv_offload

[Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810)

2026-09-20 10:58:55 +00:00

spec_decode

[Cleanup] Remove online quantization support in fp8.py in favor of online shorthands (#53585)

2026-09-24 12:48:14 -07:00

streaming_input

[MM] Move supports_multimodal_inputs and cache out of registry (#57913)

2026-09-21 07:43:07 -07:00

structured_output

[Bugfix][Outlines] Fix EOS termination and unconstrained masks after rejected drafts (#58612)

2026-09-24 21:55:56 +00:00

tracing

[CI] Fix segfault in tracing test (#47299)

2026-07-01 14:00:37 +00:00

worker

[Bugfix][KVConnector] Finalize saves on steps without a forward (#57775)

2026-09-25 00:06:36 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_kv_cache_spec_registry.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_oracle.py

[Docs] Clean up speculators docs (#34065)

2026-02-18 13:48:11 -08:00

test_outputs.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_request.py

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

test_serial_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_tensor_ipc_queue.py

[CI] Stabilize tensor IPC multiprocessing tests (#50804)

2026-08-12 10:16:43 +08:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00