Nick Hill 234df712ed [MRV2] Minor model_runner.py code cleanup (#58610) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-09-25 07:59:27 -07:00

..

attention

[Bugfix][KV Cache][MLA] Align packed block strides for V3.2 sparse MLA (#55528)

2026-09-25 05:33:36 +00:00

core

[Bugfix][KV Cache][MLA] Align packed block strides for V3.2 sparse MLA (#55528)

2026-09-25 05:33:36 +00:00

cudagraph

[Bugfix] Capture prefill kernels for mixed FULL graphs (#58275)

2026-09-24 02:05:07 -07:00

determinism

[Test][Determinism] Cover chunked prefill in the batch-invariance suite (#55612)

2026-09-23 21:21:56 -04:00

distributed

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

e2e

[Bugfix][CI] Fix the flaky sharded-sampling tests, and the engine teardown need (#58342)

2026-09-24 02:05:11 -07:00

ec_connector

[EPD] Support metadata-only audio inputs (#57887)

2026-09-23 09:03:50 +08:00

engine

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

executor

[AuxOutput] Add block-keyed storage for routed-expert outputs (#45635)

2026-09-21 10:25:05 +00:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_connector

[ROCm] Fix CI runtime and tests for MI355 DPX (#58244)

2026-09-24 23:15:11 -05:00

kv_offload

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

logits_processors

[Bugfix][LogitsProcessor] Validate ':' separator in custom logits processor FQCN (#56020)

2026-09-25 01:49:20 +00:00

metrics

[ROCm] Fix CI runtime and tests for MI355 DPX (#58244)

2026-09-24 23:15:11 -05:00

sample

[Perf] DiffusionGemma: constrained reads over the request's logprob_token_ids (#58216)

2026-09-24 13:15:08 -07:00

shutdown

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

simple_kv_offload

[Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810)

2026-09-20 10:58:55 +00:00

spec_decode

[SpecDecode] Add LiLiCorr drafter (#57934)

2026-09-25 10:08:28 -04:00

streaming_input

[MM] Move supports_multimodal_inputs and cache out of registry (#57913)

2026-09-21 07:43:07 -07:00

structured_output

[Structured Outputs] Parse Lark grammars natively in the xgrammar backend (#58321)

2026-09-25 04:35:10 +00:00

tracing

[CI] Fix segfault in tracing test (#47299)

2026-07-01 14:00:37 +00:00

worker

[MRV2] Minor model_runner.py code cleanup (#58610)

2026-09-25 07:59:27 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_kv_cache_spec_registry.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_oracle.py

[Docs] Clean up speculators docs (#34065)

2026-02-18 13:48:11 -08:00

test_outputs.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_request.py

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

test_serial_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_tensor_ipc_queue.py

[CI] Stabilize tensor IPC multiprocessing tests (#50804)

2026-08-12 10:16:43 +08:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00