3 people 7314360c9e [Perf][PP] Skip sampled-token broadcasts whose requests leave the engine (#58542) ...

Signed-off-by: LostFox11 <wangziyue17@huawei.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: LostFox11 <wangziyue17@huawei.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-09-30 19:18:55 -07:00

..

attention

[Mamba] Add FlashInfer ReplaySSM support for MTP (#52928)

2026-09-30 21:41:17 +00:00

core

[Core] Include the LoRA path in prefix-cache block hashes (#59335)

2026-10-01 08:37:09 +08:00

cudagraph

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

determinism

[MyPy][2/N] Fix mypy errors in small tests/ dirs (#51043)

2026-09-29 21:27:45 +01:00

distributed

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

e2e

[CI][Spec Decode] Add async scheduling accuracy tests (#55840)

2026-10-01 01:06:24 +00:00

ec_connector

[EPD] Support metadata-only audio inputs (#57887)

2026-09-23 09:03:50 +08:00

engine

[Metrics] Add --custom-histogram-buckets to override histogram bucket families (#48867)

2026-10-01 01:03:39 +00:00

executor

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_connector

[CI] Deflake the multi-API-server metrics test and Mooncake PD ports (#59507)

2026-09-30 17:22:58 -07:00

kv_offload

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

logits_processors

[MyPy][3/N] Fix MyPy errors in test groups (part 3) (#55939)

2026-09-30 11:06:07 +00:00

metrics

[Metrics] Add --custom-histogram-buckets to override histogram bucket families (#48867)

2026-10-01 01:03:39 +00:00

sample

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

shutdown

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

simple_kv_offload

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

spec_decode

[Bugfix] Don't let a structured-output request sample from an unmasked row (#54442)

2026-10-01 02:11:44 +00:00

streaming_input

[Bugfix][Scheduler] Refresh max tokens for streaming continuations (#57676)

2026-09-28 20:31:57 +00:00

structured_output

Disable mypy arg-type and assignment checks in tests (#59428)

2026-09-30 15:18:50 +00:00

tracing

[CI] Fix segfault in tracing test (#47299)

2026-07-01 14:00:37 +00:00

worker

[Perf][PP] Skip sampled-token broadcasts whose requests leave the engine (#58542)

2026-09-30 19:18:55 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_kv_cache_spec_registry.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_oracle.py

[Docs] Clean up speculators docs (#34065)

2026-02-18 13:48:11 -08:00

test_outputs.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_request.py

[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)

2026-09-21 09:56:11 -07:00

test_serial_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_tensor_ipc_queue.py

[CI] Stabilize tensor IPC multiprocessing tests (#50804)

2026-08-12 10:16:43 +08:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00