3 people f648eed23d [Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810) ...

Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

2026-09-20 10:58:55 +00:00

..

attention

[Perf][GLM] Fuse the kpool tail slot mapping into one Triton kernel (#57534)

2026-09-20 18:20:55 +08:00

core

[Test][Core] Compute the expected hybrid prefix-cache hit instead of hard-coding it (#57467)

2026-09-20 10:16:12 +08:00

cudagraph

[MM][V2] Enable encoder-only ViT CUDA graph capture (#56922)

2026-09-17 16:12:17 +08:00

determinism

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

distributed

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

e2e

[CI][Bugfix] Correct the Laguna DFlash acceptance-length reference (#57647)

2026-09-19 01:44:48 +00:00

ec_connector

[Feature][EPD] Support dynamic EPD (EC-connector) proxy (#54176)

2026-09-20 12:24:41 +08:00

engine

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

executor

[Bugfix] Release worker RPC payload before next dequeue (#51979)

2026-08-24 07:27:36 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_connector

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

kv_offload

[KV Offloading] Back-pressure detection and remediation (#50045)

2026-09-18 14:47:48 -04:00

logits_processors

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

metrics

[Bugfix][Metrics][MFU] Size activation traffic from the model dtype (#57070)

2026-09-17 00:23:28 +00:00

sample

[Bugfix] Fall back to native sampling when FlashInfer cannot target the GPU (#48956)

2026-09-17 12:27:54 +00:00

shutdown

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

simple_kv_offload

[Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810)

2026-09-20 10:58:55 +00:00

spec_decode

[Perf] Add fused DFlash2 grouped convolution (#55960)

2026-09-17 21:38:59 +00:00

streaming_input

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

structured_output

[Bugfix] Escape control characters in xgrammar choice grammar (#48115)

2026-09-17 15:57:47 +03:00

tracing

[CI] Fix segfault in tracing test (#47299)

2026-07-01 14:00:37 +00:00

worker

[Core][Kernel] Share persistent workspaces for Marlin and Humming (#57421)

2026-09-20 17:28:33 +08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_kv_cache_spec_registry.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_oracle.py

[Docs] Clean up speculators docs (#34065)

2026-02-18 13:48:11 -08:00

test_outputs.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_request.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

test_serial_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_tensor_ipc_queue.py

[CI] Stabilize tensor IPC multiprocessing tests (#50804)

2026-08-12 10:16:43 +08:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00