Simon Danielsson 70df48dc3d [Bugfix][KV Cache][GLM-5.3-Flash] Disable slot mapping kernel for the kpool tail buffer (#57317) ...

Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>

2026-09-17 22:42:54 -04:00

..

attention

[Bugfix][KV Cache][GLM-5.3-Flash] Disable slot mapping kernel for the kpool tail buffer (#57317)

2026-09-17 22:42:54 -04:00

core

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

cudagraph

[MM][V2] Enable encoder-only ViT CUDA graph capture (#56922)

2026-09-17 16:12:17 +08:00

determinism

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

distributed

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

e2e

[Perf] Add fused DFlash2 grouped convolution (#55960)

2026-09-17 21:38:59 +00:00

ec_connector

[Bugfix] Use DP index for dense DP weight updates and EC CPU region (#56950)

2026-09-17 22:44:36 +08:00

engine

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

executor

[Bugfix] Release worker RPC payload before next dequeue (#51979)

2026-08-24 07:27:36 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_connector

[CI/Build][Hardware][NVIDIA] Add Rubin CUDA 13.4 nightly images (#55953)

2026-09-17 08:05:31 -07:00

kv_offload

[Bugfix][ROCm][KV Offload] Use private pinned tensors for CPU KV offload (#57160)

2026-09-18 02:35:23 +00:00

logits_processors

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

metrics

[Bugfix][Metrics][MFU] Size activation traffic from the model dtype (#57070)

2026-09-17 00:23:28 +00:00

sample

[Bugfix] Fall back to native sampling when FlashInfer cannot target the GPU (#48956)

2026-09-17 12:27:54 +00:00

shutdown

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

simple_kv_offload

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

spec_decode

[Perf] Add fused DFlash2 grouped convolution (#55960)

2026-09-17 21:38:59 +00:00

streaming_input

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

structured_output

[Bugfix] Escape control characters in xgrammar choice grammar (#48115)

2026-09-17 15:57:47 +03:00

tracing

[CI] Fix segfault in tracing test (#47299)

2026-07-01 14:00:37 +00:00

worker

[Bugfix][KV Cache][GLM-5.3-Flash] Disable slot mapping kernel for the kpool tail buffer (#57317)

2026-09-17 22:42:54 -04:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_kv_cache_spec_registry.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_oracle.py

[Docs] Clean up speculators docs (#34065)

2026-02-18 13:48:11 -08:00

test_outputs.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_request.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

test_serial_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_tensor_ipc_queue.py

[CI] Stabilize tensor IPC multiprocessing tests (#50804)

2026-08-12 10:16:43 +08:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00