Michael Goinandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> e3fe212eaf [Bugfix] Generalize KV block zeroing to AttentionSpec (#51749) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-08-11 12:13:09 -04:00

..

attention

[Bugfix] Take the sliding window from the layer, not the KV cache group (#51756)

2026-08-11 09:10:46 -07:00

core

[Bugfix] Generalize KV block zeroing to AttentionSpec (#51749)

2026-08-11 12:13:09 -04:00

engine

[V1][Metrics] Preserve prefix-cache stats on zero-output steps (#48668)

2026-08-09 01:58:38 +00:00

executor

[ROCm][Bugfix] Use TCP store when AITER custom all-reduce is enabled (#51635)

2026-08-10 11:07:14 +00:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[Bugfix][KV Offload] Centralize shared mmap cleanup in CPU worker (#51622)

2026-08-11 13:22:15 +03:00

metrics

[Migration] Migrate bitsandbytes support to OOT plugin (#43529)

2026-08-09 10:27:31 +08:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

[Perf] Launch the top-k/top-p Triton sampler kernel with 8 warps (#51507)

2026-08-10 10:55:35 -07:00

simple_kv_offload

[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector (#49644)

2026-08-07 15:37:47 +08:00

spec_decode

[BugFix][SpecDecode] Fix dspark parallel_drafting_token_id init bug (#51602)

2026-08-10 13:33:10 -04:00

structured_output

[Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#49227)

2026-08-10 14:29:20 -04:00

worker

[Bugfix] Generalize KV block zeroing to AttentionSpec (#51749)

2026-08-11 12:13:09 -04:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

Add NVFP4 KV 4-over-6 scale search (#45187)

2026-08-07 13:22:27 -07:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[Bugfix][EC Connector] Don't stop an encoder-instance request before its images are encoded (#50275)

2026-08-05 05:53:58 +00:00

request.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Rust Frontend][gRPC] Add explicit data-parallel rank routing (#51178)

2026-08-10 15:05:24 -07:00