Xin Yang 10b7766a90 [Attention] Move context_lens_tensor compute into GDN prefill path (#51913) ...

Signed-off-by: Xin Yang <xyangx@amazon.com>

2026-08-12 15:35:44 +08:00

..

attention

[Attention] Move context_lens_tensor compute into GDN prefill path (#51913)

2026-08-12 15:35:44 +08:00

core

[4/N][KV-Cache Layout Refactor] Promote local KV cache specs via a class-changing replace helper (#51612)

2026-08-11 17:29:29 -04:00

engine

[Bugfix][V1][Multimodal] Recover from P0/P1 processor cache drift (#46747) (#46747)

2026-08-12 12:06:57 +08:00

executor

[ROCm][Bugfix] Use TCP store when AITER custom all-reduce is enabled (#51635)

2026-08-10 11:07:14 +00:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[Bugfix][TieredOffloading] : Return HIT_PENDING when KV promotion is triggered (#51840)

2026-08-12 05:07:16 +03:00

metrics

[Migration] Migrate bitsandbytes support to OOT plugin (#43529)

2026-08-09 10:27:31 +08:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

[Perf] Launch the top-k/top-p Triton sampler kernel with 8 warps (#51507)

2026-08-10 10:55:35 -07:00

simple_kv_offload

[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector (#49644)

2026-08-07 15:37:47 +08:00

spec_decode

[BugFix][SpecDecode] Fix dspark parallel_drafting_token_id init bug (#51602)

2026-08-10 13:33:10 -04:00

structured_output

[Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#49227)

2026-08-10 14:29:20 -04:00

worker

[Refactor][MRV2] Unify uniform decode token count helper (#51917)

2026-08-12 05:58:43 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[4/N][KV-Cache Layout Refactor] Promote local KV cache specs via a class-changing replace helper (#51612)

2026-08-11 17:29:29 -04:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[Bugfix][EC Connector] Don't stop an encoder-instance request before its images are encoded (#50275)

2026-08-05 05:53:58 +00:00

request.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Rust Frontend][gRPC] Add explicit data-parallel rank routing (#51178)

2026-08-10 15:05:24 -07:00