Connor CarpenterandNick Hill f473870ecf [Rust Frontend][gRPC] Add RL lifecycle control (#51316) ...

Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-08-14 11:32:39 -07:00

..

attention

[ROCm][AMD] Enable preshuffled sparse indexing for 16-token blocks (#51216)

2026-08-14 12:38:14 -05:00

core

[5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec (#51704)

2026-08-14 09:47:55 -04:00

engine

[Rust Frontend][gRPC] Add RL lifecycle control (#51316)

2026-08-14 11:32:39 -07:00

executor

[Rust Frontend][gRPC] Add RL lifecycle control (#51316)

2026-08-14 11:32:39 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[KV Offload] Expose data-parallel topology to offloading backends (#51879)

2026-08-12 20:27:26 -07:00

metrics

[Migration] Migrate bitsandbytes support to OOT plugin (#43529)

2026-08-09 10:27:31 +08:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

[Perf] Launch the top-k/top-p Triton sampler kernel with 8 warps (#51507)

2026-08-10 10:55:35 -07:00

simple_kv_offload

[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector (#49644)

2026-08-07 15:37:47 +08:00

spec_decode

Add Muse Glimmer model support (#51655)

2026-08-14 12:28:56 +08:00

structured_output

[Bugfix] Reject NUL byte in structured_outputs.regex (#51796)

2026-08-14 00:08:36 +00:00

worker

[Rust Frontend][gRPC] Add RL lifecycle control (#51316)

2026-08-14 11:32:39 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec (#51704)

2026-08-14 09:47:55 -04:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[Feature] Mask Replay (#49577)

2026-08-13 08:44:31 +00:00

request.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Rust Frontend][gRPC] Add explicit data-parallel rank routing (#51178)

2026-08-10 15:05:24 -07:00