3 people 654bd2bca4 [Bugfix] Sync block_size from EngineCore to frontend for hybrid Mamba… (#42967) ...

Signed-off-by: Amit Gruner <agruner@crusoe.ai>
Co-authored-by: Amit Gruner <agruner@crusoe.ai>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

2026-06-02 13:41:00 +00:00

..

attention

[ROCm] Add attention sink support to AITer flash attention backend (#43817)

2026-05-30 18:13:18 +08:00

core

[EC Connector] Non blocking EC Connector lookup (#41627)

2026-06-02 08:48:25 +00:00

engine

[Bugfix] Sync block_size from EngineCore to frontend for hybrid Mamba… (#42967)

2026-06-02 13:41:00 +00:00

executor

[Feat] Add support for per GPU worker RDMA NIC selection (#42083)

2026-05-28 12:45:23 -07:00

kv_offload

[KV Offload] Add on_schedule_end() hook to separate step lifecycle from event draining (#44206)

2026-06-02 13:42:52 +03:00

metrics

[Metrics] Exclude KV transfer tokens from iteration_tokens_total (#43346)

2026-05-29 19:56:44 +00:00

pool

[Misc] Added missing return type annotations to improve mypy and IDE tooling (#43383)

2026-05-23 13:28:22 +08:00

sample

[CPU Backend] CPU top-k and top-p sampling kernels using Triton (#43633)

2026-05-29 15:02:39 +08:00

simple_kv_offload

[Core][Refactor]: thread scheduler_block_size into KVCacheManager and KVCacheCoordinator (#44165)

2026-06-02 01:14:44 -07:00

spec_decode

[Model]Support Step-3.7-Flash (#43859)

2026-05-28 17:01:48 -07:00

structured_output

[Bug][Structured Outputs] Fix bug that leads to unconstrained generations with structural tags (#42452)

2026-05-20 07:08:58 -07:00

worker

Fix DFlash prefix cache corruption due to missing lookahead block (#42971)

2026-06-02 12:06:33 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Experimental] Breakable CUDA graph (#42304)

2026-05-16 22:04:12 +08:00

kv_cache_interface.py

[Bugfix][Hybrid][NemotronH] Fix mamba_cache_mode=all + speculative decoding crash (#41233)

2026-05-18 14:54:00 +03:00

outputs.py

[Core] Cleanup KVConnector handling with PP + fix MRV2 (#43732)

2026-05-28 13:12:03 -07:00

request.py

[bug] AsyncScheduler drops first post-resume token after pause_generation + clear_cache (#42117)

2026-05-19 01:06:21 -07:00

serial_utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Bug] Fix tests/distributed/test_elastic_ep.py - assert False (#43813)

2026-05-28 11:00:56 -04:00