Mathis Felardos b9e41734c5 [Bugfix][Disaggregated] patch the inflight batching on the decode node in SimpleConnector to avoid hangs in SimpleBuffer (nccl based) (#13987) ...

Signed-off-by: Mathis Felardos <mathis@mistral.ai>

2025-02-28 07:53:45 +00:00

..

device_communicators

[Misc] set single whitespace between log sentences (#13771)

2025-02-25 10:26:12 +08:00

kv_transfer

[Bugfix][Disaggregated] patch the inflight batching on the decode node in SimpleConnector to avoid hangs in SimpleBuffer (nccl based) (#13987)

2025-02-28 07:53:45 +00:00

__init__.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

communication_op.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

parallel_state.py

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

2025-02-25 00:38:42 -08:00

utils.py

Improve pipeline partitioning (#13839)

2025-02-25 18:53:56 -08:00