[Bugfix][NIXL] Fix _logical_to_kernel_block_ids conversion for non-mamba models (#39724)

Signed-off-by: Zhanqiu Hu <zhu@redhat.com>
This commit is contained in:
zhanqiuhu
2026-04-15 20:08:58 +00:00
committed by GitHub
parent 102d51c9f3
commit 41488f2acd
2 changed files with 97 additions and 0 deletions
@@ -1914,6 +1914,10 @@ class NixlConnectorWorker:
meta.remote.block_ids,
self._mamba_phys_ratio[meta.remote.engine_id],
)
else:
meta.remote.block_ids = self._logical_to_kernel_block_ids(
meta.remote.block_ids
)
# D may have to perform multiple reads from different remote ranks.
for i, remote_rank in enumerate(remote_ranks):
if self.use_mla and tp_ratio < 0 and i > 0: