[Bugfix][NIXL] Include transfer mode (push/pull) in the compatibility hash (#50620)

Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Tzu-Ling Kan
2026-08-14 12:11:22 +08:00
committed by GitHub
co-authored by Claude Opus 4.8
parent c05d75aaa9
commit 653cc6faca
8 changed files with 76 additions and 3 deletions
@@ -82,6 +82,8 @@ By default, a **compatibility hash** is checked during handshake. P and D instan
- Attention backend
- KV cache dtype (`cache_dtype`)
- EAGLE/MTP-style speculative method and draft-model configuration
- NIXL transfer mode (push vs pull) — a push (WRITE) connector and a pull (READ)
connector use incompatible transfer protocols and must never be paired
!!! warning
Disable the hash check with `--kv-transfer-config '{"kv_connector_extra_config": {"enforce_handshake_compat": false}}'` at your own risk.