[CI/Build][Hardware][NVIDIA] Add Rubin CUDA 13.4 nightly images (#55953)

Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
Tyler Michael Smith
2026-09-17 08:05:31 -07:00
committed by GitHub
co-authored by OpenAI Codex OpenAI Codex Misha Goin mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent 3affd35f31
commit 4f9a41ac94
6 changed files with 105 additions and 5 deletions
+2 -1
View File
@@ -177,7 +177,8 @@ def test_incremental_detokenization(
def test_remote_prefill_cached_tokens_override(do_remote_prefill: bool):
"""P/D disaggregation: num_cached_tokens should report the P worker's
cache hits (passed via kv_transfer_params) instead of the local count,
which sees the KVs pulled from the remote prefill as a ~100% hit."""
which sees the KVs pulled from the remote prefill as a ~100% hit.
"""
output_processor = OutputProcessor(tokenizer=None, log_stats=False)
prompt_tokens = [1, 2, 3, 4, 5, 6, 7, 8]