iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nicolò Lucchesiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 589a5b884b [PD][NixlPush][Bugfix] Fix blocking handshake call on writer thread (#49221) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-24 01:41:37 -07:00
Nicolò Lucchesiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2659467497 [CI][PD] Add hybrid SSM P_TP>D_TP accuracy sweep entry (#49593) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-23 22:49:53 +01:00
Nicolò LucchesiandClaude Opus 4.8 5784507da4 [Attention] Allow selecting a different attention backend per KV-cache group (#48012) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-17 15:19:02 -04:00
Nicolò Lucchesi a317bc5739 [Misc][Nixl] Unify _logical_to_remote_kernel_block_ids (#48717) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-16 18:36:25 +08:00
Nicolò LucchesiandClaude 56a357ed33 [Bugfix][KV Cache] Don't route uniform-page-size MLA+SWA models into DeepseekV4 packing (#48256) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-13 08:16:24 +00:00
Nicolò LucchesiClaude Opus 4.8Andreas Karatzas
 		bea70c7cfc [Attention] Make sliding-window support an explicit backend capability (#48011) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-13 01:07:56 -07:00
Nicolò Lucchesi bd3bb4eb26 [Misc][Docs] Add human-readable integer support for more cli-args (#47608) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-08 09:43:34 +00:00
Nicolò Lucchesi 7c67da967f Remove unused _get_kv_cache_config_deepseek_v4 alias (#47969) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-08 01:18:03 -07:00
Nicolò Lucchesi d79855eaac [Docs] kv_sharing_fast_prefill correction (#47044) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-08 01:17:46 -07:00
Nicolò Lucchesi dc148dc4d7 [CI][Bugfix] Fix Hybrid SSM NixlConnector PD prefix cache test (2 GPUs) (#47157) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-06-30 23:14:13 +08:00
Nicolò Lucchesi 06fae69114 [Misc] Mistral label alert (#47132) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-06-30 09:02:07 +00:00
Nicolò Lucchesi 6149187a4c [Kernel] Triton MLA logits workspace (#46819) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-06-29 07:54:29 -07:00
Nicolò Lucchesi a2cb08b3d5 [Misc][PD] Disable bidirectional xfer mode for NixlPushConnector (#46473) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-06-24 21:14:05 +08:00
Nicolò Lucchesi 750aab5b8e [Bugfix] Fix CPU memory leak related to not cleaning up old remotes data (#44424) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-11 07:54:52 -07:00
Nicolò Lucchesi 6690a0c4de [PD][Bugfix] Fix KV Cache sharing with HMA (#44629) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-09 06:10:06 -07:00
Nicolò Lucchesi dab60fc658 [Bugfix][CI] Fix test_offloading_connector.py::test_fs_tiering_offloading (#44903) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-09 00:57:34 -07:00
Nicolò Lucchesi 5add018beb [Connector] Remove P2pNcclConnector (#44854) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-08 18:58:29 +08:00
Nicolò Lucchesi d98b8f371c [NixlConnector] Initiate deprecation cycle for kv_both role (#43874) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-05 11:08:17 +02:00
Nicolò Lucchesi 68f5e565c9 [PD][Nixl] Mamba prefix caching mode support (#42554) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-04 06:41:46 -07:00
Nicolò Lucchesi df7252c343 [CI] Align PD tests to HMA on by default (#44174) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-04 00:04:30 +08:00
Nicolò Lucchesi 7ebc0ec104 [CI] Nixl+SimpleCPUOffloadingConnector unit tests (#43871) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-29 02:40:42 -07:00
Nicolò Lucchesi 5b115bb8a3 [Attention][AMD] Standardize kv layout to blocks first for AMD (#43660) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-28 12:28:50 -05:00
Nicolò Lucchesiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 413ac5c070 [Misc][Rocm] Remove redundant AiterUnifiedAttentionBackend block size log (#43664) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-27 22:19:11 -05:00
Nicolò Lucchesi 716d5294e6 [Misc] Print accuracy value for PD tests even on success (#43583) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-25 02:10:01 -07:00
Nicolò Lucchesi 40651c0207 [Docs][PD][NIXL] Bidirectional kv-cache transfer (#43097) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-20 09:02:36 +02:00
Nicolò Lucchesi 7e4bc2cecb [Docs][PD][NIXL] Lease extension mechanism for blocks on P (#43099) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-20 08:58:25 +02:00
Nicolò LucchesiandNick Hill fba010dd74 [Bugfix][MRV2] Fix KVCache tensor explicit kernel_block_size dim (#42766) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-05-18 20:25:41 -07:00
Nicolò Lucchesi 69c91d010a [MRv2] Default to MRv1 when a connector is present (#42955) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-18 20:34:16 +08:00
Nicolò Lucchesi 71bcd02ef3 [Bugfix][PD] Fix multi-node TP (TP>8) (#39907) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-12 22:20:57 -07:00
Nicolò Lucchesi 5672d100ed [KV Connector][NIXL][Bugfix] Fix NIXL handshake failures not honoring kv_load_failure_policy (#40364) 
When NIXL handshake fails (e.g., due to compatibility hash mismatch
between prefill and decode instances), requests fail with "engine dead"
error instead of gracefully falling back to local recomputation as configured
by kv_load_failure_policy='recompute'.

Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-11 09:37:21 +00:00
Nicolò Lucchesi 770e9bd6b3 [Nixl][PD] Lease renewal TTL KV blocks on P (#41383) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-11 09:27:30 +00:00
Nicolò LucchesiandZhanqiuHu 171d59ae8d [Bugfix][PD] Fix DSv4 Disaggregated (#41957) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: ZhanqiuHu <zhu@redhat.com>
 2026-05-09 16:48:24 +00:00
Nicolò Lucchesi 9d6500b89d [Misc] Delay EPLB Nixl import until needed (#41805) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-07 09:43:07 -07:00
Nicolò Lucchesi e43a791284 [Bugfix][CI] Fix Disaggregated test area path (#41794) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-05-06 17:41:24 +08:00
Nicolò Lucchesi efdc95674d [KVConnector] MultiConnector SupportsHMA (#39571) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-30 02:10:50 -07:00
Nicolò Lucchesi 8824f50f1f [CI] Split disaggregated tests into own test-area (#40623) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-23 23:20:12 +08:00
Nicolò Lucchesi 9c2492e501 [Misc] Support Human-readable (k/K/m/M..) json cli arg (#40473) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-23 09:42:23 +02:00
Nicolò Lucchesi 33ef1941e2 [Bugfix][CI] Fix v1/kv_connector/unit/test_nixl_connector_hma.py::test_fewer_blocks_with_hma (#40597) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-22 14:21:02 +01:00
Nicolò Lucchesi 304d5ba1a0 [Bugfix][CI] Fix tests/distributed/test_torchrun_example_moe.py (#40349) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-20 11:05:44 -07:00
Nicolò Lucchesi 3daca38e22 [Misc] toy_proxy_server handle min_tokens (#39706) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-16 15:08:22 +00:00
Nicolò Lucchesi 9965f501a8 [Nixl] Bump Nixl version to 0.10.1 (#39922) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-16 11:53:21 +01:00
Nicolò Lucchesi 8625ec267b [Misc] Multi-turn benchmark output performance json (#39572) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-13 18:15:23 +00:00
Nicolò Lucchesi 3244a2ebf2 [KVConnector][NIXL] Organize NIXL connector into its own directory (#39354) 
The number of features supported by the connector has grown substantially
and the `nixl_connector.py` file has accumulated a lot of code. Creates a separate
directory and isolates connector/scheduler code in the hope of improving clarity
and maintainability.

Further refactor of components aimed at improving clarity and simplifying code
will follow soon.

Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-12 13:10:50 +00:00
Nicolò Lucchesi c9dddc144b [CI] Add Nixl+OffloadingConnector e2e integration tests (#39200) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-10 21:40:40 +08:00
Nicolò Lucchesi 97f92c6b47 [KVConnector] Skip register_kv_caches on profiling (#38558) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-03 15:40:16 +00:00
Nicolò Lucchesi 66e86f1dbd [Kernel] Mamba support different layout for Conv state (#37416) 2026-04-03 01:50:09 +02:00
Nicolò Lucchesi 7337ff7f03 [Docs] PD with Nixl compat matrix (#38628) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-31 15:01:21 +00:00
Nicolò Lucchesi 7430389669 [Bugfix][CI] Skip flaky test_eagle test (#38566) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-31 09:42:37 -04:00
Nicolò Lucchesi cc06b4e86b [Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-30 09:41:50 +00:00
Nicolò Lucchesi 44a6528028 [CI] Skip failing test (#38369) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-27 13:25:19 -07:00
Nicolò Lucchesi 1cbbcfe8a3 [CI][PD] Add Hybrid SSM integration tests to CI (#37657) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-23 23:58:19 +08:00
Nicolò Lucchesi f5c081d432 [PD][Nixl] Add support for hybrid SSM-FA models (#36687) 2026-03-16 19:58:06 +01:00
Nicolò Lucchesi 098d844731 [NIXL][1/N] Refactor kernel_block_size detection (#35752) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-11 01:11:23 -07:00
Nicolò Lucchesi 5b3ba94ab4 [Core][KVConnector] Support HMA+NixlConnector (#35758) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-06 08:51:21 +01:00
Nicolò Lucchesi 18e01a0a10 [Misc] Add --attention-backend auto option (#35738) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-04 15:12:27 +00:00
Nicolò Lucchesi c212202d93 [Misc] Bound NIXL upper bound version (#35495) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-02 16:57:07 +08:00
Nicolò Lucchesi cabdaa7619 [Misc] Move GPUModelRunner.prepare_kernel_block_sizes to utils (#35400) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-27 11:42:51 +08:00
Nicolò Lucchesi f91808ae0d [MM] Allow audio chunking for offline LLM (#34628) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-23 21:04:28 -08:00
Nicolò Lucchesi b8d8b7e934 [Misc] Monitor interface changes (#35113) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-23 17:14:51 +00:00
Nicolò LucchesiandCyrus Leung ab6f3487a6 [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-21 01:34:57 -08:00
Nicolò Lucchesi 8e962fef5f [CI][Nixl] Add CrossLayer KV layout tests (#34615) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-17 21:35:40 +08:00
Nicolò Lucchesi 6cc403e67d [Bugfix][CI] Fix flaky entrypoints/openai/test_response_api_with_harmony.py::test_function_calling[openai/gpt-oss-20b] (#34624) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-16 16:11:07 +00:00
Nicolò Lucchesi 334c715e0f [Docs] Spec decoding docs warning removal (#34439) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-12 09:01:51 -08:00
Nicolò Lucchesi 55aeec04f5 [Bugfix] Fix Whisper tokenization (#34011) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-07 10:42:52 +08:00
Nicolò Lucchesi 20f5d185a6 [Misc] Rename translations to speech_to_text for OAI serving component (#33904) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-05 19:16:52 +00:00
Nicolò Lucchesi 7d8c6804e2 [Misc] Add debug logs (#33931) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-05 09:42:40 -08:00
Nicolò Lucchesi 81a90e5277 [Docs] Add bart-plugin to docs (#33905) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-05 12:20:25 +00:00
Nicolò Lucchesi 528b3076af [CI][Bugfix] Fix flaky tests/v1/kv_connector/unit/test_multi_connector.py::test_multi_example_connector_consistency (#33555) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-02 03:01:29 -08:00
Nicolò Lucchesi e77f162cf5 [Bugfix] Fix Qwen3ASR language asr tag in output (#33410) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-31 05:24:49 +00:00
Nicolò Lucchesi 8ece60768f [CI] Qwen3-ASR transcriptios tests (#33414) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-30 16:17:56 +00:00
Nicolò Lucchesi 8ebf372e9d [CI] Whisper tests enforce_eager=False (#33098) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-28 09:36:56 -08:00
Nicolò Lucchesi 492a7983dd [Bugfix] Fix DeepseekV32 AssertionError: num_kv_heads == 1 (#33090) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-27 15:03:20 +00:00
Nicolò Lucchesi 1f3a2c2944 [Bugfix] Disable CG for Whisper+FA2 (#33164) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-27 21:46:51 +08:00
Nicolò Lucchesi 19ab0f7ce5 [Bugfix] Fix Voxtral streaming slot_mapping (#33073) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-26 10:40:40 -08:00
Nicolò Lucchesi 7e22309755 [Misc] Postpone torch_profiler deprecation (#32867) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-23 14:39:48 +00:00
Nicolò Lucchesi 160c6fa387 [Misc] Add get_name to missing AttentionBackends (#32698) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-23 10:35:44 +00:00
Nicolò Lucchesi ea6102b85d [Bugfix] Fix Whisper/encoder-decoder GPU memory leak (#32789) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-22 10:50:37 +00:00
Nicolò Lucchesi 758df5afe7 [NIXL][Metrics] Track nixl_num_kv_expired_reqs metric in Prometheus (#32340) 
Add a new metric to track the number of requests that had their KV blocks
expire. The scenario is particularly important to surface and track as it is a
vital indicator of the health of the deployment.

Currently we're resorting to track these failures through unstructured log
parsing (which is, among other thing, error string dependent); current main:

> Releasing expired KV blocks for request cmpl-071d which were retrieved by 0 decode worker(s) within 0 seconds.

Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-19 12:28:27 +00:00
Nicolò Lucchesi 74c583bc50 [Core] Whisper support torch.compile (#30385) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-19 10:02:31 +00:00
Nicolò Lucchesi 8c8653b672 [Docs] Nixl Usage recommend fail kv_load_failure_policy (#32198) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-13 12:51:57 +00:00
Nicolò Lucchesi f8bd8394e3 [NIXL][Bugfix] Failure logging overhaul + early metadata free on failure (#32031) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-12 20:38:49 +00:00
Nicolò Lucchesi 08e8e99ce7 [Misc] Change log level for batch queue log (#32192) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-12 18:59:31 +00:00
Nicolò Lucchesi 5b68107411 [Misc][PD] Fix get_attn_backend usage in transfer connectors (#31988) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-12 18:10:05 +01:00
Nicolò Lucchesi 22970c1626 [Misc] Disable default --ready-check-timeout-sec extra call in vllm bench (#30975) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-12 01:58:21 -08:00
Nicolò Lucchesi 83e1c76dbe [CI][ROCm] Fix NIXL tests on ROCm (#31728) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-09 01:34:43 +08:00
Nicolò Lucchesi ab1af6aa3e [CI][NIXL] Split DPEP tests (#31491) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-30 07:26:12 -05:00
Nicolò Lucchesi b1c3f96ae3 [CI][Bugfix] Fix entrypoints/openai/test_audio.py (#31151) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-22 07:21:40 -08:00
Nicolò Lucchesi bc3700e0cd [NIXL] Support P tensor-parallel-size > D tensor-parallel-size (#27274) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-18 11:53:30 +08:00
Nicolò Lucchesi 9ca8cb38fd [CI][Bugfix] Fix flaky tests/entrypoints/openai/test_audio.py::test_chat_streaming_audio (#30878) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-17 18:49:56 +01:00
Nicolò LucchesiandCyrus Leung e087fbc393 [MM] Pass FA version in ViT Attn (#30756) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-17 07:54:45 +08:00
Nicolò Lucchesi ca702a14dc [Frontend] Add max-completion-token option to transcription/translation endpoints (#30769) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-16 19:36:49 +00:00
Nicolò Lucchesi 75eb302a2e [Bugfix] Whisper fix number of allocated CrossAttn blocks per-request (#30772) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-16 14:20:19 +00:00
Nicolò Lucchesi 185c22bf2f [Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator + KV cache connector (#29805) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-15 11:17:58 +00:00
Nicolò Lucchesi 57e9bf1864 [CI] Whisper logprobs tests (#30504) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-13 10:49:11 +08:00
Nicolò Lucchesi 0efd9f867c [Core] Whisper Enable Encoder Batching (#29421) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-11 21:06:51 +00:00
Nicolò Lucchesi c756fb6781 [Core] Whisper enable FULL_DECODE_ONLY CudaGraph (#30072) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-10 06:14:24 -08:00
Nicolò Lucchesi e23ca3a0e8 [CI] Re-use whisper_client for all tests (#30148) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-05 19:47:37 +00:00
Nicolò Lucchesi bff78310d9 [Enc-Dec] Fix OOT tokenizer issue (#30144) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-05 19:23:33 +00:00
Nicolò LucchesiandCyrus Leung 78c44fd722 [NIXL] Small cleanup of unused variables (#29618) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-05 18:17:36 +01:00
Nicolò Lucchesi e5a621b724 [CI] Add batched audios Whisper test (#29308) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-11-27 19:31:52 +00:00