iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,297 Commits 3 Branches 0 Tags
main
Commit Graph
95 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Micah WilliamsonandCursor a0e7137c4b [CI][ROCm][Bugfix] DeepSeek V4.1: don't pass expert intermediate padding to AITER (#61960) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-10-17 04:25:39 +00:00
Micah Williamson e8e1e96196 [ROCm][DSv4] AITER MegaMoE Fixed-Slot Dispatch For DeepSeek-V4 (#61262) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-10-15 19:10:59 +08:00
Micah Williamson a4d553a46a Revert "[Build] Update deep_gemm git tag for locality_domain update" (#61703) 2026-10-14 14:57:44 -07:00
Micah WilliamsonandFangzhou Ai f6e3944e31 [ROCm][DSv4] AITER MegaMoEV2 Integration For DeepSeek V4 (#59685) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
 2026-10-07 09:35:53 -05:00
Micah WilliamsonandKevin H. Luu 13f8c453ee [CI][Releases] Trigger perf-eval Through Release Pipeline (#52213) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-10-06 18:27:27 -07:00
Micah WilliamsonandFangzhou Ai ac8c2130a8 [ROCm] Bump AITER to 0.1.24.post1 (#59794) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
 2026-10-05 00:19:19 -04:00
Micah Williamson b0d2b854f6 [ROCm]Keep LMCache OpenTelemetry on the image's 1.40 stack (#59056) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-28 15:49:48 +00:00
Micah Williamson 468663a5e5 [ROCm] Bump AITER to v0.1.22.post1 (#56885) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-18 18:36:45 -07:00
Micah WilliamsonandAndreas Karatzas d5f0a6e829 [Bugfix][DBO] Fix DeepEP low-latency profiling crash with DP+EP+DBO (#57502) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-09-18 06:33:41 +00:00
Micah Williamson bbaa1b9340 [ROCm][CI] Extend timeout for Basic Models (other) (#56522) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-11 22:11:59 +00:00
Micah Williamson a9271c750f [ROCm][CI] Accept base-v2-preview images during content hash lookup for ROCm base images (#56356) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-11 02:30:39 -05:00
Micah Williamson 7de70fa7ae [Bugfix][ROCm] Create linear layer biases with requires_grad=False (#56161) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-10 13:54:52 -05:00
Micah WilliamsonandFangzhou Ai 4e990dfcec [ROCm] Bump AITER to v0.1.21.post2 (#55968) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
 2026-09-09 07:49:59 -07:00
Micah Williamson e3e1241003 [ROCm][CI] Extend Multimodal Processor Shard timeout on AMD CI (#55011) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-02 21:11:46 +00:00
Micah Williamson ce6a283c09 [Bugfix] Restore weight_dtype in QuarkW8A8Fp8MoEMethod to fix GPT-OSS FP8 MoE weight loading (#54824) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-09-01 16:08:11 -05:00
Micah WilliamsonAndreas KaratzasAndreas Karatzas
 		fbb4c04db4 [ROCm][CI] Speed up test_rocm_aiter_qk_norm_rope_kvcache_fusion (#53004) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-08-19 21:20:21 -05:00
Micah Williamson 8878ebd8fd [ROCm][CI] Expand AITER W4A4 MoE Coverage (#52647) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-08-17 15:46:22 -05:00
Micah WilliamsonandAndreas Karatzas 045a986f3b [ROCm][CI] Speed Up ROCm Skinny GEMM Tests (reduced parameterizations, (#51877) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-12 01:40:13 +00:00
Micah WilliamsonandAndreas Karatzas 4282fe52d5 [ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-05 21:27:33 +00:00
Micah Williamson 67fe73b2b4 [CI] Extend max-model-len for test_parsable_context to allow reasoning to finish (#48873) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-07-17 11:36:44 +08:00
Micah Williamson 7dc2698632 [ROCm][CI] Set "highest" matmul precision for reference hf_runner in test_bert_for_masked_lm (#48784) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-07-16 05:49:15 +00:00
Micah WilliamsonandAndreas Karatzas 49e777cf08 [CI][ROCm] Retry failed Docker build steps once (#48773) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-15 14:31:23 -05:00
Micah WilliamsonAndreas Karatzasfxmarty-amdAndreas Karatzas
 		6e073440b1 [ROCm][CI] Remove mxfp4 test skips after amd-quark 0.12 release (#47330) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-15 01:25:05 +00:00
Micah Williamson 0f0f28b537 [Bugfix][CI] Fix test_head_dtype quant_method test on ROCm (#48654) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-07-14 18:31:36 -05:00
Micah Williamson 18c4067a54 [ROCm][CI] Unblock AMD: Language Models Test (Extended Pooling) (#48513) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-07-13 18:38:10 +00:00
Micah Williamson 766469a4c4 [ROCm] Revert Part of [ROCm] Fix pooling startup workspace lock #47912 (#48154) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-07-09 20:34:24 +00:00
Micah WilliamsonandAndreas Karatzas dd5c299fbe [ROCm][Bugfix] Convert ModelOpt FP8 per-channel weights to e4m3fnuz on MI300/MI325 (#47201) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-06 23:24:58 -07:00
Micah Williamson b446792306 [ROCm][Bugfix] Fix Triton "out of resource: shared memory" Error In One-Shot LoRA MoE (#47209) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-30 23:24:36 -07:00
Micah Williamson c3b1f9e827 [ROCm][CI] Enable LoRA TP Distributed Test Group In AMD CI (#47193) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-30 23:24:32 -07:00
Micah Williamson ebcf511ec3 [ROCm][CI] Soft Fail Spec Decode Ngram + Suffix and Entrypoints Integration (LLM) AMD Mirrors (#47067) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-29 16:24:08 -05:00
Micah WilliamsonMatthew WongAndreas Karatzas
 		c2127a25c7 [ROCm][CI] Fix rlhf_async_new_apis Example On ROCm (#46895) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-28 12:50:30 -05:00
Micah Williamson 274325dd43 [ROCm][CI] Remove V1 Sample + Logits from mi250 Queue (#46867) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-26 15:38:38 -05:00
Micah WilliamsonandRohan138 d980a3cc6e [ROCm] Fix AITER_UNIFIED_ATTN Dispatching After AITER Bump (#46780) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Rohan138 <rohanpotdar138@gmail.com>
 2026-06-26 02:09:56 -07:00
Micah WilliamsonAndreas Karatzasmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		710ebaa189 [ROCm][Bugfix] Fix chunk alignment when using context parallelism with TRITON_MLA (#46114) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-25 00:07:28 -04:00
Micah WilliamsonandAndreas Karatzas 6e3a983cf3 [ROCm] Remove erroneous inclusion of gptq_marlin as supported quant scheme on ROCm (#46655) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-24 21:27:19 -05:00
Micah Williamson d6696e2385 [ROCm] Begin Deprecation Window for CUDA_VISIBLE_DEVICES on ROCm (#46636) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-24 20:40:28 +00:00
Micah WilliamsonandMatthew Wong b3a688cb9e [ROCm] Fix OOB During Model Warmup With ROCM_ATTN and MRV2 (#46548) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-06-24 10:53:21 -05:00
Micah Williamsonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> e2bdc24612 [ROCm][Bugfix] Fix use_v2_model_runner inside Ray driver thread (#45998) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-24 08:41:56 +08:00
Micah Williamson b28103e1ca [ROCm][CI] Shard LM Eval Qwen3-5 Models (B200-MI355) in AMD CI (#46520) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-23 16:32:05 -05:00
Micah Williamson 156b12667c [ROCm][CI] Skip Quark mxfp4 tests unless Quark version is compatible with Torch version (#46431) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-23 22:26:39 +08:00
Micah Williamson fa36f86d77 [CI] Torch 2.11 flaky test_spec_decode_logprobs and gritlm tests (#45772) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-23 01:26:54 +00:00
Micah Williamson f3df7a7231 [ROCm][CI] Enable kv_connector unit tests on ROCm (#45955) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-22 05:08:44 +03:00
Micah Williamson 4a083cc858 [ROCm][CI] Pin test_rocm_compressed_tensors_w8a8 to TRITON_ATTN (#46180) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-19 15:20:06 -05:00
Micah Williamson e945169207 Revert "[Kernel] Add PDL support for DeepGEMM kernel" (#45999) 2026-06-17 22:59:48 -07:00
Micah Williamson 6f612fbedf [ROCm][CI] Patch conftest to resolve occasional OOMs (#45722) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-16 10:00:15 -05:00
Micah Williamson 39cb9bf292 [ROCm] Bump Torch to 2.11 (#45362) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-12 15:22:26 -05:00
Micah Williamson e1ed89dbee Revert "[Kernel] Speed up silu_and_mul_per_block_quant with warp-shuf… (#45066) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-09 14:12:06 -07:00
Micah Williamson c9c1540e61 [ROCm][V2] Fix failed assertion in Llama models when using EAGLE with ROCM_AITER_FA (#44936) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-09 13:30:52 -05:00
Micah Williamson 2588ec4f0a [ROCm] Upgrade AITER to v0.1.13.post1 (#44265) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-02 01:48:59 +00:00
Micah Williamson 1b5437cec8 [ROCm] Bump ROCm to 7.2.3 (#43136) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-05-28 09:42:43 -07:00
Micah Williamson 34ab4f2565 [ROCm] Upgrade aiter to v0.1.13-rc5 (#42113) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-05-09 08:13:45 +00:00
Micah Williamson 7a576e2c72 [ROCm][CI] Remove TORCH_NCCL_BLOCKING_WAIT=1 After Bugfix In ROCm 7.2 (#41840) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-05-06 16:37:11 -07:00
Micah Williamson 6d09769700 [ROCm] Support non-causal attention in ROCM_ATTN (#40176) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-04-22 12:57:12 +09:00
Micah Williamson 4f4f8eaa78 [ROCm][CI] Fix condition for test_per_token_group_quant_fp8_packed (#39730) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-04-14 16:14:31 +00:00
Micah Williamson d5f75fdf50 [ROCm] Correctly guard fused_silu_mul_block_quant on ROCm (#39387) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-04-09 17:59:03 +00:00
Micah Williamson 9570654c6d [ROCm][CI] Run Kernels Core Operation Test On MI325 and mitigate flakiness (#38184) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-04-06 09:42:02 +08:00
Micah Williamson d9c7db18da [ROCm][CI] Pin test_hybrid test to TRITON_ATTN on ROCm (#38381) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-03-30 20:26:46 +00:00
Micah Williamson 4ff9b045fe [ROCm][CI] Prep Tests For Change To ROCM_ATTN As New Default Backend On ROCm (#36025) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-03-09 13:27:55 -05:00
Micah Williamson ee54f9cdb9 [ROCm][CI] Accept Different But Valid Output for test_olmoe_tp (#35224) 2026-03-07 13:50:52 -08:00
Micah Williamson fc4657756f [ROCm][CI] Enable AITER for failing test_gpt_oss test case on MI355 (#36174) 2026-03-07 13:50:17 -08:00
Micah Williamson e7213003cb [ROCm][CI] Fix TP size issue for test_gpt_oss (#35887) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-03-03 20:57:34 +00:00
Micah Williamson 8b9e8b7454 [ROCm][CI] Fix Assertion Logic For test_gpt_oss (#35806) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-03-03 05:08:04 +00:00
Micah Williamson 0edf101d2b [ROCm] Add stablelm Head Size 80 To Supported Head Sizes For ROCM_ATTN (#35527) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-02-28 12:16:34 +08:00
Micah Williamson f5432e35a3 [ROCm][CI] Loosen RemoteOpenAIServer Startup Timeout (#34922) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-02-20 05:37:49 +00:00
Micah Williamson fb7b30c716 [ROCm][CI] Revert Test Groups From mi325_8 to mi325_1 Agent Pool In AMD CI (#34384) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-02-11 15:52:34 -08:00
Micah Williamson 4a1550d22d [ROCm][CI] Fix test_sequence_parallel.py location in AMD CI pipeline (#34280) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-02-11 01:08:11 +00:00
Micah Williamson 1d367a738e [Bugfix][ROCm] Include float8_e4m3fnuz in NCCL Dtype Dispatching (#33713) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-02-04 05:36:29 -08:00
Micah Williamson 6c64c41b4a [ROCm][CI] Force max_num_seqs=1 on ROCm In test_sharded_state_loader to reduce flakiness (#33277) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-31 12:28:29 +08:00
Micah Williamson 911b51b69f [ROCm][CI] Add TORCH_NCCL_BLOCKING_WAIT For Distributed Tests (A100) (#32891) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-28 11:32:31 +08:00
Micah Williamson 019e2c3b7c [ROCm][CI] Lower Acceptance Len Threshold For test_draft_model_quantization (#32731) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-22 05:47:33 +00:00
Micah Williamson 22375f8d13 [ROCm][CI] Remove DS async eplb accuracy test from AMD CI (#32717) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-20 13:40:48 -08:00
Micah Williamson b84c426a8c [ROCm][CI] Skip Qwen3-30B-A3B-MXFP4A16 Eval Test On Non-CUDA Platforms (#32460) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-16 00:17:44 -08:00
Micah Williamson 46f8a982b1 [ROCm][CI] Enable AITER Unified Attention On ROCm For gpt-oss Test (#32431) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-16 00:55:57 +00:00
Micah Williamson 773d7073ae [ROCm][CI] Disable async scheduling on ROCm for test_structured_output[meta-llama/Meta-Llama-3.1-8B-Instruct-xgrammar-auto-speculative_config9] (#32355) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-15 04:53:43 +00:00
Micah Williamson 6fa6e7ef0c [ROCm][CI] Disable Async Scheduling For Qwen3-Next-80B-A3B-Instruct MTP Async EPLB Accuracy Test (#32275) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-14 13:29:42 +08:00
Micah Williamson ac0675ff6b [CI] Allow Deprecated Quantization For LM Eval Tests (#32065) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-09 19:10:47 -07:00
Micah Williamson 6559d96796 [ROCm][CI] Set TORCH_NCCL_BLOCKING_WAIT Distributed Tests On ROCm (#31259) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-24 07:19:07 +00:00
Micah Williamson 3ce791ac77 [ROCm][CI] Set VLLM_FLOAT32_MATMUL_PRECISION="tf32" For terratorch Tests In AMD CI (#31242) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-24 03:21:50 +00:00
Micah Williamson a5bc77c253 [AMD][CI] Add "V1 Test e2e + engine" to mi325_8 Agent Pool (#31040) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-22 10:41:56 -05:00
Micah Williamson fd8afdf38d [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-18 10:27:37 +08:00
Micah WilliamsonWeiQing ChenCyrus Leung
 		97f2f160fd [ROCm][CI] Add "Qwen3-Next-80B-A3B-Instruct MTP Async EPLB Accuracy Test" Back Into AMD CI (#30590) 
Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-14 06:56:26 +00:00
Micah Williamson 7d80c73d42 [CI] Reduce Flakiness For test_spec_decode.py::test_suffix_decoding_acceptance (#30367) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-10 02:35:49 +00:00
Micah Williamson aeb82b1930 [CI] Fix Flaky test_eagle_max_len Test (#30306) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-09 07:33:34 +00:00
Micah Williamson 78c7503364 [ROCm][CI] Skip NVIDIA-Only Prime-RL Test in AMD CI (#29420) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-09 02:14:02 +00:00
Micah Williamson 06579f9a82 [AMD][CI] Add ray[default] Dependency On ROCm To Pass v1/metrics/test_engine_logger_apis.py (#30110) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-05 06:48:23 +00:00
Micah Williamson 5430e110c0 [CI][AMD] Match Main CI Behavior By Skipping test_eplb_spec_decode In AMD CI (#30006) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-04 16:20:54 +08:00
Micah Williamson d1f7392c5f [ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-04 01:17:07 +08:00
Micah Williamson c014de1ec7 [ROCm][CI] Fix test_cudagraph_mode.py Failure For AMD CI (#29808) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-12-02 22:54:36 +00:00
Micah Williamson 43c5792592 [ROCm][CI] Fix test_cpu_offloading for ROCm (#29548) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-11-27 07:54:44 +00:00
Micah Williamson ef1f7030f0 [ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-11-25 07:55:09 +00:00
Micah Williamson 55c21c8836 [ROCm][CI] Fix "Cannot re-initialize CUDA in forked subprocess" in test_pynccl.py (#29119) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-11-23 13:05:00 +08:00
Micah Williamson 22e44ad589 [ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-11-19 21:31:33 +00:00
Micah Williamson 921e78f4bb [ROCm] Update AITER branch for ROCm base docker (#27586) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-10-27 17:22:33 +00:00
Micah Williamson aa1356ec53 [ROCm] Update Triton, Torch, and AITER branches for ROCm base Dockerfile (#27206) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2025-10-21 12:01:23 -04:00
Micah WilliamsonandGregory Shtrasberg 1c63a16b65 [Core] Run garbage collector after CUDA graph capture to fix throughput regression (#24128) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2025-09-09 10:38:10 -04:00