3 people 3f1e57225a [ROCm][Perf][Kimi-K3] Use AITER Gluon KDA kernels for decode and spec decode (#57392) ...

Signed-off-by: omuhamma <omar.muhammad@amd.com>
Signed-off-by: Nicholas Susanto <nicholas.susanto@amd.com>
Co-authored-by: Nicholas Susanto <nicholas.susanto@amd.com>
Co-authored-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>

2026-10-15 17:54:24 -05:00

..

deepseek_v32

[Perf] Optimize DeepSeek V3.2 sequence parallelism (#51434)

2026-08-07 16:51:01 -07:00

fixtures

[BUGFIX] Fix Pixtral consolidated format vision weight loading (#39916)

2026-04-19 22:25:03 -07:00

glm5next

[Bugfix][GLM-5.3-Flash] Honor --mamba-ssm-cache-dtype for the KDA recurrent state (#59147)

2026-10-11 17:55:00 +00:00

inkling

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

kimi_k3

[ROCm][Perf][Kimi-K3] Use AITER Gluon KDA kernels for decode and spec decode (#57392)

2026-10-15 17:54:24 -05:00

language

[Core] Update PyTorch to 2.14.0, torchvision to 0.29.0, triton to 3.8.0 (release channel) (#52183)

2026-10-14 00:17:59 -07:00

multimodal

[MM][CG] Support ViT full CUDA graph for DeepSeek-VL2 (#46005)

2026-10-15 21:38:52 +08:00

quantization

[ROCm][MoE] Support MiMo-V2.6 MXFP4 on gfx942 (#58262)

2026-09-30 17:23:00 +08:00

qwen4_exp

[Quantization] Support packed NVFP4 Qwen4Exp PLE embeddings (#56273)

2026-10-14 08:24:55 +08:00

transformers

[Bugfix][Transformers backend] Fix CUDA graph capture for dynamic-rope models (#58064)

2026-10-14 05:56:54 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

registry.py

[Model] Support every Decision 3.0 size (d3-flash, d3-mini, d3-nano, d3-lite, d3-edge) (#61778)

2026-10-15 13:29:24 +00:00

test_adapters.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)

2026-09-24 14:14:10 +00:00

test_alice_ai_config.py

[Model] Add AliceAI support (#57963)

2026-10-15 10:15:03 +00:00

test_alice_ai.py

[Model] Add AliceAI support (#57963)

2026-10-15 10:15:03 +00:00

test_deepseek_v4_aiter_mega_moe.py

[ROCm][DSv4] AITER MegaMoE Fixed-Slot Dispatch For DeepSeek-V4 (#61262)

2026-10-15 19:10:59 +08:00

test_deepseek_v4_dspark_rocm.py

[Bugfix][RL] Load attention sinks through weight_loader for layerwise reload (#57797)

2026-10-14 10:17:58 +00:00

test_deepseek_v4_fi_moe_ep.py

Add MoNe experts pruning support (#50415)

2026-10-12 23:18:43 +00:00

test_deepseek_v4_mega_moe.py

[MoE] Unify DeepGEMM MegaMoE experts behind one feature-matrix layer; add NVFP4 (#61538)

2026-10-15 19:02:01 +00:00

test_deepseek_v4_rocm_compressor_gemm_fusion.py

[ROCm][DSV4][Perf] Fuse DeepSeek V4 C4 compressor GEMMs (#53838)

2026-08-26 23:36:14 +08:00

test_deepseek_v4_rocm_wo_a.py

[ROCm][DSV4][Perf] Use FP8 WO_A output projection (#54894)

2026-09-20 09:13:55 +00:00

test_deepseek_v4_vl_rocm.py

[ROCm][DSv4] AITER MegaMoEV2 Integration For DeepSeek V4 (#59685)

2026-10-07 09:35:53 -05:00

test_deepseek_v41_amd_replay_forward.py

[ROCm][Perf][DSv4.1] Enable decoder SWA bounded replay (#59039)

2026-10-13 02:19:14 +00:00

test_deepseek_v41_decoder_replay_layers.py

[Bugfix][DSv4.1] Match decoder-replay input_ids dtype for FlashInfer MegaMoE (#61041)

2026-10-12 14:23:00 +00:00

test_deepseek_v41_replay_batch.py

[Bugfix][MoE] Keep routing rows during DeepSeek V4.1 decoder replay (#61643)

2026-10-15 14:02:06 +00:00

test_deepseek_v41_replay_start.py

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

test_dspark_mla.py

[Bugfix][RL] Load attention sinks through weight_loader for layerwise reload (#57797)

2026-10-14 10:17:58 +00:00

test_dsv41_mono_decode.py

[ROCm][Perf][DSv4.1] Mono decode on every backbone layer (#61082)

2026-10-13 10:16:50 +08:00

test_dsv41_mono_layers.py

[ROCm][Perf][DSv4.1] Mono decode on every backbone layer (#61082)

2026-10-13 10:16:50 +08:00

test_dsv41_mono_numerics.py

[ROCm] Bump AITER to v0.1.25 and relax the DSv4.1 mono MoE tolerance (#61697)

2026-10-14 23:50:24 +00:00

test_hyv4_rocm.py

[Perf][ROCm] Add a ROCm path for Hy4 and compile the backbone (#57526)

2026-09-21 08:20:43 +00:00

test_initialization.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

test_language_model_cache_is_weak.py

[Feature][Model Loader] Apply model-owned MTP shard selection to RunAI ModelStreamer (#60759)

2026-10-15 12:23:11 +08:00

test_qwen3_5_mtp_config.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)

2026-09-24 14:14:10 +00:00

test_registry.py

[Spec Decode] Remove Medusa and MLP speculator support (#61701)

2026-10-14 17:29:23 -07:00

test_terratorch.py

[CI/Build] Skip Prithvi/Terratorch model-registry tests when terratorch is missing (#41389)

2026-04-30 12:47:55 -07:00

test_utils.py

[Model][Gemma4] Load Weights with AutoWeightsLoader (#55911)

2026-09-18 12:07:30 +00:00

test_vision.py

[MM] Add Triton kernel for mm_input_normal. (#56798)

2026-09-25 04:31:20 +00:00

utils.py

[Misc] Remove code paths for Transformers < 5.16.1 (#59762)

2026-10-02 11:17:24 +00:00