3 people e80b6c642f [ROCm][DSv4] Overlap the unfused shared expert with AITER MegaMoE (#61819) ...

Signed-off-by: Taoyu Zhu <zhutaoyu97@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: vllm-agent <claw@inferact.ai>

2026-10-18 22:39:38 +08:00

..

deepseek_v32

[Perf] Optimize DeepSeek V3.2 sequence parallelism (#51434)

2026-08-07 16:51:01 -07:00

fixtures

[BUGFIX] Fix Pixtral consolidated format vision weight loading (#39916)

2026-04-19 22:25:03 -07:00

glm5next

[Bugfix][GLM-5.3-Flash] Honor --mamba-ssm-cache-dtype for the KDA recurrent state (#59147)

2026-10-11 17:55:00 +00:00

inkling

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

kimi_k3

[ROCm] attn res + sigmoid_mul + conv fusions (#52968)

2026-10-17 00:54:54 +00:00

language

[Frontend] Score with the chat template declared by Sentence Transformers CrossEncoders (#60877)

2026-10-18 11:30:12 +00:00

multimodal

[Frontend] Score with the chat template declared by Sentence Transformers CrossEncoders (#60877)

2026-10-18 11:30:12 +00:00

quantization

[ROCm][MoE] Support MiMo-V2.6 MXFP4 on gfx942 (#58262)

2026-09-30 17:23:00 +08:00

qwen4_exp

[Qwen4Exp] Clean up HC and PLE implementations for Qwen3.8-Flash-Next (#61454)

2026-10-18 19:38:21 +08:00

transformers

[Bugfix][Transformers backend] Fix CUDA graph capture for dynamic-rope models (#58064)

2026-10-14 05:56:54 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

registry.py

[Bugfix] Honor OPT token embedding width for prompt embeddings (#61736)

2026-10-16 04:41:50 +00:00

test_adapters.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)

2026-09-24 14:14:10 +00:00

test_alice_ai_config.py

[Model] Add AliceAI support (#57963)

2026-10-15 10:15:03 +00:00

test_alice_ai.py

[Model] Add AliceAI support (#57963)

2026-10-15 10:15:03 +00:00

test_deepseek_v4_aiter_mega_moe.py

[ROCm][DSv4] Overlap the unfused shared expert with AITER MegaMoE (#61819)

2026-10-18 22:39:38 +08:00

test_deepseek_v4_dspark_rocm.py

[Bugfix][RL] Load attention sinks through weight_loader for layerwise reload (#57797)

2026-10-14 10:17:58 +00:00

test_deepseek_v4_fi_moe_ep.py

Add MoNe experts pruning support (#50415)

2026-10-12 23:18:43 +00:00

test_deepseek_v4_mega_moe.py

[MoE] Unify DeepGEMM MegaMoE experts behind one feature-matrix layer; add NVFP4 (#61538)

2026-10-15 19:02:01 +00:00

test_deepseek_v4_rocm_compressor_gemm_fusion.py

[ROCm][DSV4][Perf] Fuse DeepSeek V4 C4 compressor GEMMs (#53838)

2026-08-26 23:36:14 +08:00

test_deepseek_v4_rocm_wo_a.py

[ROCm][DSV4][Perf] Use FP8 WO_A output projection (#54894)

2026-09-20 09:13:55 +00:00

test_deepseek_v4_vl_rocm.py

[ROCm][DSv4] AITER MegaMoEV2 Integration For DeepSeek V4 (#59685)

2026-10-07 09:35:53 -05:00

test_deepseek_v4_vl_stream_weights.py

[Model] DeepSeek-V4/V4.1 VL: stream language-model weights instead of sorting the checkpoint (#58857)

2026-10-17 09:37:56 +00:00

test_deepseek_v41_amd_replay_forward.py

[ROCm][Perf][DSv4.1] Enable decoder SWA bounded replay (#59039)

2026-10-13 02:19:14 +00:00

test_deepseek_v41_decoder_replay_layers.py

[Bugfix][DSv4.1] Match decoder-replay input_ids dtype for FlashInfer MegaMoE (#61041)

2026-10-12 14:23:00 +00:00

test_deepseek_v41_pcp.py

[Feature][PCP] Add DeepSeek-V4.1-Flash support (#59857)

2026-10-15 23:17:51 -07:00

test_deepseek_v41_replay_batch.py

[Bugfix][MoE] Restore TP-sharded routed-expert capture for DP=1 (#61388)

2026-10-16 00:21:24 +00:00

test_deepseek_v41_replay_start.py

[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash (#56227)

2026-09-18 15:01:24 -07:00

test_dspark_mla.py

[Bugfix][RL] Load attention sinks through weight_loader for layerwise reload (#57797)

2026-10-14 10:17:58 +00:00

test_dsv41_mono_decode.py

[ROCm][Perf][DSv4.1] Mono decode on every backbone layer (#61082)

2026-10-13 10:16:50 +08:00

test_dsv41_mono_layers.py

[ROCm][Perf][DSv4.1] Mono decode on every backbone layer (#61082)

2026-10-13 10:16:50 +08:00

test_dsv41_mono_numerics.py

[ROCm] Bump AITER to v0.1.25 and relax the DSv4.1 mono MoE tolerance (#61697)

2026-10-14 23:50:24 +00:00

test_hyv4_rocm.py

[Perf][ROCm] Add a ROCm path for Hy4 and compile the backbone (#57526)

2026-09-21 08:20:43 +00:00

test_initialization.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

test_language_model_cache_is_weak.py

[Feature][Model Loader] Apply model-owned MTP shard selection to RunAI ModelStreamer (#60759)

2026-10-15 12:23:11 +08:00

test_qwen3_5_mtp_config.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)

2026-09-24 14:14:10 +00:00

test_registry.py

[ROCm][Qwen4Exp] Support HC and MoE sequence parallelism on ROCm (#61471)

2026-10-15 20:11:17 -05:00

test_terratorch.py

[CI/Build] Skip Prithvi/Terratorch model-registry tests when terratorch is missing (#41389)

2026-04-30 12:47:55 -07:00

test_utils.py

[Model][Gemma4] Load Weights with AutoWeightsLoader (#55911)

2026-09-18 12:07:30 +00:00

test_vision.py

[MM] Add Triton kernel for mm_input_normal. (#56798)

2026-09-25 04:31:20 +00:00

utils.py

[Misc] Remove code paths for Transformers < 5.16.1 (#59762)

2026-10-02 11:17:24 +00:00