Commit Graph
6 Commits
Author SHA1 Message Date
Shang WangandClaude Opus 5.5 ffec221276 [Bugfix][DSv4.1] Match decoder-replay input_ids dtype for FlashInfer MegaMoE (#61041)
Signed-off-by: Shang Wang <samshang.wang@mail.utoronto.ca>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 14:23:00 +00:00
ad73a4740d [Perf][DSv4.1] Trim the last KV-source layer in decoder replay (#59894)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Juntian Liu <Juntianl777@gmail.com>
2026-10-09 06:07:49 +00:00
stefankoncarevic 71f9a74920 [CI][ROCm] Re-enable the DSv4.1 decoder replay graph test on ROCm (#60392)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
2026-10-07 09:57:52 -05:00
Kevin H. LuuandClaude Opus 5.5 02d8a94e61 [CI][ROCm] Skip DSv4.1 decoder replay graph test on ROCm (#60378)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 02:38:31 -07:00
Juntian LiuClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
eb2901b735 [Perf][DSv4.1] Run decoder replay layers in CUDA graphs and trim in PIECEWISE graphs (#59532)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-10-05 22:11:45 -07:00
Yifan QiaoandClaude Fable 5.1 4b2e1cfa7b [Model] Decoder-side SWA bounded replay for DeepSeek-V4.1 (#58132)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-29 08:25:46 +00:00