3 people a6f43e57d6 [ROCm] Enable the cuMem CUDA-graph pool offload on ROCm (#59523) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: indianspeedster <cspandey016@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: indianspeedster <cspandey016@gmail.com>

2026-10-09 08:29:55 +00:00

..

attention

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

core

[ROCm][Quark][7/N] Use MXFP4 linear kernel abstraction for emulation backend (#48949)

2026-07-31 10:07:15 -07:00

cpu

[Bugfix][CPU] Fix fused Gumbel-max wrapping-window bias (#60221)

2026-10-08 15:15:53 +08:00

cutlass_extensions

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

libtorch_stable

[Attention][MiniMax-M3] NVFP4 KV cache on the MSA sparse attention path (#59300)

2026-10-01 14:39:55 -07:00

moe

[CPU][BugFix] Multiple fixes to w4a8_int8 CPU MoE path (#46739)

2026-07-06 05:39:20 +00:00

quantization

[Refactor] Remove dead kernel code (#57621)

2026-09-20 10:39:23 -07:00

quickreduce

Enable gfx1250 ROCm architecture (#46516)

2026-07-31 01:41:12 +00:00

rocm

[ROCm][Perf] W4A16: pad gfx11 weight and activation strides (#56301)

2026-10-06 08:22:33 -05:00

cache.h

[Bugfix] Sparse MLA: enable fp8_ds_mla dense prefill (#48642)

2026-07-16 22:44:04 +00:00

cuda_compat.h

[Bugfix][ROCm] Fix for warp_size uses on host (#21205)

2025-07-24 00:37:19 -07:00

cuda_utils.h

[Attention] MLA with chunked prefill (#12639)

2025-02-21 15:30:12 -08:00

cumem_allocator_compat.h

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695)

2025-11-12 15:24:12 -08:00

cumem_allocator.cpp

[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm (#59523)

2026-10-09 08:29:55 +00:00

custom_all_gather_reduce_scatter.cuh

[Perf][Distributed] Add low-SM multimem reduce-scatter for SM100/SM103 (#55072)

2026-09-25 03:27:21 +00:00

custom_all_reduce.cuh

[Perf][Distributed] Add low-SM multimem reduce-scatter for SM100/SM103 (#55072)

2026-09-25 03:27:21 +00:00

custom_collective_common.cuh

[Model] Add Kimi K3 support: model files and kernels [1/N] (#50089)

2026-07-29 14:10:58 +08:00

custom_quickreduce.cu

[ROCM] [Communication] Add INT3 quantization method for quickreduce (#45666)

2026-06-25 15:14:15 +00:00

dispatch_utils.h

[Performance] Fused blockwise quant RMS norm (#27883)

2025-12-07 16:38:04 +00:00

flashkda_registration.cpp

[Perf] Support internal prefill checkpoints for Mamba prefix caching, 9%~25% TTFT improvement (#52789)

2026-08-22 10:32:40 -07:00

fs_io.cpp

[KV Offload] Fix failed-load livelock by marking the lookup verdict as a miss (#49328)

2026-08-09 10:25:36 +03:00

ops.h

[Kernel] Implement CUDA kernel for ReLUSquaredActivation (relu^2) (#39058)

2026-07-12 19:18:03 -07:00

qutlass_registration.cpp

[12/n] final _C library kernel migration (#45415)

2026-06-19 06:57:26 -07:00

spinloop.cpp

[BugFix] Fix clang spinloop mwaitx include (#45532)

2026-07-28 19:00:06 +00:00

torch_bindings.cpp

[ROCm] [PyTorch] Move to stable abi since ROCm upgraded to torch 2.11 (#47128)

2026-07-02 18:34:07 +08:00

torch_utils.h

[6/n] Migrate activation kernels, gptq, gguf, non cutlass w8a8 to libtorch stable ABI (continued) (#42663)

2026-05-20 00:18:12 -07:00