3 people 3403e0f176 [Bugfix] Persist FlashInfer autotune cache per rank to fix the rank-0-only cache-hit deadlock (#57635) ...

Signed-off-by: Madhav Jivrajani <madhav.jiv@gmail.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>

2026-10-06 17:51:01 +00:00

..

__init__.py

[Docs] Fix warnings in docs build (#22588)

2025-08-10 05:49:51 -07:00

b12x_warmup.py

[Kernel] Add b12x FP4 MoE backend (#52018)

2026-08-21 08:04:36 -07:00

cutedsl_warmup.py

[2/N][Feat][Perf] Add new warmup infrastructure for JITs. Add predicate filtering for JIT warmup, and migrate Inkling FA4 (#49315)

2026-08-11 07:46:07 -04:00

deep_gemm_warmup.py

[Build] Migrate vendored DeepGEMM from pybind to TORCH_LIBRARY (abi3) (#48962)

2026-10-06 08:39:04 -07:00

flashinfer_autotune_cache.py

[Elastic EP] Reuse CUDA graphs across reconfiguration (#54985)

2026-09-12 10:26:39 -04:00

flashinfer_sparse_mla_warmup.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

jit_warmup_cutedsl_helper.py

[5/N][warmup][DSv4] Migrate NVIDIA CuTeDSL attention kernels (#53566)

2026-09-12 00:05:59 -04:00

jit_warmup_tilelang_helper.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

jit_warmup_triton_helper.py

[Perf] Parallelize registered CUDA Triton kernel warmup at startup (#58582)

2026-09-24 19:52:00 -04:00

jit_warmup.py

[Perf] Parallelize mHC pre-norm JIT warmup (#56683)

2026-09-13 18:58:20 -07:00

kernel_warmup.py

[Bugfix] Persist FlashInfer autotune cache per rank to fix the rank-0-only cache-hit deadlock (#57635)

2026-10-06 17:51:01 +00:00

kimi_k3_triton_warmup.py

[Bugfix] Gate Kimi-K3 KDA warmup on sys.modules to skip Kimi import for non-Kimi models (#59257)

2026-10-01 09:25:45 +00:00

mamba_triton_warmup.py

[Perf] Extend Qwen Triton warmup to avoid first-request latency spikes (#54797)

2026-09-07 11:46:00 +08:00

minimax_m3_msa_warmup.py

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

qwen4_exp_qsa_warmup.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

qwen_triton_warmup.py

[Model] Add Qwen4Exp to the Qwen GDN Triton warmup (#56742)

2026-10-02 21:38:15 +08:00

qwen_vl_triton_warmup.py

[Perf] Extend Qwen Triton warmup to avoid first-request latency spikes (#54797)

2026-09-07 11:46:00 +08:00

replayssm_warmup.py

[Mamba] Add FlashInfer ReplaySSM support for MTP (#52928)

2026-09-30 21:41:17 +00:00

rocm_segmented_attn_autotune_warmup.py

[ROCM][Perf] Add ROCM_SEGMENTED_ATTN attention-backend works across RDNA3/3.5/4 (#59132)

2026-10-06 07:53:47 +00:00

watermark_sample_warmup.py

[watermarking] Dual-key gumbel-max watermarking for speculative decoding support (#56122)

2026-09-12 18:42:01 +00:00