Schwinn Saereesitthipitak b7c5baf63d fix: keep DeepSeek V4 RoPE cache on inv_freq device (#43926) ...

Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Signed-off-by: Schwinn Saereesitthipitak <17022745+galletas1712@users.noreply.github.com>

2026-06-05 02:30:29 +04:00

..

attention

docs: fix MLA attention docstring examples (#44118)

2026-05-31 12:28:38 -07:00

fla

[Perf][KDA] Fuse gate softplus, chunk-local cumsum, and RCP_LN2 scaling (#43667)

2026-05-28 13:47:08 +00:00

fused_moe

[Bugfix] Fix test_cutlass_moe.py (#44380)

2026-06-04 14:18:52 -04:00

mamba

[mamba] unify KDA conv states into one cache to match 2-state SSM layout (#44539)

2026-06-04 20:38:05 +02:00

minimax_rms_norm

[Kernel] Porting fuse_minimax_qk_norm to manual fusion (#43410)

2026-05-26 13:16:03 -07:00

pooler

[Misc] Added missing return type annotations to improve mypy and IDE tooling (#43383)

2026-05-23 13:28:22 +08:00

quantization

[Quant] Support compressed-tensors WNA8O8Int linears and WNInt embeddings (#44340)

2026-06-04 07:40:33 -07:00

rotary_embedding

fix: keep DeepSeek V4 RoPE cache on inv_freq device (#43926)

2026-06-05 02:30:29 +04:00

__init__.py

…

activation.py

[ROCm][CI] Fix ROCm multimodal Qwen2.5-VL activation compile and Phi4MM ragged image mask handling (#43647)

2026-05-26 19:53:34 -07:00

attention_layer_base.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

batch_invariant.py

[Feature] Support batch invariant rms norm with residual (#42453)

2026-06-03 15:22:01 -04:00

conv.py

[Misc] Always use forward_mulmat for Conv3d on newer versions of torch. (#38487)

2026-03-30 05:39:41 +00:00

layernorm.py

[perf] Add gemma RMS AR fusion (#42646)

2026-06-04 01:33:59 -07:00

lightning_attn.py

[Kernel][Test] Extend lightning_attn and awq_triton kernel tests to XPU (#43307)

2026-06-04 14:25:59 -04:00

linear.py

[Refactor] Remove dead code (#43234)

2026-05-29 00:29:56 -04:00

logits_processor.py

[PluggableLayer][3/N] Apply PluggableLayer to llm_head and vocab embedding layer (#33465)

2026-04-10 16:12:59 +08:00

mhc.py

[DSv4] Move mHC tilelang kernels & Don't use CustomOP in dsv4/nvidia (#43905)

2026-05-29 10:25:02 +08:00

mla.py

[Feature]: IndexCache support for DSA models (#37735)

2026-04-29 15:15:35 -04:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer.py

[XPU] Enable multiple key kernels for sparse attention (#37888)

2026-05-22 12:02:51 +08:00

utils.py

[ROCm][Perf] Support N=5 in wvSplitK skinny GEMM kernels for speculative decoding (#40687)

2026-05-28 16:28:21 +00:00

vocab_parallel_embedding.py

Add LM head quantization support for ModelOpt (#42124)

2026-05-26 09:21:05 -07:00