Giancarlo Delfin dec13a33b7 [Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892) ...

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

2026-07-30 15:54:15 -07:00

..

ops

[Model] Add Kimi K3 support: model files and kernels [1/N] (#50089)

2026-07-29 14:10:58 +08:00

__init__.py

…

attention.py

[Model] Add PW CUDA graph support for Inkling [2/N] (#48822)

2026-07-16 10:28:56 -07:00

layernorm.py

…

logits_processor.py

[Model] Add Inkling LoRA support [4/N] (#48884)

2026-07-17 09:52:15 +08:00

mlp.py

[Performance][Model] Avoid transient Inkling result allocations (performance, and OOM prevention on smaller memory configurations) (#49487)

2026-07-23 05:03:34 +00:00

model.py

[Model] Support llm-compressor Inkling NVFP4 weights (#49258)

2026-07-23 20:06:01 -07:00

moe.py

[Model] Add Inkling compressed-tensors dynamic FP8 support (#48876)

2026-07-28 19:27:01 -07:00

mtp.py

[Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892)

2026-07-30 15:54:15 -07:00

sconv_swa_attn.py

[Model] Add PW CUDA graph support for Inkling [2/N] (#48822)

2026-07-16 10:28:56 -07:00

short_conv.py

[Model] Add PW CUDA graph support for Inkling [2/N] (#48822)

2026-07-16 10:28:56 -07:00