Giancarlo Delfin d154d90d6c [Model Runner V2] batch-sharded sample (#50465) ...

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

2026-08-24 15:49:57 -07:00

..

ops

[2/N][Feat][Perf] Add new warmup infrastructure for JITs. Add predicate filtering for JIT warmup, and migrate Inkling FA4 (#49315)

2026-08-11 07:46:07 -04:00

__init__.py

…

attention.py

[2/N][Feat][Perf] Add new warmup infrastructure for JITs. Add predicate filtering for JIT warmup, and migrate Inkling FA4 (#49315)

2026-08-11 07:46:07 -04:00

layernorm.py

…

logits_processor.py

[Model Runner V2] batch-sharded sample (#50465)

2026-08-24 15:49:57 -07:00

mlp.py

[Performance][Model] Avoid transient Inkling result allocations (performance, and OOM prevention on smaller memory configurations) (#49487)

2026-07-23 05:03:34 +00:00

model.py

Reduce AutoWeightsLoader kwargs (#53106)

2026-08-20 15:40:11 +00:00

moe.py

[Kernel][Inkling] Fuse shared-expert partial addition into the Lamport collective (#50697)

2026-08-04 18:41:35 +00:00

mtp.py

[Bugfix][Model Runner V2] Restore multimodal draft capability detection (#50417)

2026-08-03 14:18:14 -07:00

sconv_swa_attn.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

2026-08-21 17:47:49 -07:00

short_conv.py

[Model] Add PW CUDA graph support for Inkling [2/N] (#48822)

2026-07-16 10:28:56 -07:00