Santino Ramos 85f671b8e1 [Model Runner V2] Support Streaming Inputs (#37028) ...

Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>

2026-03-20 20:42:25 +00:00

..

kernels

[Bugfix] Fix ConchLinearKernel channelwise quantization (group_size=-1) (#37329)

2026-03-20 10:32:21 -05:00

layers

[Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605)

2026-03-20 12:19:26 -07:00

model_loader

[BUG] Exclude SKIP_TENSORS from get_layer_size() + new weight sync example for dpep (#37334)

2026-03-19 00:45:10 +00:00

models

[Model Runner V2] Support Streaming Inputs (#37028)

2026-03-20 20:42:25 +00:00

offloader

Bugfix for offloading+prefetch for GLM-4.7-FP8 (#37178)

2026-03-17 21:22:09 +08:00

warmup

[Bugfix] Fix AttributeError when serving MXFP8 models with DeepGEMM installed (#37358)

2026-03-19 17:58:33 +00:00

__init__.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

custom_op.py

Add ability to replace oot ops when using lora (#37181)

2026-03-16 18:04:15 -07:00

parameter.py

[QeRL] Layerwise Reloading (#32133)

2026-01-30 08:50:05 -07:00

utils.py

[BugFix] Fix EPLB fail for MoeFP4 model with Marlin backend (#33262)

2026-01-29 16:52:11 +08:00