Wentao Ye 0d453e2336 [Perf] Batch invariance with Cutlass fp8 support, 28.9% E2E latency improvement (#40408) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

2026-05-11 12:20:58 -04:00

..

kernels

[CUDA][CUTLASS] Enable cutlass scaled mm for non-compatible sizes (#41868)

2026-05-08 15:58:05 -07:00

layers

[Perf] Batch invariance with Cutlass fp8 support, 28.9% E2E latency improvement (#40408)

2026-05-11 12:20:58 -04:00

model_loader

[Performance] Make safetensors checkpoint prefetch settings configurable (#41499)

2026-05-10 15:55:15 +00:00

models

[Bug] Fix kimi dtype issue with mm_projector_forward (#42081)

2026-05-11 11:45:24 -04:00

offloader

[Refactor] Clean up log once scope="local" (#40540)

2026-04-22 16:42:43 -04:00

warmup

mxfp8 online quant move to new frontend (#40152)

2026-04-20 06:26:12 -07:00

__init__.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

custom_op.py

Add ability to replace oot ops when using lora (#37181)

2026-03-16 18:04:15 -07:00

parameter.py

[Quantization] add humming quantization kernel (#34556)

2026-04-24 09:29:44 -04:00

utils.py

[Bugfix][Rocm]Aiter MoE re-uses existing tensor addresses after weight update. (#40390)

2026-05-06 10:32:26 +00:00