Shinichi Hemmi df14152ac6 [Model] Support speculative decoding method for PLaMo3 (#54239) ...

Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>

2026-08-28 22:31:07 +00:00

..

determinism

[Perf] Autotune batch invariance triton kernel in blackwell, 33.6% E2E latency reduction (#53649)

2026-08-25 15:06:01 -04:00

hw_agnostic

Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)

2026-08-13 11:21:50 +01:00

kernels

[ROCm] remove VLLM_ROCM_USE_AITER_FP4_ASM_GEMM environment variable; make w4a4 use the preshuffle triton+asm by default (#53141)

2026-08-28 18:59:53 +00:00

layers

[Bugfix][ROCm] Pre-allocate wvSplitKrc static workspaces before KV init (#54247)

2026-08-28 14:22:53 -07:00

model_loader

Add routed expert loading for gpt-oss (#52209)

2026-08-23 17:59:08 +08:00

models

[Model] Support speculative decoding method for PLaMo3 (#54239)

2026-08-28 22:31:07 +00:00

offloader

[Offloader] Offload submodules that make_layers never reaches (#53120)

2026-08-26 18:37:00 +08:00

warmup

[kernel] Integrate FlashInfer BF16 CuTeDSL Low Latency GEMM (#50572)

2026-08-27 22:29:12 +00:00

__init__.py

…

custom_op.py

[Bugfix] Reject contradictory custom-op directives (#49134)

2026-07-26 08:42:14 -04:00

parameter.py

Speed up docs build (#44635)

2026-06-05 14:51:44 +00:00

utils.py

[Weight processing] Copy over new_data attributes in replace_parameter (#49601)

2026-08-06 13:03:37 -04:00