Wentao Ye 995dea1354 [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2026-03-29 18:12:50 +00:00

..

kernels

[CPU] Support CT W4A16 on CPU MP kernel (#38219)

2026-03-27 14:15:28 +08:00

layers

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)

2026-03-29 18:12:50 +00:00

model_loader

[CI]revert initialize_model context manager (#38426)

2026-03-28 16:56:50 +00:00

models

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)

2026-03-29 18:12:50 +00:00

offloader

Bugfix for offloading+prefetch for GLM-4.7-FP8 (#37178)

2026-03-17 21:22:09 +08:00

warmup

[Bugfix] Fix AttributeError when serving MXFP8 models with DeepGEMM installed (#37358)

2026-03-19 17:58:33 +00:00

__init__.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

custom_op.py

Add ability to replace oot ops when using lora (#37181)

2026-03-16 18:04:15 -07:00

parameter.py

[Mypy] Fix mypy for vllm/model_executor (except vllm/model_executor/layers) (#37904)

2026-03-24 17:14:01 +00:00

utils.py

[BugFix] Fix EPLB fail for MoeFP4 model with Marlin backend (#33262)

2026-01-29 16:52:11 +08:00