vLLM/csrc/cpu at c3ccc0e957fbcb1f4b55fb10ff935cf0a114e880 - vLLM

micro_gemm

[Hardware][Power] Unqualized MoE Backend for Power (VSX) (#51624 )

2026-08-13 10:56:09 +08:00

sgl-kernels

[Model] Add DeepSeek-V4 CPU backend (#55355 )

2026-09-10 14:14:48 +08:00

activation_lut_bf16.cpp

[perf][cpu] Accelerate BF16 GELU with LUT impl on Arm CPUs (#37469 )

2026-04-15 22:26:17 -07:00

activation.cpp

[CPU][Perf]Added tanh AOR for faster gelu activations. (#44639 )

2026-06-30 23:24:40 -07:00

cpu_arch_macros.h

[CPU][s390x] Optimize inference perf and add oneDNN INT8 GEMM for s390x (#50219 )

2026-07-31 17:49:31 +08:00

cpu_attn_amx_fp8.hpp

[CPU] [Feat] Add native AMX-FP8 attention impl for Diamond Rapids (#49410 )

2026-09-06 11:06:56 +08:00

cpu_attn_amx.hpp

[Feat] CPU fp8 attn for AMX/AVX-512 (#39445 )

2026-04-29 20:43:21 +08:00

cpu_attn_fp8.hpp

[Refactor] Remove kernel dead code (#51051 )

2026-08-07 01:20:19 -07:00

cpu_attn_impl.hpp

[CPU] [Feat] Add native AMX-FP8 attention impl for Diamond Rapids (#49410 )

2026-09-06 11:06:56 +08:00

cpu_attn_neon_bfmmla.hpp

[Feat] CPU fp8 attn for AMX/AVX-512 (#39445 )

2026-04-29 20:43:21 +08:00

cpu_attn_neon.hpp

[Feat] CPU fp8 attn for AMX/AVX-512 (#39445 )

2026-04-29 20:43:21 +08:00

cpu_attn_rvv.hpp

[CPU][RISC-V] Add VLEN=256 support to RVV attention kernels (#42943 )

2026-05-21 04:50:49 -07:00

cpu_attn_vec16.hpp

[Feat] CPU fp8 attn for AMX/AVX-512 (#39445 )

2026-04-29 20:43:21 +08:00

cpu_attn_vec.hpp

[Bugfix][CPU] Fix Clang OpenMP build on macOS (#49021 )

2026-07-21 09:58:52 +00:00

cpu_attn_vsx.hpp

[HARDWARE][POWER] optimize math functions of VSX power (#47321 )

2026-07-07 09:35:47 +00:00

cpu_attn_vxe.hpp

[Feat] CPU fp8 attn for AMX/AVX-512 (#39445 )

2026-04-29 20:43:21 +08:00

cpu_attn.cpp

[CPU] [Feat] Add native AMX-FP8 attention impl for Diamond Rapids (#49410 )

2026-09-06 11:06:56 +08:00

cpu_fused_moe_activations.hpp

[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133 )

2026-08-03 14:55:04 +08:00

cpu_fused_moe_int8.cpp

[CPU][Perf] INT8 Fused MoE Kernel for Arm CPUs (#48637 )

2026-07-27 05:53:09 +00:00

cpu_fused_moe.cpp

[Bugfix][CPU] Fix several bugs (#54042 )

2026-08-31 15:33:06 +08:00

cpu_tanhf_neon.hpp

[CPU][Perf]Added tanh AOR for faster gelu activations. (#44639 )

2026-06-30 23:24:40 -07:00

cpu_types_arm.hpp

[CPU] Add MLA backend so DeepSeek-V2/V3 can run on CPU (#49453 )

2026-08-06 16:51:41 +08:00

cpu_types_riscv_defs.hpp

[CPU][RISC-V] Add RVV path for W4A8 INT4 GEMM (#45269 )

2026-06-25 08:18:10 +00:00

cpu_types_riscv_impl.hpp

[Bugfix][CPU][RISC-V] Fix build: make FP32Vec copy constructors non-explicit (#51099 )

2026-08-14 04:59:01 +00:00

cpu_types_riscv.hpp

[CPU][RISC-V] Support multiple RVV VLEN targets via compile-time dispatch (#39478 )

2026-04-20 14:36:59 +08:00

cpu_types_scalar.hpp

[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133 )

2026-08-03 14:55:04 +08:00

cpu_types_vsx.hpp

[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133 )

2026-08-03 14:55:04 +08:00

cpu_types_vxe.hpp

[CPU] Enable GPTQ and AWQ quantization for s390x (#51148 )

2026-08-10 11:41:43 +08:00

cpu_types_x86.hpp

[CPU] [Feat] Add native AMX-FP8 attention impl for Diamond Rapids (#49410 )

2026-09-06 11:06:56 +08:00

cpu_types.hpp

[HARDWARE][POWER] optimize math functions of VSX power (#47321 )

2026-07-07 09:35:47 +00:00

cpu_wna16.cpp

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809 )

2026-09-08 12:45:12 -07:00

dnnl_helper.cpp

[Perf] Use dummy M for weight prepacking on x86 (#35890 )

2026-03-05 04:56:49 +00:00

dnnl_helper.h

[CPU] Refactor CPU attention backend (#27954 )

2025-11-12 09:43:06 +08:00

dnnl_kernels.cpp

[CPU] Fix macOS/Apple Silicon hang by enabling OpenMP in the build (#46769 )

2026-06-26 14:32:21 -04:00

float_convert.hpp

Use std::bit_cast for type punning in CPU kernels (#45089 )

2026-06-10 22:07:44 -07:00

generate_cpu_attn_dispatch.py

[CPU] [Feat] Add native AMX-FP8 attention impl for Diamond Rapids (#49410 )

2026-09-06 11:06:56 +08:00

layernorm.cpp

[Kernel] Add weightless RMSNorm CUDA kernels for has_weight=False (#41430 ) (#44109 )

2026-06-16 23:45:55 -07:00

mamba_cpu.cpp

[Hardware][CPU] Enable granite-4 model on cpu (#47641 )

2026-07-20 06:15:16 +00:00

mamba_kernels.hpp

[Hardware][CPU] Enable granite-4 model on cpu (#47641 )

2026-07-20 06:15:16 +00:00

mla_decode.cpp

[CPU] Add MLA backend so DeepSeek-V2/V3 can run on CPU (#49453 )

2026-08-06 16:51:41 +08:00

pos_encoding.cpp

[HARDWARE][POWER] Enable fp16 support for PowerPC (#46135 )

2026-06-23 13:24:49 +00:00

shm.cpp

[HARDWARE][POWER] Enable SHM communicator support for PowerPC (#43754 )

2026-06-02 18:06:32 +08:00

spec_decode_utils.cpp

[CPU][Spec Decode] Enable DFlash SD for CPU (#44029 )

2026-06-25 15:32:48 +08:00

torch_bindings.cpp

[Model] Add DeepSeek-V4 CPU backend (#55355 )

2026-09-10 14:14:48 +08:00

utils.cpp

[CPU] Refactor CPU affinity and memory management (#39781 )

2026-04-17 21:01:08 +08:00

utils.hpp

[Hardware][Power] Unqualized MoE Backend for Power (VSX) (#51624 )

2026-08-13 10:56:09 +08:00