4 people 6936e77ba4 [Perf][Engram] Serialize offloaded lookups and pack host tables into huge pages (#56926) ...

Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-09-25 10:52:02 +08:00

..

kernels

[Quantization] Select linear backends per quantization (#51204)

2026-09-14 16:24:18 -04:00

layers

[Kimi-K3][Perf] Dispatch GEMM for vision patch embedder (#58527)

2026-09-24 18:30:11 -07:00

model_loader

[Cleanup] Remove online quantization support in fp8.py in favor of online shorthands (#53585)

2026-09-24 12:48:14 -07:00

offloader

[Bugfix][Offloader] Preserve prefetch static-buffer slot ownership (#54975)

2026-09-07 10:58:44 +08:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_b12x_warmup.py

[Kernel] Add b12x FP4 MoE backend (#52018)

2026-08-21 08:04:36 -07:00

test_bailing_mrope.py

[Model] Add Bailing V3 VL support (#55921)

2026-09-10 02:46:56 -07:00

test_cpu_unquantized_gemm_dispatch.py

[Bugfix][CPU][MoE] Fix out-of-bounds write and segfault when router weights are fp32 (#56168)

2026-09-24 13:15:17 +08:00

test_deep_gemm_warmup.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_eagle_quantization.py

[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)

2026-09-04 11:46:06 -07:00

test_enabled_custom_ops.py

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00

test_ernie45_vl_mrope.py

[Model] Use mm_features for Ernie-4.5 VL M-RoPE (#39753)

2026-04-14 01:11:52 -07:00

test_flashinfer_autotune_warmup.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781)

2026-09-12 00:36:47 -04:00

test_gemma_hidden_act.py

[Models][Gemma3/Gemma4] Support hidden_act variants in gated MLP (#40588)

2026-05-08 11:29:11 -07:00

test_jit_warmup_cutedsl_launcher.py

[5/N][warmup][DSv4] Migrate NVIDIA CuTeDSL attention kernels (#53566)

2026-09-12 00:05:59 -04:00

test_jit_warmup_triton_launcher.py

[Perf] Parallelize registered CUDA Triton kernel warmup at startup (#58582)

2026-09-24 19:52:00 -04:00

test_jit_warmup.py

[6/N][warmup][DSv4] Migrate sampling, and DFlash JIT kernels (#56323)

2026-09-12 17:24:24 -07:00

test_keye_mrope.py

[Model] Use mm_features for Keye-VL and Keye-1.5-VL M-RoPE (#39869)

2026-04-16 02:16:06 -07:00

test_keye_vl1_5_mrope.py

[Model] Use mm_features for Keye-VL and Keye-1.5-VL M-RoPE (#39869)

2026-04-16 02:16:06 -07:00

test_mamba_triton_warmup.py

[Perf] Extend Qwen Triton warmup to avoid first-request latency spikes (#54797)

2026-09-07 11:46:00 +08:00

test_minicpmv.py

[Bugfix][MiniCPM-V] Route video_embeds to the shared vision parser (#54633)

2026-09-01 09:16:07 +00:00

test_mistral_large_3_eagle.py

[Bugfix] Initialize missing attributes in mistral eagle (#45217)

2026-06-12 08:21:01 +08:00

test_model_load_with_params.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_nemotron_h_quantization.py

[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793)

2026-09-14 10:26:15 -07:00

test_oink_integration.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_paddleocr_vl_mrope.py

[Model] Use mm_features to compute mrope positions for PaddleOCR-VL (#39888)

2026-04-16 06:14:00 -07:00

test_plamo3.py

[Model] Support speculative decoding method for PLaMo3 (#54239)

2026-08-28 22:31:07 +00:00

test_qwen3_5_quantization.py

Add LM head quantization support for ModelOpt (#42124)

2026-05-26 09:21:05 -07:00

test_qwen3_asr_mrope.py

[Rust Frontend][gRPC] Add audio and video media inputs (#53760)

2026-08-30 11:31:37 +08:00

test_qwen3_omni.py

[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)

2026-09-24 14:14:10 +00:00

test_qwen3_vl_mrope.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_qwen_triton_warmup.py

[Perf] Extend Qwen Triton warmup to avoid first-request latency spikes (#54797)

2026-09-07 11:46:00 +08:00

test_qwen_vl_triton_warmup.py

[Perf] Extend Qwen Triton warmup to avoid first-request latency spikes (#54797)

2026-09-07 11:46:00 +08:00

test_replayssm_warmup.py

[Mamba] Add FlashInfer ReplaySSM backend (#52506)

2026-09-01 10:26:43 -04:00

test_routed_experts_capture.py

[AuxOutput] Add block-keyed storage for routed-expert outputs (#45635)

2026-09-21 10:25:05 +00:00

test_sleep_mode_tensor_ownership.py

[Bugfix][Models] Register sleep-managed runtime buffers (#53507)

2026-08-29 10:32:24 +08:00

test_utils.py

[Weight processing] Copy over new_data attributes in replace_parameter (#49601)

2026-08-06 13:03:37 -04:00

test_watermark_sample_warmup.py

[watermarking] Dual-key gumbel-max watermarking for speculative decoding support (#56122)

2026-09-12 18:42:01 +00:00

test_weight_utils.py

[Perf][Engram] Serialize offloaded lookups and pack host tables into huge pages (#56926)

2026-09-25 10:52:02 +08:00