Jun-Howie dd2ccf8dde Feat Dynamic Quantization for MoE Layers in GPTQ Marlin Backend (#19395)

2025-06-24 07:23:28 +09:00

..

fused_moe

[EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885)

2025-06-23 11:07:47 -07:00

mamba

[v1] Support mamba2 (#19327)

2025-06-18 20:34:15 +00:00

quantization

Feat Dynamic Quantization for MoE Layers in GPTQ Marlin Backend (#19395)

2025-06-24 07:23:28 +09:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

layernorm.py

[Bugfix] Enable PP with AITER+V1 (#19822)

2025-06-20 12:43:20 +08:00

lightning_attn.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

linear.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

logits_processor.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

pooler.py

[Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956)

2025-06-23 18:38:06 +00:00

rejection_sampler.py

Fix some typo (#19475)

2025-06-11 10:36:04 +00:00

resampler.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

rotary_embedding.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

sampler.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode_base_sampler.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

typical_acceptance_sampler.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[KERNEL] Sampler. CUDA kernel for applying repetition penalty (#18437)

2025-06-03 21:13:01 -07:00

vocab_parallel_embedding.py

[DOC] fix doc typos (#19600)

2025-06-17 11:34:53 +08:00