Michael GoinandDipika 307939f299 Use NVFP4 Marlin for CompressedTensorsW4A16Fp4 (#18000) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Dipika <dipikasikka1@gmail.com>

2025-05-12 18:07:34 -06:00

..

fused_moe

[Kernel] fp4 marlin kernel (#17687)

2025-05-10 19:58:49 -07:00

mamba

[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for Corresponding Kernels (#17146)

2025-05-06 17:59:30 -07:00

quantization

Use NVFP4 Marlin for CompressedTensorsW4A16Fp4 (#18000)

2025-05-12 18:07:34 -06:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[New Model]: Snowflake Arctic Embed (Family) (#16649)

2025-04-18 08:11:57 -07:00

layernorm.py

[BugFix] [ROCm]: Bugfix and handle addition case of input for rocm_aiter_rms_norm (#17857)

2025-05-11 04:17:11 -07:00

lightning_attn.py

[Bugfix] Fix triton import with local TritonPlaceholder (#17446)

2025-05-06 17:53:09 +08:00

linear.py

[Model] Qwen3 Dense FP8 Compat Fixes (#17318)

2025-04-28 14:12:01 -07:00

logits_processor.py

[Misc][Platform] Move use allgather to platform (#14010)

2025-03-03 15:40:04 +08:00

pooler.py

[Frontend] support matryoshka representation / support embedding API dimensions (#16331)

2025-04-11 23:23:10 -07:00

rejection_sampler.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00

resampler.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

rotary_embedding.py

[Attention] MLA move rotary embedding to cuda-graph region (#17668)

2025-05-09 11:14:42 +08:00

sampler.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00

spec_decode_base_sampler.py

[model][refactor] remove cuda hard code in models and layers (#13658)

2025-02-24 06:10:14 -08:00

typical_acceptance_sampler.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00

utils.py

[Kernel][Hardware][AMD] Bf16 mfma opt for ROCm skinny GEMMs (#17071)

2025-05-07 22:34:49 -07:00

vocab_parallel_embedding.py

[ROCm][Misc] Follow-ups for Skinny Gemms on ROCm. (#17011)

2025-04-25 22:05:10 -07:00