3 people 151ef4efd2 [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) ...

Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2024-10-07 11:55:12 +00:00

..

fused_moe

[Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973)

2024-10-04 12:34:44 -06:00

mamba

[Kernel][Model] Varlen prefill + Prefill chunking support for mamba kernels and Jamba model (#8533)

2024-09-29 17:35:58 -04:00

quantization

[Core] Refactor GGUF parameters packing and forwarding (#8859)

2024-10-07 10:01:46 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Hardware][intel GPU] bump up ipex version to 2.3 (#8365)

2024-09-13 16:54:34 -07:00

layernorm.py

[Model] Support NVLM-D and fix QK Norm in InternViT (#9045)

2024-10-07 11:55:12 +00:00

linear.py

[Core] Refactor GGUF parameters packing and forwarding (#8859)

2024-10-07 10:01:46 +00:00

logits_processor.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)

2024-08-13 05:33:41 +00:00

pooler.py

[Model] Support Qwen2.5-Math-RM-72B (#8896)

2024-09-28 21:19:39 -07:00

rejection_sampler.py

[SpecDec][Misc] Cleanup, remove bonus token logic. (#8701)

2024-09-22 12:34:14 -07:00

resampler.py

[MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029)

2024-09-05 12:48:10 +00:00

rotary_embedding.py

[Misc] Use RoPE cache for MRoPE (#8396)

2024-09-11 23:13:14 -07:00

sampler.py

[core] remove beam search from the core (#9105)

2024-10-07 05:47:04 +00:00

spec_decode_base_sampler.py

[SpecDec][Misc] Cleanup, remove bonus token logic. (#8701)

2024-09-22 12:34:14 -07:00

typical_acceptance_sampler.py

Fix typical acceptance sampler with correct recovered token ids (#8562)

2024-09-23 12:32:27 -07:00

vocab_parallel_embedding.py

[Misc] Update GPTQ to use vLLMParameters (#7976)

2024-09-03 17:21:44 -04:00