Woosuk Kwon 4624d98dbd [Misc] Clean up RoPE forward_native (#8076)

2024-09-04 20:31:48 -07:00

..

fused_moe

[Model] Adding support for MSFT Phi-3.5-MoE (#7729)

2024-08-30 13:42:57 -06:00

mamba

[Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651)

2024-08-28 15:06:52 -07:00

ops

[CI/Build] Update PyTorch to 2.4.0 (#6951)

2024-08-01 11:11:24 -07:00

quantization

[Neuron] Adding support for adding/ overriding neuron configuration a… (#8062)

2024-09-04 16:33:43 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Doc] Add Nemotron to supported model docs (#6843)

2024-07-26 17:32:44 -04:00

layernorm.py

[Misc] Use torch.compile for GemmaRMSNorm (#7642)

2024-08-22 01:14:13 -07:00

linear.py

[Misc] Update fbgemmfp8 to use vLLMParameters (#7972)

2024-09-03 20:12:41 -06:00

logits_processor.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)

2024-08-13 05:33:41 +00:00

pooler.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

rejection_sampler.py

[SpecDecode][Kernel] Flashinfer Rejection Sampling (#7244)

2024-09-01 21:23:29 -07:00

rotary_embedding.py

[Misc] Clean up RoPE forward_native (#8076)

2024-09-04 20:31:48 -07:00

sampler.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

spec_decode_base_sampler.py

[SpecDecode][Kernel] Flashinfer Rejection Sampling (#7244)

2024-09-01 21:23:29 -07:00

typical_acceptance_sampler.py

[SpecDecode][Kernel] Flashinfer Rejection Sampling (#7244)

2024-09-01 21:23:29 -07:00

vocab_parallel_embedding.py

[Misc] Update GPTQ to use vLLMParameters (#7976)

2024-09-03 17:21:44 -04:00