3 people 73c8d677e5 [Kernel] Marlin Expansion: Support AutoGPTQ Models with Marlin (#3922) ...

Co-authored-by: alexm <alexm@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

2024-04-29 09:35:34 -07:00

..

fused_moe

[Kernel] Optimize FP8 support for MoE kernel / Mixtral via static scales (#4343)

2024-04-27 04:49:59 +00:00

ops

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

quantization

[Kernel] Marlin Expansion: Support AutoGPTQ Models with Marlin (#3922)

2024-04-29 09:35:34 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Misc] Add indirection layer for custom ops (#3913)

2024-04-10 20:26:07 -07:00

layernorm.py

[Misc] Add indirection layer for custom ops (#3913)

2024-04-10 20:26:07 -07:00

linear.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

logits_processor.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

rejection_sampler.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

rotary_embedding.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

sampler.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

vocab_parallel_embedding.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00