Cade Daniel 62b8aebc6f [Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

..

fused_moe

[Kernel] Fused MoE Config for Mixtral 8x22 (#4002)

2024-04-11 07:50:00 -07:00

ops

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

quantization

Updating lm-format-enforcer version and adding links to decoding libraries in docs (#4222)

2024-04-20 08:33:16 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Misc] Add indirection layer for custom ops (#3913)

2024-04-10 20:26:07 -07:00

layernorm.py

[Misc] Add indirection layer for custom ops (#3913)

2024-04-10 20:26:07 -07:00

linear.py

[Kernel][FP8] Initial support with dynamic per-tensor scaling (#4118)

2024-04-20 04:28:57 +00:00

logits_processor.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00

rejection_sampler.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

rotary_embedding.py

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

sampler.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

vocab_parallel_embedding.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00