Kunshang Ji 26f2fb5113 [Core]Refactor gptq_marlin ops (#4466)

2024-04-30 08:14:47 -04:00

..

fused_moe

[Bugfix][Kernel] Fix compute_type for MoE kernel (#4463)

2024-04-29 22:05:40 -07:00

ops

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

quantization

[Core]Refactor gptq_marlin ops (#4466)

2024-04-30 08:14:47 -04:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Misc] Add indirection layer for custom ops (#3913)

2024-04-10 20:26:07 -07:00

layernorm.py

[Misc] Add indirection layer for custom ops (#3913)

2024-04-10 20:26:07 -07:00

linear.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

logits_processor.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

rejection_sampler.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

rotary_embedding.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

sampler.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

vocab_parallel_embedding.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00