Cody YuandCade Daniel f942efb5a3 [Dynamic Spec Decoding] Auto-disable by the running queue size (#4592) ...

Co-authored-by: Cade Daniel <edacih@gmail.com>

2024-05-08 21:44:00 +00:00

..

fused_moe

[Misc] Fix expert_ids shape in MoE (#4517)

2024-05-01 23:47:59 +00:00

ops

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

quantization

[Kernel] Support running GPTQ 8-bit models in Marlin (#4533)

2024-05-02 12:56:22 -04:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

layernorm.py

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

linear.py

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

logits_processor.py

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

rejection_sampler.py

[Dynamic Spec Decoding] Auto-disable by the running queue size (#4592)

2024-05-08 21:44:00 +00:00

rotary_embedding.py

[CI] Make mistral tests pass (#4596)

2024-05-08 08:44:35 -07:00

sampler.py

[Core] Optimize sampler get_logprobs (#4594)

2024-05-08 08:42:28 -07:00

vocab_parallel_embedding.py

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00