Travis Johnson 0258b7a94b [Bugfix] handle prompt_logprobs in _apply_min_tokens_penalty (#3876) ...

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

2024-04-10 01:39:56 -07:00

..

fused_moe

[Kernel] Add MoE Triton kernel configs for A100 40GB (#3700)

2024-03-28 15:26:24 -07:00

ops

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

quantization

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[1/n][Chunked Prefill] Refactor input query shapes (#3236)

2024-03-20 14:46:05 -07:00

layernorm.py

Revert "Refactor llama family models (#2637)" (#2851)

2024-02-13 09:24:59 -08:00

linear.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

logits_processor.py

[Bugfix] Fix logits processor when prompt_logprobs is not None (#3899)

2024-04-10 00:09:36 -07:00

rejection_sampler.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

rotary_embedding.py

[BugFix] tensor.get_device() -> tensor.device (#3604)

2024-03-24 19:01:13 -07:00

sampler.py

[Bugfix] handle prompt_logprobs in _apply_min_tokens_penalty (#3876)

2024-04-10 01:39:56 -07:00

vocab_parallel_embedding.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00