3 people 8dbfcd35bf [ CI/Build ] Added E2E Test For Compressed Tensors (#5839) ...

Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic>

2024-06-29 21:12:58 +08:00

..

fused_moe

[Kernel] Raise an exception in MoE kernel if the batch size is larger then 65k (#5939)

2024-06-29 21:04:20 +08:00

ops

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

quantization

[ CI/Build ] Added E2E Test For Compressed Tensors (#5839)

2024-06-29 21:12:58 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Kernel][CPU] Add Quick gelu to CPU (#5717)

2024-06-21 06:39:40 +00:00

layernorm.py

[Model] Add Gemma 2 (#5908)

2024-06-27 13:33:56 -07:00

linear.py

[ Bugfix ] Enabling Loading Models With Fused QKV/MLP on Disk with FP8 (#5921)

2024-06-28 18:43:49 +00:00

logits_processor.py

[Model] Add Gemma 2 (#5908)

2024-06-27 13:33:56 -07:00

pooler.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

rejection_sampler.py

[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (#5131)

2024-06-17 21:29:09 -05:00

rotary_embedding.py

Support Deepseek-V2 (#4650)

2024-06-28 13:24:57 -07:00

sampler.py

[Hardware][Intel] OpenVINO vLLM backend (#5379)

2024-06-28 13:50:16 +00:00

spec_decode_base_sampler.py

[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (#5131)

2024-06-17 21:29:09 -05:00

typical_acceptance_sampler.py

[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (#5131)

2024-06-17 21:29:09 -05:00

vocab_parallel_embedding.py

[Bugfix] Fix embedding to support 2D inputs (#5829)

2024-06-26 00:15:22 -07:00