rasmith 127c07480e [Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857) ...

Signed-off-by: Randall Smith <Randall.Smith@amd.com>

2024-11-08 19:59:22 -05:00

..

fused_moe

[torch.compile] directly register custom op (#9896)

2024-10-31 21:56:09 -07:00

mamba

[Model] factoring out MambaMixer out of Jamba (#8993)

2024-11-04 18:00:00 +00:00

quantization

[Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857)

2024-11-08 19:59:22 -05:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

layernorm.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

linear.py

[Hardware][CPU] Support AWQ for CPU backend (#7515)

2024-10-09 10:28:08 -06:00

logits_processor.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

pooler.py

Adds method to read the pooling types from model's files (#9506)

2024-11-07 08:42:40 +00:00

rejection_sampler.py

[SpecDec][Misc] Cleanup, remove bonus token logic. (#8701)

2024-09-22 12:34:14 -07:00

resampler.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

rotary_embedding.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

sampler.py

[V1] Make v1 more testable (#9888)

2024-11-06 11:57:35 -08:00

spec_decode_base_sampler.py

[SpecDec][Misc] Cleanup, remove bonus token logic. (#8701)

2024-09-22 12:34:14 -07:00

typical_acceptance_sampler.py

Fix typical acceptance sampler with correct recovered token ids (#8562)

2024-09-23 12:32:27 -07:00

vocab_parallel_embedding.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00