alexm-nm 5c342570d7 Add marlin unit tests and marlin benchmark script (#4815)

2024-05-16 09:36:49 -04:00

..

utils

Add marlin unit tests and marlin benchmark script (#4815)

2024-05-16 09:36:49 -04:00

__init__.py

[Model] Snowflake arctic model implementation (#4652)

2024-05-09 22:37:14 +00:00

aqlm.py

[Misc][Refactor] Generalize linear_method to be quant_method (#4373)

2024-04-26 16:41:14 -04:00

awq.py

[Misc][Refactor] Generalize linear_method to be quant_method (#4373)

2024-04-26 16:41:14 -04:00

base_config.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

deepspeedfp.py

[Model] Snowflake arctic model implementation (#4652)

2024-05-09 22:37:14 +00:00

fp8.py

[Kernel] [FP8] Improve FP8 linear layer performance (#4691)

2024-05-09 16:38:07 -07:00

gptq_marlin.py

[Kernel] Support running GPTQ 8-bit models in Marlin (#4533)

2024-05-02 12:56:22 -04:00

gptq.py

[Misc][Refactor] Generalize linear_method to be quant_method (#4373)

2024-04-26 16:41:14 -04:00

marlin.py

[Misc][Refactor] Generalize linear_method to be quant_method (#4373)

2024-04-26 16:41:14 -04:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

squeezellm.py

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00