3 people ee93f4f92a [CORE] Quantized lm-head Framework (#4442) ...

Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: ZX <zx@lbx.dev>

2024-07-02 22:25:17 +00:00

..

compressed_tensors

[misc][cuda] use nvml to avoid accidentally cuda initialization (#6007)

2024-06-30 20:07:34 -07:00

utils

[misc][cuda] use nvml to avoid accidentally cuda initialization (#6007)

2024-06-30 20:07:34 -07:00

__init__.py

[Misc] Update to comply with the new compressed-tensors config (#5350)

2024-06-10 03:49:46 +00:00

aqlm.py

[Core] Allow AQLM on Pascal (#5058)

2024-05-27 15:26:14 -07:00

awq.py

[Misc] Fix get_min_capability (#5971)

2024-06-30 20:15:16 +00:00

base_config.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

bitsandbytes.py

[Misc] Fix get_min_capability (#5971)

2024-06-30 20:15:16 +00:00

deepspeedfp.py

[Model] Snowflake arctic model implementation (#4652)

2024-05-09 22:37:14 +00:00

fp8.py

[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970)

2024-07-02 21:54:35 +00:00

gptq_marlin_24.py

Marlin 24 prefill performance improvement (about 25% better on average) (#4983)

2024-05-23 02:39:27 -04:00

gptq_marlin.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

gptq.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

marlin.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

squeezellm.py

[Misc] Fix get_min_capability (#5971)

2024-06-30 20:15:16 +00:00