Nir DavidandUri Livne 01513a334a Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010) ...

Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>

2025-07-16 15:33:41 -04:00

..

__init__.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

base_loader.py

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)

2025-07-16 15:33:41 -04:00

bitsandbytes_loader.py

Enabled BnB NF4 inference on Gaudi (#20172)

2025-07-14 20:26:08 -07:00

default_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

dummy_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gguf_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

neuron.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

neuronx_distributed.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

runai_streamer_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

sharded_state_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tensorizer_loader.py

[Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643)

2025-07-09 15:36:37 +00:00

tensorizer.py

[Bugfix] [CI] Fix Tensorizer LoRA test (#20760)

2025-07-10 19:07:06 +00:00

tpu.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

utils.py

[Quantization] add BNB for MixtralForCausalLM (#20893)

2025-07-14 07:34:34 +00:00

weight_utils.py

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)

2025-07-16 15:33:41 -04:00