Bowen Bao db593aa67f [Quantization] Quark MXFP4 format loading (#16943)

2025-05-07 15:05:05 -04:00

..

__init__.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

base_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

bitsandbytes_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

default_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

dummy_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

gguf_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

neuron.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

neuronx_distributed.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

runai_streamer_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

sharded_state_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

tensorizer_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

tensorizer.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

utils.py

[Quantization] Quark MXFP4 format loading (#16943)

2025-05-07 15:05:05 -04:00

weight_utils.py

[Misc] Remove qlora_adapter_name_or_path (#17699)

2025-05-06 23:10:37 -07:00