Jee Jee Li a99b9f7dee [Quantization] add BNB for MixtralForCausalLM (#20893) ...

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

2025-07-14 07:34:34 +00:00

..

__init__.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

base_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

bitsandbytes_loader.py

[Quantization][1/N] MoE support BNB-Inflight Quantization (#20061)

2025-07-11 08:01:13 +00:00

default_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

dummy_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gguf_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

neuron.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

neuronx_distributed.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

runai_streamer_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

sharded_state_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tensorizer_loader.py

[Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643)

2025-07-09 15:36:37 +00:00

tensorizer.py

[Bugfix] [CI] Fix Tensorizer LoRA test (#20760)

2025-07-10 19:07:06 +00:00

tpu.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

utils.py

[Quantization] add BNB for MixtralForCausalLM (#20893)

2025-07-14 07:34:34 +00:00

weight_utils.py

Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419)

2025-07-11 23:07:16 -07:00