Benjamin BartelsandCyrus Leung b194557a6c Adds parallel model weight loading for runai_streamer (#21330) ...

Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2025-07-22 08:15:53 -07:00

..

__init__.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355)

2025-07-03 08:18:30 +00:00

base_loader.py

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)

2025-07-16 15:33:41 -04:00

bitsandbytes_loader.py

[V0 deprecation] Remove V0 HPU backend (#21131)

2025-07-17 16:37:36 -07:00

default_loader.py

[V0 deprecation] Remove V0 HPU backend (#21131)

2025-07-17 16:37:36 -07:00

dummy_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gguf_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

neuron.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

neuronx_distributed.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

runai_streamer_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

sharded_state_loader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tensorizer_loader.py

[Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643)

2025-07-09 15:36:37 +00:00

tensorizer.py

[Bugfix] [CI] Fix Tensorizer LoRA test (#20760)

2025-07-10 19:07:06 +00:00

tpu.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

utils.py

[Model] Support VLMs with transformers backend (#20543)

2025-07-20 13:25:50 +00:00

weight_utils.py

Adds parallel model weight loading for runai_streamer (#21330)

2025-07-22 08:15:53 -07:00