3 people ebed81fbf5 Update default neuron config for speculation (#18274) ...

Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
Co-authored-by: Shashwat Srijan <sssrijan@amazon.com>
Co-authored-by: Aakash Shetty <sheaak@amazon.com>

2025-05-22 02:18:55 -07:00

..

__init__.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

base_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

bitsandbytes_loader.py

[Quantization] Pool model support bitsandbytes (#18087)

2025-05-19 09:03:43 -07:00

default_loader.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

dummy_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

gguf_loader.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

neuron.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

neuronx_distributed.py

Update default neuron config for speculation (#18274)

2025-05-22 02:18:55 -07:00

runai_streamer_loader.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

sharded_state_loader.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

tensorizer_loader.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

tensorizer.py

fix: Add type specifications for CLI arguments in tensorizer options (#18314)

2025-05-18 23:42:17 -07:00

utils.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

weight_utils.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00