[Model Loader] Apply EP weight filtering in InstantTensor (#61167)

Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
This commit is contained in:
Itay Etelis
2026-10-14 09:10:10 -07:00
committed by GitHub
co-authored by Robert Shaw Misha Goin
parent eaf25f675a
commit 13dbf96093
9 changed files with 84 additions and 6 deletions
@@ -318,6 +318,7 @@ class DefaultModelLoader(BaseModelLoader):
weights_iterator = instanttensor_weights_iterator(
hf_weights_files,
self.load_config.use_tqdm_on_load,
local_expert_ids=self.local_expert_ids,
)
else:
if extra_config.get("enable_multithread_load"):