Shaun Kotek 90512b2e8b fix: Use iterator as not to store all the file loads in memory at once (#36149) ...

Signed-off-by: Shaun Kotek - Nvidia <skotek@nvidia.com>

2026-03-08 20:25:21 -07:00

..

reload

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

2026-02-05 12:13:23 -05:00

__init__.py

[Misc][Spec Decode] support different load config for draft model (#34022)

2026-02-10 14:52:43 -08:00

base_loader.py

[Feature] OTEL tracing during loading (#31162)

2026-02-05 16:59:28 -08:00

bitsandbytes_loader.py

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

default_loader.py

Revert "[Misc] Enable weights loading tracking for quantized models" (#35309)

2026-02-25 09:20:15 -08:00

dummy_loader.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

gguf_loader.py

[Bugfix] Remove broken raw url GGUF model loading support (#34433)

2026-02-12 09:40:01 -08:00

runai_streamer_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

sharded_state_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

tensorizer_loader.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

tensorizer.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)

2026-02-13 08:11:26 -08:00

weight_utils.py

fix: Use iterator as not to store all the file loads in memory at once (#36149)

2026-03-08 20:25:21 -07:00