arlo 8c29042bb9 [Feature] Add InstantTensor weight loader (#36139)

2026-03-14 18:05:23 +01:00

..

reload

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

2026-02-05 12:13:23 -05:00

__init__.py

[Feature] Add InstantTensor weight loader (#36139)

2026-03-14 18:05:23 +01:00

base_loader.py

[Feature] OTEL tracing during loading (#31162)

2026-02-05 16:59:28 -08:00

bitsandbytes_loader.py

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

default_loader.py

[Feature] Add InstantTensor weight loader (#36139)

2026-03-14 18:05:23 +01:00

dummy_loader.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

gguf_loader.py

[Bugfix] Remove broken raw url GGUF model loading support (#34433)

2026-02-12 09:40:01 -08:00

runai_streamer_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

sharded_state_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

tensorizer_loader.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

tensorizer.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

utils.py

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)

2026-02-13 08:11:26 -08:00

weight_utils.py

[Feature] Add InstantTensor weight loader (#36139)

2026-03-14 18:05:23 +01:00