Lucia FangandZhuohan Li 922979bfcc [DP] support torchrun external launcher with Data Parallelism (#24899) ...

Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2025-09-22 12:06:05 -07:00

..

__init__.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

async_llm.py

[V0 Deprecation] Remove V0 core (#25321)

2025-09-20 19:58:26 -07:00

coordinator.py

[BugFix] Improve internal DP load balancing (#21617)

2025-08-01 19:45:27 -07:00

core_client.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

core.py

[Hybrid Allocator] Support full attention with different hidden size (#25101)

2025-09-19 23:43:59 -07:00

detokenizer.py

[V0 Deprecation] Remove V0 Output Processor (#25320)

2025-09-20 17:57:20 -07:00

exceptions.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

llm_engine.py

[DP] support torchrun external launcher with Data Parallelism (#24899)

2025-09-22 12:06:05 -07:00

logprobs.py

[Chore][V0 Deprecation] Move LogProb to a separate file (#24055)

2025-09-01 12:07:53 -07:00

output_processor.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

parallel_sampling.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

processor.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

utils.py

[DP] Create placement groups by ray_device_key (#25026)

2025-09-17 08:57:25 +00:00