Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by: Harry Mellor <hej.mellor@gmail.com> Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Opus 5
parent
804e5377aa
commit
8c1557a79c
@@ -75,7 +75,8 @@ def _sconv_add_norm(
|
||||
"""``h = hidden + sconv(TP-sum(delta)); y = rmsnorm(h)``.
|
||||
|
||||
The Lamport path performs reduce-scatter + shard sconv + all-gather +
|
||||
residual add + norm. The NCCL path handles unsupported configurations."""
|
||||
residual add + norm. The NCCL path handles unsupported configurations.
|
||||
"""
|
||||
attn_metadata = get_forward_context().attn_metadata
|
||||
m = (
|
||||
attn_metadata.get(sconv.owner.prefix)
|
||||
|
||||
Reference in New Issue
Block a user