Skip to content

[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage #1712

[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage

[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage #1712

Annotations

1 warning

lint (3.10)

succeeded Dec 11, 2024 in 33s