The training crashes

[OwXiaoM]

Dear authors, thank you for sharing your codes for the community, I have a question about the model training, is it nomarl that the model crashes during the training, as I tried to reproduct the model on derain and desnow datasets, but during certain iters, as 800000, the visual results shows like pure noise or pure black. Should I wait more iters or is there any error in my reproduction? Thank you very much

[OwXiaoM]

I've verified that the black patch shows when the loss is NAN

[Kushpatel49]

hey there can you help me to setup this code locally as i am not able to find datasets and .txt files?

[yongliang-wu]

hey there can you help me to setup this code locally as i am not able to find datasets and .txt files?

you can find the .txt files from #10