Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bash run/train_voc_first.sh #38

Open
chh6936 opened this issue Apr 22, 2021 · 6 comments
Open

bash run/train_voc_first.sh #38

chh6936 opened this issue Apr 22, 2021 · 6 comments

Comments

@chh6936
Copy link

chh6936 commented Apr 22, 2021

2021-04-22 15-21-27屏幕截图
When I run this step bash run/train_voc_first.sh, it appears as shown in the figure. It has been in this state for a day. I don't know how to solve it. Can you help me?Thank you.

@YoungXIAO13
Copy link
Owner

It appears not very clear to me where could come from the error, maybe you can do a monitoring of the GPU running state with nvidia-smi to check if the training has already started? If not, maybe it's better to go step by step to spot the issue

@chh6936
Copy link
Author

chh6936 commented Apr 23, 2021

It appears not very clear to me where could come from the error, maybe you can do a monitoring of the GPU running state with nvidia-smi to check if the training has already started? If not, maybe it's better to go step by step to spot the issue

I use nvidia-smi to check the running status of GPU. I find that the GPU is not working, but the terminal always displays the status of the above picture, and it does not report any errors. Where should I check for errors? Thank you.

@YoungXIAO13
Copy link
Owner

Maybe the first thing to check is wether the code has gone from line-321 to the training loops in line-399.

For a step-by-step debugging, you could use the ipdb libraries. Hope that will help you.

@WqxLoveCoding
Copy link

hello, have you fixed it yet? I met the same problem with you, but my nvidia-smi shows that it's working

@WqxLoveCoding
Copy link

it remains like this
屏幕截图 2022-04-11 093343

@WqxLoveCoding
Copy link

@YoungXIAO13 @chh6936

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants