Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

event collector stops with TimeoutException error and does not restart or exit, running indefinitely until restarted manually #17

Open
Koguni31 opened this issue May 3, 2023 · 1 comment

Comments

@Koguni31
Copy link

Koguni31 commented May 3, 2023

eNcore 5.2.4 runs and exports events for some time (from several or tens of minutes to tens of hours or several days) but stops with TimeoutException error and does not restart or exit, but several processes running indefinitely (and systemd does not see that service have failed) until restarted manually:

2023-05-03 08:38:06,308 Monitor INFO Running. 5609100 handled; average rate 2032.07 ev/sec;
2023-05-03 08:40:13,200 Monitor ERROR Monitor __start: 'TimeoutException' object has no attribute 'message'
2023-05-03 20:52:03,552 Controller INFO Stopping...
2023-05-03 20:54:04,070 Controller INFO eNcore version: development
2023-05-03 20:54:04,071 Controller INFO Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0]
2023-05-03 20:54:04,071 Controller INFO Platform version: Linux-5.15.0-69-generic-x86_64-with-glibc2.35
2023-05-03 20:54:04,071 Controller INFO Starting client (pid=2510035).

Before emitting error and stopping processing events, htop shows 100% vCPU usage by one of eNcore processes, this could be not related to problem, but anyway, its illustrated below:

Screenshot 2023-05-03 214735

Config file:
estreamer.conf.txt

Systemd estreamer service file:
estreamer.service.txt

@Koguni31
Copy link
Author

Koguni31 commented May 23, 2023

More failures with same behavior. Error messages in log:

2023-05-11 11:29:33,522 Controller INFO Process writer is dead.
2023-05-17 10:00:14,607 Monitor ERROR Monitor __start: 'BrokenPipeError' object has no attribute 'message'
2023-05-19 10:10:44,361 Controller INFO Process subscriber is dead.

@Koguni31 Koguni31 reopened this May 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant