Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Connection closed: CHANNEL_ERROR - expected 'channel.open' (ConnectionChannelError) #41

Open
kinnarr opened this issue Sep 23, 2021 · 0 comments
Labels
bug Something isn't working question Further information is requested

Comments

@kinnarr
Copy link
Member

kinnarr commented Sep 23, 2021

sink-nsca stopped after following error:

Sep 20 16:41:09 igel metricq-sink-nsca[751]: [2021-09-20 16:41:09,185] [INFO ] [metricq_sink_nsca.reporter] Sending 1 NSCA report(s)
Sep 20 16:41:21 igel metricq-sink-nsca[751]: [2021-09-20 16:41:21,795] [ERROR] [metricq_sink_nsca.reporter] Failed to send reports to NSCA host at xx.xx.xx.xx:5667: returncode=2
Sep 20 16:41:21 igel metricq-sink-nsca[751]: [2021-09-20 16:41:21,795] [ERROR] [metricq_sink_nsca.reporter] send_nsca: Error: Timeout after %d seconds
Sep 20 16:41:26 igel metricq-sink-nsca[751]: [2021-09-20 16:41:26,364] [ERROR] [metricq.agent       ] Exception in event loop: Future exception was never retrieved
Sep 20 16:41:26 igel metricq-sink-nsca[751]: [2021-09-20 16:41:26,364] [ERROR] [metricq.agent       ] Future: <Future finished exception=BrokenPipeError(32, 'Broken pipe')>
Sep 20 16:41:26 igel metricq-sink-nsca[751]: [2021-09-20 16:41:26,364] [ERROR] [metricq.agent       ] Stopping Agent on unhandled exception (BrokenPipeError)
Sep 20 16:41:27 igel metricq-sink-nsca[751]: [2021-09-20 16:41:27,640] [INFO ] [metricq.data_client ] closing data channel and connection.
Sep 20 16:41:27 igel metricq-sink-nsca[751]: [2021-09-20 16:41:27,812] [INFO ] [metricq_sink_nsca.reporter] Sending 3 NSCA report(s)
Sep 20 16:41:50 igel metricq-sink-nsca[751]: [2021-09-20 16:41:50,062] [INFO ] [metricq.agent       ] Connection closed: CHANNEL_ERROR - expected 'channel.open' (ConnectionChannelError)
Sep 20 16:41:50 igel metricq-sink-nsca[751]: [2021-09-20 16:41:50,062] [INFO ] [aio_pika.robust_connection] Connection to amqps://nsca:******@rabbitmq:5671/data closed. Reconnecting after 5 seconds.
Sep 20 16:41:50 igel metricq-sink-nsca[751]: [2021-09-20 16:41:50,069] [INFO ] [metricq.agent       ] Stopping Agent ReporterSink ([Errno 32] Broken pipe)...
Sep 20 16:41:50 igel metricq-sink-nsca[751]: [2021-09-20 16:41:50,075] [INFO ] [metricq.agent       ] Closing management channel and connection...
Sep 20 16:41:50 igel metricq-sink-nsca[751]: Traceback (most recent call last):
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/metricq/agent.py", line 251, in run
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     self.event_loop.run_until_complete(wait_for_stop())
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "uvloop/loop.pyx", line 1494, in uvloop.loop.Loop.run_until_complete
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/metricq/agent.py", line 247, in wait_for_stop
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     return stopped_task.result()
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/metricq/agent.py", line 497, in stopped
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     await self._stop_future
Sep 20 16:41:50 igel metricq-sink-nsca[751]: BrokenPipeError: [Errno 32] Broken pipe
Sep 20 16:41:50 igel metricq-sink-nsca[751]: During handling of the above exception, another exception occurred:
Sep 20 16:41:50 igel metricq-sink-nsca[751]: Traceback (most recent call last):
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/bin/metricq-sink-nsca", line 8, in <module>
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     sys.exit(main())
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/click/core.py", line 829, in __call__
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     return self.main(*args, **kwargs)
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/click/core.py", line 782, in main
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     rv = self.invoke(ctx)
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/click/core.py", line 1066, in invoke
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     return ctx.invoke(self.callback, **ctx.params)
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/click/core.py", line 610, in invoke
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     return callback(*args, **kwargs)
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/metricq_sink_nsca/main.py", line 76, in main
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     reporter.run(cancel_on_exception=True)
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "/home/service/envs/nsca/lib/python3.9/site-packages/metricq/agent.py", line 254, in run
Sep 20 16:41:50 igel metricq-sink-nsca[751]:     self.event_loop.run_until_complete(self.event_loop.shutdown_asyncgens())
Sep 20 16:41:50 igel metricq-sink-nsca[751]:   File "uvloop/loop.pyx", line 1492, in uvloop.loop.Loop.run_until_complete
Sep 20 16:41:50 igel metricq-sink-nsca[751]: RuntimeError: Event loop stopped before Future completed.
@kinnarr kinnarr added bug Something isn't working question Further information is requested labels Sep 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant