bug(hubble): grpc stream closes unexpectedly

[sanjayprabhu]

What is the bug?

from @manan19:

Hub sometimes closes the grpc stream unexpectedly

hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716792213921,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"r\":{\"eventTypes\":[1,3,2,9,6]},\"peer\":\"172.31.81.174:43516\",\"msg\":\"subscribe: starting stream\"}\n","timestamp":"2024-05-27T06:43:33.921Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716792221539,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"r\":{\"eventTypes\":[1,3,2,9,6]},\"peer\":\"172.31.81.174:43530\",\"msg\":\"subscribe: starting stream\"}\n","timestamp":"2024-05-27T06:43:41.539Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716792221864,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"r\":{\"eventTypes\":[1,3,2,9,6]},\"peer\":\"172.31.81.174:43538\",\"msg\":\"subscribe: starting stream\"}\n","timestamp":"2024-05-27T06:43:41.864Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716792223168,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"r\":{\"eventTypes\":[1,3,2,9,6]},\"peer\":\"172.31.81.174:43540\",\"msg\":\"subscribe: starting stream\"}\n","timestamp":"2024-05-27T06:43:43.168Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716794114157,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"r\":{\"eventTypes\":[]},\"peer\":\"44.205.98.253:48634\",\"msg\":\"subscribe: starting stream\"}\n","timestamp":"2024-05-27T07:15:14.157Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716794305073,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"peer\":\"44.205.98.253:48634\",\"msg\":\"subscribe: strea closed\"}\n","timestamp":"2024-05-27T07:18:25.073Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716797753877,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"r\":{\"eventTypes\":[]},\"peer\":\"44.205.98.253:37444\",\"msg\":\"subscribe: starting stream\"}\n","timestamp":"2024-05-27T08:15:53.877Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716797943984,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"peer\":\"44.205.98.253:37444\",\"msg\":\"subscribe: strea closed\"}\n","timestamp":"2024-05-27T08:19:03.984Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716798203860,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"r\":{\"eventTypes\":[1,3,2,9,6]},\"peer\":\"172.31.81.174:49624\",\"msg\":\"subscribe: starting stream\"}\n","timestamp":"2024-05-27T08:23:23.860Z","type":"out","process_id":0,"app_name":"hubble"}
hubble-hubble-1  | {"message":"{\"level\":30,\"time\":1716798208720,\"pid\":41,\"hostname\":\"032834dc6467\",\"component\":\"gRPCServer\",\"peer\":\"172.31.81.174:43540\",\"msg\":\"subscribe: strea closed\"}\n","timestamp":"2024-05-27T08:23:28.720Z","type":"out","process_id":0,"app_name":"hubble"}

How can it be reproduced? (optional)
Include steps, code samples, replits, screenshots and anything else that would be helpful to reproduce the problem.

Additional context (optional)
Add any other context about the problem here.