@bonsaisearch I saw something very similar with my cluster on EC2 as well.
Our cluster is experiencing increased error rates due to disconnected nodes. We are restarting nodes now to recover the cluster.
-
-
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@nz_ I was getting monit warnings that the node seemed to have disconnected from the cluster.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@nz_ I restarted ES twice and after a few minutes the node joined the cluster successfully.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@nz_ weird, I wonder if it was an ebs issue.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@nz_ and now it makes sense, I bet the connection was dropped between that node and the master.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.