Sometimes when a container has been reaped it will no longer be responsive although it should restart automatically. Logs do not show anything it is just halted.
Then I try to stop and remove the container manually. Logs show
The logs show:
2023-05-24 02:35:03,431 WARN received SIGTERM indicating exit request
2023-05-24 02:35:03,445 INFO waiting for storagenode, processes-exit-eventlistener, storagenode-updater to die
2023-05-24T02:35:03.577Z INFO Got a signal from the OS: "terminated"{"Process": "storagenode-updater"}
2023-05-24 02:35:03,650 INFO stopped: storagenode-updater (exit status 0)
2023-05-24 02:35:06,654 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-05-24 02:35:09,658 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-05-24 02:35:12,662 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-05-24 02:35:13,663 WARN killing 'storagenode' (57) with SIGKILL
2023-05-24 02:35:15,666 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-05-24 02:35:18,670 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-05-24 02:35:21,674 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-05-24 02:35:23,676 WARN killing 'storagenode' (57) with SIGKILL
2023-05-24 02:35:24,678 INFO waiting for storagenode, processes-exit-eventlistener to die
2023-05-24 02:35:27,682 INFO waiting for storagenode, processes-exit-eventlistener to die
Docker outputs:
Error response from daemon: cannot stop container: storagenode: tried to kill container, but did not receive an exit event
The container remains present. It seems that the node software is waiting for something and Docker is waiting for something and none of it happens resulting in the container that cannot be stopped or removed.