I have had similar issues in the past . But back then a node restart did resolve it. Not this time. I have had 2 nodes that did not see ingress anymore. Both had space available and were not suspended as far as I have seen. The second node magically resolved the issue and is currently receiving up…

[image] jammerdan: The second node magically resolved the issue and is currently receiving uploads again. Not the first node: It seems that now after some additional wait the first node has magically resolved the issue as well. I can see uploads again. I have no idea why ingress initially has…

[image] Alexey: Hashstore uses a probabilistic model to estimate a used space and calculate a free space in the allocation. So used space and free space are only a guess? Maybe that wouldn’t be so bad, if it would not send out contrary signals. To the satellite it signals it is full, to the …

Ok, that’s really bad. I have just checked another node where the dashboard was telling me there is still like 250GB free. In reality, no ingress on that node anymore. After increasing space, ingress is back.

And found another node lying at me that it has almost 400 GB space left, but ingress halted at some time today.

Looks like a dashboard bug. It shall show space available as minimum of the two.

[image] arrogantrabbit: Looks like a dashboard bug. I cannot tell which one is the source of truth. Either way, there shouldn’t be contradicting signals. I have just found 4 more nodes that have not received ingress since the start of the day despite free space showing hundreds of GB as rema…

This is perhaps related to some suspected bug in the single node dashboard: https://forum.storj.io/t/hashstore-migration-guide/30658/159?u=alexey Could you please check with the multinode dashboard this behavior: https://forum.storj.io/t/hashstore-migration-guide/30658/154?u=alexey

I found now that 1 of my node gone out of sense completely [Screenshot 2025-10-11 153154] How it cold be overused and free space at same time? I deleted prefix db but it not helped. HDD is totaly full Update> Even after deletion of all db, picture is the same, so looks like node math is broken …

A new day begins and again there are several nodes that stopped ingress despite appearing to have enough free space left. [image] Alexey: Could you please check with the multinode dashboard this behavior: I was able to do that now: Node dashboard: [node_dashboard] Multinode dashboard (sa…

Then it’s exactly the problem, which is recently discovered: [image] Single node and multinode dashboards shows different values after migration to hashstore troubleshooting How is this possible? There is free space and also overused: [image] It is a single…

[image] Alexey: Then it’s exactly the problem, which is recently discovered: It seems to be the same problem. Now the question is, which numbers to trust? Does any of them show the correct value how much is actual used and how much is actual still free?

2 nodes no more ingress

Node Operators troubleshooting

Alexey October 12, 2025, 3:31am 20

Then it’s exactly the problem, which is recently discovered: