So I get alot of put and get errors in logs for all of my nodes they crash after like 12h of running time, cant seem to find any new information about put and get errors so lets talk about it? :slight_smile: Logs of past few hours 2024-10-11T05:23:22+03:00 ERROR piecestore upload failed {"Piece ID…

The usual long tail cancelation errors. Your node is too slow for these customers and they drop it. You cannot win all races, because your node cannot be close to everyone customer in the world. However, dropped GET_REPAIR suggests that your node have issues to read data from the disk in time. Lik…

Im using normal hdds diffrent sizes NTFS(on windows) file system, 1 node per drive and I did add 200gb of virtual ram.

Ok then. You may do some optimizations though: [image] Windows Node Best Configs getting started Hi! Perhaps the most popular suggestion would be do not use Windows and NTFS, if that is not a server version or perhaps do not use it at all and use Linux/FreeBSD instead w…

SMR hdds? they are really slow.

Mostly seagate exos and some wd

look at the last couple hundred lines of the file and see if some segments are successfully “uploaded” or “downloaded”. If some are succeeding then the node is still operating, although maybe the disk load is high. steps to reduce load (there are NTFS tips out there, or adding extra SSD caching op…

And I think i found the problem, since there is no fatal errors in logs,(did a scan on all hdds and ssd for errors and fixed them) the only thing that could be crashing the node would be Vadims toolbox with the new update that updates all nodes. And it doesnt even work I left the updater running and…

Then it try to update, but for some reason it cant stop normaly node, what version of node do you have?

When I installed your new version of toolbox I had my first node on v1.113.2 and others on v1.112 I started the updater and it did nothing. After that I manually updated my nodes now all on v1.113.2.

Getting Put and Get on all Nodes

Node Operators troubleshooting

Alexey October 11, 2024, 7:54am 4

Ok then. You may do some optimizations though: