Estimated Payout
The storage node payout dashboard is showing an estimated payout for the current month. It now subtracts the held amount.
Payout History
We added a new payout history table. It is showing a payout overview for a selected month. This overview contains information about held returned after GE, held returned in month 16, and the payout transaction ID for each satellite. The transaction ID is available starting with the 2020-02 payout. We don’t have the transaction IDs for older payouts.
Note: By default, the payout history table will select the earliest instead of the latest month. We are going to fix that with a future release.
Held Amount History
The held amount history was changed as well. It shows the total held amount and the total held returned per satellite.
Periodic Filesystem Check
On startup, the storage node will write a file and once per minute, it will try to read this file. If the hard drive gets disconnected from the storage node this check will fail and the storage node will error out instead of getting disqualified for failing audits.
Order DB
Some storage nodes had problems with a locked order DB. To avoid this problem we replaced the order DB with flat files. The storage node creates one file per hour per satellite and appends all incoming orders. One hour later the storage node will submit these orders to the satellite and move the file into an archive folder. By creating a new file every hour we avoid defragmentation and with that also DB locks.
Note: The storage node will check the unsent orders every 5 minutes. For 55 minutes it will notice that there is nothing to submit. That is intentional and not a bug.
Auth Token Service
We are replacing the old auth token service with a new one (registration.storj.io). The new service should work in all browsers even with adblocker enabled. There is a captcha on the new page. If you don’t see it you might have to enable the corresponding java scripts.
The auth token is getting displayed directly on the page. No waiting for an email that might or might not arrive. You can go on and sign your identity immediately.
We also made some progress for graceful exit. I have posted a list of graceful exit bugs here: Known issues we are working on
Only one bug out of that list is fixed with this version. I don’t think that will change much and for that reason I haven’t mentioned it. I don’t want to open the floor for false expectations.
Every minute is quite frequent though especially if the disk is struggling, hopefully the system is not going to try and check the file again if the previous check did not complete yet?
But I guess you’d argue that if my disk takes more than 1 minute to check whether a file exists or not, I’ve got serious issues with my disk and you would be right
Serious issues, like an SMR drive for instance
When you say “the storage node will error out”, what does it mean exactly? Is the node software going to exit, or just switch to an error state visible on the dashboard?
In general yes, you’re right @Pentium100, as long as the disk is not stalling.
When it does though (because of writes indeed), even reading from it becomes really difficult. At least that’s the case with the little 2.5" consumer-grade HDD I have, which is absolutely not designed to run 24/7 with this amount of data read/written to it.
I’ve seen this SMR drive take several tens of seconds for a simple ls command to complete on the root of the Storj folder where there isn’t much to list, and stopping a node running on this very SMR disk (when completely overwhelmed by writes and reads) could take 5, 10, 15 minutes…
If you have disk that behaves that bad, this new file written every minute is not a game changer. Plus the new ordersdb mechanism will offload the disks. Very nice changelog, good job
This time to check appears configurable with “VerifyDirInterval”
Happy to see this change. I can stop relying as much on my own cronjob. I do a few other things with it while monitoring AC power status on the UPS, and it will shutdown the node gracefully at certain limits too. Need to publish that.
