Hashstore: bad file descriptor

ItsHass · January 23, 2025, 7:31am

Does this work - to put that data to SSD like we do with DBS currently ?

Cheers

ItsHass · January 23, 2025, 1:40pm

any simple scripts / snippets you could give or what is needing to be added to the run command

bney · January 23, 2025, 2:57pm

No script or adding anything to the run command. I just moved the hashtable directory to the system drive and created a symbolic link to it in the required place in the storage directory

snorkel · January 23, 2025, 5:45pm

I believe the option to move the hashtables is in one of the new verions, 120+…

dgtadmin · January 24, 2025, 3:51am

Did this as well and it brought the node back online

Clete2 · January 25, 2025, 1:29am

I did this too, and it worked.

Commands:

mkdir -p data/storage/hashstore
rsync -avhr /mnt/storj/data/storage/hashstore/ data/storage/hashstore
Edit docker-compose.yml: Add in volumes:: - ./data/storage/hashstore:/app/config/storage/hashstore

I prefer this over symbolic links, because it is more obvious at first glance that I am overriding that one directory.

EasyRhino · August 21, 2025, 9:25pm

greetings from 6 months later.

Now that hashstore has been announced for the future, do we know if the hashstore file locking will still be an issue for NFS mounts, or has something changed with how it is accessed by storj?

Alexey · August 22, 2025, 4:09am

We do not use NFS and the requirements have not changed, also the claim that it doesn’t support any network filesystems is still valid. It hasn’t been tested at all, so it’s not forbidden, but not supported.
It may work until it doesn’t.

EasyRhino · August 22, 2025, 6:38pm

Yeah I just tried disabling my workaround (specifying a local drive for the hashstore in docker) and the same error came back, so flock() still doesn’t work with NFS.

Alexey · August 23, 2025, 2:14am

There should be a configuration option for NFS to enable it or to emulate it.
At least it’s exist for the other network filesystems, but also depends on a kernel or OS.

EasyRhino · August 24, 2025, 5:10pm

Yeah what I learned so far in experimentation is that the flock error fails on a NFS4 mount no matter what I do. (tried every different local_lock option on the mount) I can actually mount it NFS v3 and it no longer gives an error, but then my storj log shows a lot of errors for Stale NFS file handle.

So… not definitve info right now just thinking out loud more than anything.

Alexey · August 25, 2025, 3:24am

Then perhaps for your setup it will not work properly.