Can you explain a little bit what each of this lines does, and what affects each one? RAM, HDD, etc. --filestore.write-buffer-size 4MiB \ --pieces.write-prealloc-size 4MiB \ Is there a dependency between them, between the values? I understand that buffer affects RAM, what about the other parameter…

This post and thread should get you started until someone is here who can specifically answer If I set 1 or 2MiB for buffer and 4MiB for prealloc , is there a problem? [image] Filestore.write-buffer-size FAQ The write-buffer-size sets the in-memory buffer for incoming …

[image] snorkel: --pieces.write-prealloc-size 4MiB \ This option will eat space like hell, at one point you will have half disk but you will not be able to write there, because you will be out of 4MB space at one piece. because if file even 1 kb it will reserve 4MB there. and you will not be …

@Vadim This is the default setting. I use it in Docker run command, just to be aware of it, but it’s the default setting in the newest config.yaml. Even if I don’t use it in docker run, it will still be used with 4MiB. Untill Storj team dosen’t change it, I won’t as well, because I don’t understan…

I have a question if Filestore.write-buffer-size: 4 MiB but .partial files are stiil accrue in temp folder why? why it not write directly to folder, where it intend to be?

because there should be only whole pieces.

but there is whole piece in the ram already, just write it there. it is the same, you write it to temp then copy to new location, but if buffer is 4mb whole piece can be in buffer. If buffer is only 128k then yes you need make it part by part.

[image] Vadim: you write it to temp then copy to new location actually we use move not copy in this case if I’m not mistaken. Why to implement two mechanisms to write a piece, if one is working for both cases?

additional IO usage? but yes if it move then it wont take so much resources.

Is [image] snorkel: --pieces.write-prealloc-size 4MiB \ still a thing with this change: storagenode/blobstore: remove preallocate size committed 08:24PM - 06 May 24 UTC (UTC) [zeebo] zee…

Storj Community Forum (official)

Write-buffer-size and write-prealloc-size explained

Node Operators

show post in topic

Home
Categories
Guidelines
Terms of Service
Privacy Policy

Powered by Discourse, best viewed with JavaScript enabled