On tuning ext4 for storage nodes

[Toyoo]

@Zetanova

What information does this process require?

Satellite ID, piece ID, expiration time.

@Zetanova

If the entry size is 124bytes then a in memory dictionary/array would require around 122Mb memory for each 1mil entries. Most likely the entry size is less then that.

Ok, and?

@Zetanova

A simple journal near 1:1 memory layout with append only operations would be already to act as persistent storage for the in memory table.

If it is append only, this means that pieces deleted by GC are not removed from this journal? Or, well, expired pieces?

@Zetanova

For me it makes simply little sense that storj need to use a dedicated HDD or to hold all fs-metadata in the system-cache to be able to operate or let some other process like a btc-node use the disk.

It is simple, that’s the key benefit. There were ideas to make it more complex for speed. More complexity is risky though.