Inode usage increased a lot

Node Operators
1

Not sure to what is this related, but recently I observed high increase of inodes being used:

[root@localhost ~]# df -i | egrep "File|storj"
Filesystem                      Inodes   IUsed    IFree IUse% Mounted on
/dev/mapper/vg01_xfs-lv01_xfs  9549024 8690271   858753   92% /storj
[root@localhost ~]#

image
image1897×379 13.1 KB

out of which:

  59371 /storj/storage/temp

and the rest is multiple similar places like:

   5532 /storj/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/gw
   5535 /storj/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/zu
   5542 /storj/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/bx
   5563 /storj/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/wh
   5588 /storj/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/vd

What this might be related to?

2

May be because your drive is filling with data?
Did you tune the inodes number or used a default setting?

3

Default, it was slowly filling over time so it doesn’t seem to be related, this is comparison for last 3 months:

image
image1915×381 15.3 KB

image
image1917×375 13.6 KB

4

That looks normal to me comparing with my inodes.

Why are you using lvm?

I recommend using ext4, even on my biggest node that is 92% full, I’m only using 5% of inodes.
I’m not sure how xfs inodes are created when you format the disk.

5

You may use ext4 even if you use LVM :smiley:
LVM just a disk/partition manager, it’s unrelated to the filesystem.
The filesystem is a next level of abstraction, so you may have LVM and use ext4 (or any other filesystem).

1 Like
6

Maybe related to new version?

7

This is a bad sign. The temp directory normally only holds files while they are being uploaded. It is rare that I observe more than a few files being there. A large number here may mean that your node crashed many times, or the I/O is too slow.

I’ve got no experience with xfs, sorry.

3 Likes
8

You should use ext4.

1 Like