No data in dashboard after migrating to new computer

Hi,

i just finished to migrate my existing node with ~250GB stored data to a new Computer.
storage folder and identity is copied including the --mount command with the correct path.

Now the dashboard doesnt show me the existing 250 GB data and start to count from 0 MB.

What do i miss?

Hello @LordHelmchen,
Welcome to the forum!

Please, show your docker run command

here it is.

sudo docker run -d --restart unless-stopped -p 28967:28967 -e WALLET=“0xC23e9b8516169Df5b029A82841A77B977860653B” -e EMAIL="xxx@googlemail.com" -e ADDRESS=“xxx.dyndns.org:28967” -e BANDWIDTH=“60TB” -e STORAGE=“10TB” --mount type=bind,source="/mnt/storj/identity",destination=/app/identity --mount type=bind,source="/mnt/storj/nas",destination=/app/config --name storagenode storjlabs/storagenode:alpha

additionally i get the following error:

2019-08-18T20:52:58.113Z INFO piecestore download started {“Piece ID”: “IGM5N3FUV34R2JOCGXK3K6A2M3GLRC6YSI3AXQ6ZN24XJEHHA4PA”, “SatelliteID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_AUDIT”}
2019-08-18T20:52:58.113Z INFO piecestore download failed {“Piece ID”: “IGM5N3FUV34R2JOCGXK3K6A2M3GLRC6YSI3AXQ6ZN24XJEHHA4PA”, “SatelliteID”: “12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”, “Action”: “GET_AUDIT”, “error”: “rpc error: code = NotFound desc = open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ig/m5n3fuv34r2jocgxk3k6a2m3glrc6ysi3axq6zn24xjehha4pa: no such file or directory”}
2019-08-18T20:52:58.113Z ERROR server rpc error: code = NotFound desc = open config/storage/blobs/ukfu6bhbboxilvt7jrwlqk7y2tapb5d2r2tsmj2sjxvw5qaaaaaa/ig/m5n3fuv34r2jocgxk3k6a2m3glrc6ysi3axq6zn24xjehha4pa: no such file or directory

Have you shutdown the DUC on your previous location?
Please, configure your router to update your DDNS address with a new public IP when it changed.
Use either DUC or router, don’t use both.
Please, compare the WAN IP on the main page of your router with IP there: https://www.yougetsignal.com/tools/open-ports/ , they should match, otherwise your port forwarding will not work.
Please, compare an output of the command:

nslookup knusperkai.dyndns.org 8.8.8.8

with IP on yougetsignal, they should match too

The new computer is in the same network and the forwarding is working as far as i can see.

I do get new data, it seems that just some parts are missing after migration.

But independend on the portforwarding the existing data should still appear in the dashboard, right?

Yes.
Please, show the output of the commands:

ls -l /mnt/storj/
ls -l /mnt/storj/nas

nas@nas:~$ ls -l /mnt/storj
total 8
drwxr-xr-x 2 root root 4096 Aug 18 17:03 identity
drwxr-xr-x 5 root root 4096 Aug 18 19:27 nas

nas@nas:/mnt/storj/nas$ ls -l /mnt/storj/nas
total 124
drwxr-xr-x 4 root root 4096 Aug 18 16:36 backup
-rw-r–r-- 1 root root 873 Aug 18 19:27 config.yaml
-rw------- 1 root root 131072 Aug 18 21:32 kademlia
drwx------ 2 root root 4096 Aug 18 16:36 lost+found
-rw------- 1 root root 32768 Aug 18 20:12 revocations.db
drwx------ 5 root root 4096 Aug 18 20:12 storage

Please, show the output of this command:

ls -l /mnt/storj/nas/backup

nas@nas:/mnt/storj/nas$ ls -l /mnt/storj/nas/backup
total 128
-rw-r–r-- 1 root root 872 Aug 18 16:36 config.yaml
drwxr–r-- 3 root root 4096 Aug 18 16:36 identity
-rw------- 1 root root 131072 Aug 18 16:36 kademlia
-rw------- 1 root root 32768 Aug 18 16:36 revocations.db
drwx------ 5 root root 4096 Aug 18 16:36 storage

Please, show the output of these commands:

du -hd1 /mnt/storj/nas/storage
du -hd1 /mnt/srorj/nas/backup/storage

I think, you already got it. Seems your previous data in the backup folder

nas@nas:/mnt/storj/nas$ sudo du -hd1 /mnt/storj/nas/storage
204G /mnt/storj/nas/storage/blobs
4.0K /mnt/storj/nas/storage/garbage
4.0K /mnt/storj/nas/storage/temp
204G /mnt/storj/nas/storage

nas@nas:/mnt/storj/nas$ sudo du -hd1 /mnt/storj/nas/backup/storage
22M /mnt/storj/nas/backup/storage/blobs
4.0K /mnt/storj/nas/backup/storage/garbage
4.0K /mnt/storj/nas/backup/storage/temp
22M /mnt/storj/nas/backup/storage

no, the backup contains much less data

try to restart the container:

docker restart -t 300 storagenode 

I did so but still the same issue.

Storage Node Dashboard ( Node Version: v0.17.0 )

======================

ID 17Rm3wo9zb6G1zSZDwhY5JvSegRNTFM3L6gQjFRuKAAiY4pi49
Last Contact 0s ago
Uptime 36s

               Available         Used       Egress     Ingress
 Bandwidth       60.0 TB       1.3 GB     448.2 MB      0.8 GB (since Aug 1)
      Disk       10.0 TB     504.4 MB

Bootstrap bootstrap.storj.io:8888
Internal 127.0.0.1:7778
External knusperkai.dyndns.org:28967

Neighborhood Size 160

Please, delete the config.yaml and restart the container

Deleted, after restart a new one is in place but the same thing here…

Please show the output of this command:

docker exec -it storagenode ls -l /app/config
docker exec -it storagenode du -hd1 /app/config

nas@nas:~$ sudo docker exec -it storagenode ls -l /app/config
total 128
drwxr-xr-x 4 root root 4096 Aug 18 16:36 backup
-rw------- 1 root root 5783 Aug 18 21:52 config.yaml
-rw------- 1 root root 131072 Aug 19 05:09 kademlia
drwx------ 2 root root 4096 Aug 18 16:36 lost+found
-rw------- 1 root root 32768 Aug 18 21:52 revocations.db
drwx------ 5 root root 4096 Aug 18 21:52 storage

nas@nas:~$ sudo docker exec -it storagenode du -hd1 /app/config
204.6G /app/config/storage
22.1M /app/config/backup
4.0K /app/config/lost+found
204.6G /app/config

I think I’ve found the problem.

The previous storage folder is 290G large, after copying it over to the new computer is is just 204G.

I don’t know if this explains why the dashboard shows just the new uploaded files but it would explain why I have just in some cases the error of missing files displayed inside the log.

1 Like

i did copy all the files again by using the command rsync… instead of cp… and now the dashboard is showing all the previous data.

problem is solved.

now the node is not vetted anymore but i guess that i have to wait just a bit of time to be vetted again.

Thanks for the support! :+1: