Migrate node from Windows 10 to Raspberry Pi

Node Operators FAQ
1

Hey all,
I currently have a node set up in a windows 10 system using a RAID1 NTFS file type system. I want to move it to my raspberry pi following the guide which sets the harddrive with a ext4 type files system. See the forum guide:

The problem is, I should transfer my existing node to the harddrive with the ext4 type system, which I cannot read with Windows 10. I would have to use Ext2Fsd tool to read/write from Windows 10 but i heard it is unreliable.

I also found the following guide https://www.pinode.co.uk/storj-host-raspberry-pi.html
which could perhaps fulfill my needs but I want to check with everyone about the best way forward. Has anyone migrated a node from Windows 10 NTFS to a linux based filetype system before?

Cheers,
Adam

1 Like
2

options off the top of my head:

  1. Use smb on rpi and copy the files on your windows system from the drive to the new location
  2. Use an ubuntu live-cd and transfer files there (probably the fastest method if you raid is supported by ubuntu)
3

You can use winscp to transfer all of the files to your rpi, Might take awhile but theres not alot of ways, I think rsync also works aswell.

4

You can use rsync. You need to enable WSL on your Windows 10 and install Ubuntu from the Microsoft Store. Then you can run Ubuntu shell from the Windows and use the rsync from there, while your node still running on the Windows 10.
The path to your D: disk for example will be /mnt/d
so the command will looks like (Ubuntu shell/bash):

rsync -r /mnt/d/Storj/storage pi@192.168.1.68:/mnt/Storj/

assuming that the IP of your pi is 192.168.1.68, the user there pi, the source path of data is D:\Storj\storage, the destination on your pi is /mnt/Storj.

You should run that command a few times. When the difference will be a small, then shutdown your node on the Windows (elevated Powershell):

Stop-Service storagenode
Set-Service storagenode -StartupType Disabled

and do the rsync last time, but with a --delete option.
You can transfer the identity the same way.

Then run the storagenode on your pi and uninstall the Windows GUI.

5 Likes
5

Thanks Alexey,

I’m assuming the above command

rsync -r /mnt/d/Storj/storage pi@192.168.1.68:/mnt/Storj/

will point directly to my mounted drive had i done it like this:

sudo mount /dev/sda1 /mnt/storagenode

which is exactly the instructions i followed here. Will this sync over my local network? Therefore, I do NOT plug my harddrive in with the ext4 filesystem into my windows 10 PC. I think I interpret it correctly but i want to make sure.
Thanks,
Adam

6

Also, btw, in Windows 10 I have the drive D:\ (4TB) connected via a USB 3.0 port. Therefore, do i need to first mount the harddrive within WSL? For example, do i do this:

sudo mkdir /mnt/d

or are the drives mounted by default.

Cheers,
Adam

7

They are typically mounted by default. Just check what’s inside /mnt/d

8

Then that command will looks like:

rsync -r /mnt/d/Storj/storage pi@192.168.1.68:/mnt/storagenode

no, they are mounted automatically

9

Hey @Alexey,

I know if the rsync process is working by putting a P after the -r, e.g., like this rsync -rP … That’s nice! I’m monitoring the transfer on my pi side… but it doesn’t seem the storagenode folder is increasing in size… I’ll just wait for a couple of hours.

Cheers,
Adam

10

By the way, I can recommend to place the storage data inside the folder on the disk, in case of disk lose this folder will not be exist and node will fail, but will not start from scratch and will not be disqualified because of data lose: Storagenode keeps writing data after mounted drive lost

1 Like
11

Unfortunately, at the last rsync hangs due to the large block size of some files.

you need to add

–block-size=508576

or what ever the max block size it indicates. See Rsync hangs on large files - Quick fixes !!

12

dont recomend moove at all GUI to raspberry, GUI nodes success rate is better.
But it is only my vision.

13

Hey,
That’s dependent on many things, e.g., specs of raspberry and the OS understanding. But I agree… in fact… it is much more difficult. Fortunately, I enjoy the pain.
Cheers,
Adam

1 Like
14

my compare resalts gived 8-10% on rassperry 78 on GUI

15

That is not neccesarily what matters. You don’t get paid for upload anyway so the download successrate is far more interesting.
Of course you need upload to fill your drive but currently my drives are all pretty full anyway…

16

if you have 2-3 TB it is not big problem, if you have 30-40TB it is other picture.
I am migrating my raspberry to GUI, litle problematic EXT4 to NTFS copy 1.1TB

17

My raspberry pi just have as much storage filled as my Windows node. It just collect more big pieces than a Windows node.
So, I think it works well.

1 Like
18

A post was split to a new topic: Migrate from raspberry pi to the Windows