# After a few files have been uploaded, the upload stops

**URL:** <https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129>\
**Category:** Product Discussions\
**Created:** [April 16, 2022, 4:55am UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129 "2022-04-16T04:55:39Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![weeix](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/weeix/32/10634_2.png) [@weeix](https://forum.storj.io/u/weeix)\
**Post date:** [April 16, 2022, 4:55am UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129/1 "2022-04-16T04:55:39Z")

</div>

**Edit:** Today I tried the hosted gateway pattern and uploaded those ~8 GB files within ~20 minutes without any errors at all. Didn’t know why I thought I had already tried this pattern. Maybe I was confused.

**Original post:**

> Hi,
> 
> My upstream bandwidth is about 200 Mbps. I’m using restic 0.11.0 and rclone 1.58.0 to backup ~1000 files (~8 GB) via [ap1.storj.io](http://ap1.storj.io) (I tried ~~both~~ the native ~~and hosted gateway~~ pattern). However, after some files have been uploaded, a lot of errors (successful puts less than success/repair threshold) appear, and the backup will eventually fail.
> 
> ![At this point, no more files were uploaded, and the ETA keeps increasing](https://storj-s3.bcdn.literatehosting.net/original/2X/a/a07d32dbcd6ab10c783d0ad7b7118651d6ad602c.png)
> 
> Since restic can resume the backup job, I created a cron job to backup every hour. However, only ~400 files (~3.2 GB) had been uploaded after a night.
> 
> ![Network throughput overnight](https://storj-s3.bcdn.literatehosting.net/original/2X/8/8ac76ea56fdb2af3849e70acd08be1830810e567.jpeg)
> 
> I thought this had something to do with rclone, so I tried FileZilla instead. Unfortunately, FileZilla also throws errors after some successful uploads.
> 
> ![FileZilla starts throwing errors after 18 files have been successfully uploaded](https://storj-s3.bcdn.literatehosting.net/original/2X/9/9f9444deb07fe475f88eb8a276a451298b175f68.png)
> 
> Any ideas on how to troubleshoot this issue?
> 
> Thank you.

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [April 16, 2022, 7:49am UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129/2 "2022-04-16T07:49:37Z")

</div>

Do you have any outbound firewall rules? Like limiting what services, IPs or ports you can connect from your PC?  
If so - you need to remove them. The native integration uses p2p mechanism to spread pieces across the globe. The end storage nodes could have literally any IP and port, so you must not limit your outgoing connections.

Take into account that the native integration creates 110 connections for each segment (less or equal 64MB), the restic and rclone uses several threads to upload for each big file and several parallel file uploads, so you can multiple number of connections to the number of threads and to the number of parallel uploads. Your router will have a hard time to manage so much connections and if it’s not capably - most of the “excess” connections will fail.  
This is especially true if you use a WiFi connection - it’s not capable for many heavy connections (highly depends on your router though).  
The same is true for FileZilla - it uses several parallel uploads by default.  
You can manage that by limiting number of parallel uploads and threads to the acceptable for your router level and/or use a wired connection where is possible.  
The s3-compatible integration (via GatewayMT) uses one connection per upload, it can use more connections for multipart uploads though, however it’s not hundreds of connections like with p2p.  
See also [Hotrodding Decentralized Storage](https://forum.storj.io/t/hotrodding-decentralized-storage/15228)

---

<div class="post-metadata">

**Author:** ![weeix](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/weeix/32/10634_2.png) [@weeix](https://forum.storj.io/u/weeix)\
**Post date:** [April 16, 2022, 8:38am UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129/3 "2022-04-16T08:38:48Z")

</div>

My router (Huawei HG8245W5 with ISP firmware​) doesn’t have the firewall option. The option that resembles a firewall the most seems to be _IPv4/6 Address Filtering_, to which I only added a few IPv6 rules to it (didn’t enable IP filter for IPv4 though).

 ![IPv6 Address Filtering](https://storj-s3.bcdn.literatehosting.net/original/2X/d/df4dd236fec7cc8a1e1e28a448d6730e7d0c8651.png)

I assumed that my ISP hid this option in their firmware. Maybe to prevent BitTorrent from dominating their network?

I used a wired connection when using restic+rclone and a WiFi connection when using FileZilla.

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [April 16, 2022, 9:12am UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129/4 "2022-04-16T09:12:14Z")

</div>

These filters for incoming (Downstream) connections not outcoming (Upstream). So I can assume that your router doesn’t have outbound filtering rules.  
And I can assume that you doesn’t have a local firewall on the device where you run restic or FileZilla, or their firewalls doesn’t have outbound rules too.

I would recommend to experiment with number of parallel uploads and number of threads to find the allowed limit or use a GatewayMT.

---

<div class="post-metadata">

**Author:** ![weeix](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/weeix/32/10634_2.png) [@weeix](https://forum.storj.io/u/weeix)\
**Post date:** [April 16, 2022, 10:49am UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129/5 "2022-04-16T10:49:34Z")

</div>

I just read [an article about throttling](https://www.highspeedinternet.com/resources/how-can-i-tell-if-my-internet-is-being-throttled-by-my-isp) and tried connecting to a VPN before transferring the files via FileZilla.

Results: No more errors! 🎉

 ![Transfering via FileZilla+VPN](https://storj-s3.bcdn.literatehosting.net/original/2X/2/2314768fbeb7b1bf63d7aaffe23f3be49683703c.png)

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [April 16, 2022, 2:38pm UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129/6 "2022-04-16T14:38:05Z")

</div>

Seems it’s your ISP. Weird. Even in Russia they do not interfere with traffic… yet…

---

<div class="post-metadata">

**Author:** ![Alexey](https://storj.bcdn.literatehosting.com/user_avatar/forum.storj.io/alexey/32/41_2.png) [@Alexey](https://forum.storj.io/u/Alexey)\
**Post date:** [April 17, 2022, 1:46pm UTC](https://forum.storj.io/t/after-a-few-files-have-been-uploaded-the-upload-stops/18129/7 "2022-04-17T13:46:18Z")

</div>

By the way, please take a look:

> [@Too many connection errors on Windows node](https://forum.storj.io/t/too-many-connection-errors-on-windows-node/17712/5):
>
> I found the problem! You were right about the router. The “Enable DoS protection” in Firewall router’s settings is causing the error. After deactivating it, all “contact:service ping satellite failed” errors are gone. You should mention this in the install docs of storagenode.
