Rate limiting under 100 RPS (HTTP 403 errors)

Developer Discussions DCS
1

Our application randomly seems to get rate limited when using the S3 Gateway MT, even though we can confirm that we’re under 100 RPS. During uploads, there will suddenly be an HTTP 403 error that stops the upload in its tracks for our users, which cannot continue.

How is the rate limit actually calulcated? Is it 1 request per 0.01 seconds, or 100 requests per second? Anybody else being rate limited using the S3 gateway?

2

Usage limits: Billing, Payment and Accounts | Storj Docs

You can contact support for increase in higher limits.

https://supportdcs.storj.io/hc/en-us/requests/new?ticket_form_id=360000683212

2 Likes
3

I would like to suggest to take a look on Hotrodding Decentralized Storage to increase speed of uploads by not increasing number of requests but increasing chunks size and parallelism.

1 Like