Can't get rclone to work

Developer Discussions
1 
# rclone config
No remotes found, make a new one?
n) New remote
s) Set configuration password
q) Quit config
n/s/q> n

Enter name for new remote.
name> storj-fu

Option Storage.
Type of storage to configure.
Choose a number from below, or type in your own value.
[snip]
Storage> s3
Option provider.
Choose your S3 provider.
Choose a number from below, or type in your own value.
Press Enter to leave empty.
[snip]
provider> Storj
Option env_auth.
Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
Only applies if access_key_id and secret_access_key is blank.
Choose a number from below, or type in your own boolean value (true or false).
Press Enter for the default (false).
 1 / Enter AWS credentials in the next step.
   \ (false)
 2 / Get AWS credentials from the environment (env vars or IAM).
   \ (true)
env_auth> 1

Option access_key_id.
AWS Access Key ID.
Leave blank for anonymous access or runtime credentials.
Enter a value. Press Enter to leave empty.
access_key_id> jvzohkaclwulrmq6irokuu7vp7ya

Option secret_access_key.
AWS Secret Access Key (password).
Leave blank for anonymous access or runtime credentials.
Enter a value. Press Enter to leave empty.
secret_access_key> [redacted]

Option endpoint.
Endpoint for Storj Gateway.
Choose a number from below, or type in your own value.
Press Enter to leave empty.
 1 / Global Hosted Gateway
   \ (gateway.storjshare.io)
endpoint> 1

Edit advanced config?
y) Yes
n) No (default)
y/n> n

Configuration complete.

The access token and secret are the same as I’m using for Mastodon. Now when I run rclone copy test storj-fu:test, I get:

2023/02/06 21:43:52 ERROR : Attempt 1/3 failed with 1 errors and: Forbidden: Forbidden
        status code: 403, request id: 17415A4F41D8CC94, host id: 
2023/02/06 21:43:52 ERROR : Attempt 2/3 failed with 1 errors and: Forbidden: Forbidden
        status code: 403, request id: 17415A4F464A08A4, host id: 
2023/02/06 21:43:53 ERROR : Attempt 3/3 failed with 1 errors and: Forbidden: Forbidden
        status code: 403, request id: 17415A4F4A629FF3, host id: 
2023/02/06 21:43:53 Failed to copy: Forbidden: Forbidden
        status code: 403, request id: 17415A4F4A629FF3, host id:

What should I do?

2

What is likely happening is your S3 credentials were restricted to a certain bucket, so it doesn’t have permission to upload to the bucket you’ve specified.

Screenshot 2023-02-06 at 3.17.42 PM
Screenshot 2023-02-06 at 3.17.42 PM409Ă—741 29.2 KB

What you can do is create new S3 credentials that includes your test bucket or have the access be for “All”

Screenshot 2023-02-06 at 3.19.09 PM
Screenshot 2023-02-06 at 3.19.09 PM396Ă—697 26.5 KB

2 Likes
3

But I can list files just fine with rclone ls storj-fu:. And the key ID and secret is the same as I’m using for Mastodon.

4

The bucket name follows the : so it’s trying to upload to a bucket named test which either doesn’t exist or it doesn’t have permission to do so.

I think your bucket name was freakuniversity from your other post, so you’ll likely need to do something like rclone copy test storj-fu:freakuniversity/test

4 Likes
5

I made a new bucket on the web. Let’s call it foo-backups. Then I ran uplink share --register --readonly=true --disallow-lists --not-after=none sj://foo-backups. Then I added the following to my ~/.config/rclone/rclone.conf, using the values outputted by uplink:

[storj-foo-backups]
type = s3
provider = Storj
access_key_id = [...]
secret_access_key = [...]
endpoint = gateway.storjshare.io

This is identical to a prior remote I set up called storj-fu in the same config file, just with different access keys. However, when I run echo hello world > test followed by rclone move test storj-foo-backups:foo-backups/, I get the following:

2023/04/15 05:11:57 ERROR : test: Failed to copy: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4BBE09EBE, host id: 
2023/04/15 05:11:57 ERROR : test: Not deleting source as copy failed: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4BBE09EBE, host id: 
2023/04/15 05:11:57 ERROR : Attempt 1/3 failed with 1 errors and: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4BBE09EBE, host id: 
2023/04/15 05:11:57 ERROR : test: Failed to copy: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4C9E2D15A, host id: 
2023/04/15 05:11:57 ERROR : test: Not deleting source as copy failed: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4C9E2D15A, host id: 
2023/04/15 05:11:57 ERROR : Attempt 2/3 failed with 1 errors and: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4C9E2D15A, host id: 
2023/04/15 05:11:57 ERROR : test: Failed to copy: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4D808486C, host id: 
2023/04/15 05:11:57 ERROR : test: Not deleting source as copy failed: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4D808486C, host id: 
2023/04/15 05:11:57 ERROR : Attempt 3/3 failed with 1 errors and: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4D808486C, host id: 
2023/04/15 05:11:57 Failed to move: AccessDenied: Access Denied.
	status code: 403, request id: 175603A4D808486C, host id:

What am I doing wrong?

6

Nevermind, forgot I already went through this in Can't get rclone to work.

1 Like