Getting "error retrieving piece 09" errors

Product Discussions
1 
uplink cp -p 10 -t 10 sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst .
download sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst to akashnet-2_2023-10-08T05:00:02.tar.zst
failed to download part 5: uplink: eestream: failed to download stripe 0:
error retrieving piece 09: used serial already exists in store
error retrieving piece 102: used serial already exists in store
error retrieving piece 103: used serial already exists in store
error retrieving piece 15: used serial already exists in store
error retrieving piece 19: used serial already exists in store
error retrieving piece 24: used serial already exists in store
error retrieving piece 31: used serial already exists in store
error retrieving piece 46: used serial already exists in store
error retrieving piece 51: used serial already exists in store
error retrieving piece 82: used serial already exists in store
error retrieving piece 99: used serial already exists in store
failed to download part 3: context canceled
failed to download part 2: context canceled
failed to download part 1: uplink: metaclient: context canceled
failed to download part 0: context canceled
failed to download part 7: context canceled
failed to download part 9: context canceled
failed to download part 6: context canceled
failed to download part 4: context canceled
failed to download part 8: context canceled

This download was working perfectly a few minutes before, then I needed to stop and restart it elsewhere, on the same machine, and I started getting these errors less than a minute into running.

uplink version
Release build
Version:            v1.88.3
Build timestamp:    27 Sep 23 20:52 CEST
Git commit:         68e1a740044fd126129f905d1af44dda9a23efd9

PATH                      VERSION
storj.io/storj            (devel)
storj.io/common           v0.0.0-20230907123639-5fd0608fd947
storj.io/drpc             v0.0.33
storj.io/monkit-jaeger    v0.0.0-20220915074555-d100d7589f41
storj.io/picobuf          v0.0.2-0.20230906122608-c4ba17033c6c
storj.io/private          v0.0.0-20230824104110-1eac532af65a
storj.io/uplink           v1.11.1-0.20230907122241-39cbd8e765dc
2

Trying the same command in a new directory

uplink cp -p 10 -t 10 sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst .
download sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst to akashnet-2_2023-10-08T05:00:02.tar.zst
failed to download part 1: uplink: eestream: failed to download stripe 0:
error retrieving piece 07: used serial already exists in store
error retrieving piece 103: used serial already exists in store
error retrieving piece 11: used serial already exists in store
error retrieving piece 22: used serial already exists in store
error retrieving piece 50: used serial already exists in store
error retrieving piece 52: io: read/write on closed pipe
error retrieving piece 55: used serial already exists in store
error retrieving piece 69: used serial already exists in store
error retrieving piece 70: used serial already exists in store
error retrieving piece 71: used serial already exists in store
error retrieving piece 89: used serial already exists in store
failed to download part 3: uplink: metaclient: rpc: tcp connector failed: rpc: context canceled
failed to download part 0: uplink: metaclient: rpc: tcp connector failed: rpc: context canceled
failed to download part 8: uplink: eestream: failed to download stripe 0:
error retrieving piece 02: context canceled
error retrieving piece 15: context canceled
error retrieving piece 23: context canceled
error retrieving piece 26: context canceled
error retrieving piece 47: context canceled
error retrieving piece 50: context canceled
error retrieving piece 68: context canceled
error retrieving piece 72: context canceled
error retrieving piece 79: context canceled
error retrieving piece 80: context canceled
error retrieving piece 94: context canceled
failed to download part 2: context canceled
failed to download part 5: uplink: eestream: failed to download stripe 0:
error retrieving piece 102: drpc: stream terminated by sending close
error retrieving piece 15: context canceled
error retrieving piece 19: io: read/write on closed pipe
error retrieving piece 24: io: read/write on closed pipe
error retrieving piece 31: io: read/write on closed pipe
error retrieving piece 32: io: read/write on closed pipe
error retrieving piece 46: context canceled
error retrieving piece 47: context canceled
error retrieving piece 49: ecclient: rpc: dial tcp 91.222.236.208:6007: operation was canceled
error retrieving piece 82: context canceled
error retrieving piece 99: io: read/write on closed pipe
failed to download part 4: context canceled
failed to download part 9: uplink: eestream: failed to download stripe 0:
error retrieving piece 103: context canceled
error retrieving piece 105: context canceled
error retrieving piece 10: context canceled
error retrieving piece 30: context canceled
error retrieving piece 58: context canceled
error retrieving piece 61: context canceled
error retrieving piece 65: context canceled
error retrieving piece 69: context canceled
error retrieving piece 70: ecclient: rpc: dial tcp 82.165.177.195:28967: operation was canceled
error retrieving piece 84: context canceled
error retrieving piece 90: context canceled
failed to download part 7: context canceled
failed to download part 6: uplink: metaclient: rpc: tcp connector failed: rpc: context canceled
3

In another attempt, in which 10s of GB had downloaded

uplink cp -p 10 -t 10 sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst .
download sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst to akashnet-2_2023-10-08T05:00:02.tar.zst
failed to download part 37: uplink: eestream: failed to download stripe 0:
error retrieving piece 07: used serial already exists in store
error retrieving piece 08: used serial already exists in store
error retrieving piece 101: used serial already exists in store
error retrieving piece 16: used serial already exists in store
error retrieving piece 32: used serial already exists in store
error retrieving piece 49: used serial already exists in store
error retrieving piece 56: used serial already exists in store
error retrieving piece 59: used serial already exists in store
error retrieving piece 71: used serial already exists in store
error retrieving piece 81: used serial already exists in store
error retrieving piece 92: used serial already exists in store
failed to download part 30: uplink: eestream: failed to download stripe 0:
error retrieving piece 00: context canceled
error retrieving piece 01: context canceled
error retrieving piece 02: context canceled
error retrieving piece 05: context canceled
error retrieving piece 102: context canceled
error retrieving piece 106: context canceled
error retrieving piece 43: ecclient: rpc: dial tcp 37.46.115.25:22379: connect: connection refused
error retrieving piece 45: context canceled
error retrieving piece 59: context canceled
error retrieving piece 95: context canceled
error retrieving piece 96: context canceled
failed to download part 36: context canceled
failed to download part 32: context canceled
failed to download part 35: uplink: eestream: failed to download stripe 704:
error retrieving piece 00: context canceled
error retrieving piece 07: context canceled
error retrieving piece 08: context canceled
error retrieving piece 09: context canceled
error retrieving piece 35: context canceled
error retrieving piece 41: context canceled
error retrieving piece 53: context canceled
error retrieving piece 54: context canceled
error retrieving piece 70: context canceled
error retrieving piece 85: context canceled
error retrieving piece 99: context canceled
failed to download part 31: context canceled
failed to download part 39: uplink: eestream: failed to download stripe 0:
error retrieving piece 03: context canceled
error retrieving piece 04: context canceled
error retrieving piece 100: context canceled
error retrieving piece 108: context canceled
error retrieving piece 32: context canceled
error retrieving piece 39: context canceled
error retrieving piece 54: context canceled
error retrieving piece 58: context canceled
error retrieving piece 59: context canceled
error retrieving piece 80: context canceled
error retrieving piece 95: context canceled
failed to download part 38: uplink: metaclient: rpc: tcp connector failed: rpc: context canceled
failed to download part 34: context canceled
failed to download part 33: context canceled
4

Hi @DanielSimplyStaking, thanks for reporting this issue to us. Could you check if you’re still having problems after decreasing the parallelism count from 10 to a lower number?

3 Likes
5

Hi Jeremy,

thanks for your reply.
I’ve tried lowering from 10 to 7, 5, 3, 2, and 1

3 
uplink cp -p 3 -t 3 sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst .
download sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst to akashnet-2_2023-10-08T05:00:02.tar.zst
failed to download part 0: uplink: eestream: failed to download stripe 0:
error retrieving piece 04: used serial already exists in store
error retrieving piece 100: used serial already exists in store
error retrieving piece 11: used serial already exists in store
error retrieving piece 18: used serial already exists in store
error retrieving piece 19: used serial already exists in store
error retrieving piece 21: used serial already exists in store
error retrieving piece 26: used serial already exists in store
error retrieving piece 31: used serial already exists in store
error retrieving piece 70: used serial already exists in store
error retrieving piece 81: used serial already exists in store
error retrieving piece 86: used serial already exists in store
failed to download part 1: context canceled
failed to download part 2: uplink: eestream: failed to download stripe 4864:
error retrieving piece 02: used serial already exists in store
error retrieving piece 18: used serial already exists in store
error retrieving piece 20: used serial already exists in store
error retrieving piece 22: used serial already exists in store
error retrieving piece 27: used serial already exists in store
error retrieving piece 29: context canceled
error retrieving piece 64: used serial already exists in store
error retrieving piece 73: used serial already exists in store
error retrieving piece 74: used serial already exists in store
error retrieving piece 88: used serial already exists in store
error retrieving piece 98: used serial already exists in store
2 
uplink cp -p 2 -t 2 sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst .
download sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst to akashnet-2_2023-10-08T05:00:02.tar.zst
failed to download part 1: uplink: eestream: failed to download stripe 0:
error retrieving piece 101: used serial already exists in store
error retrieving piece 103: used serial already exists in store
error retrieving piece 106: used serial already exists in store
error retrieving piece 108: used serial already exists in store
error retrieving piece 11: used serial already exists in store
error retrieving piece 22: used serial already exists in store
error retrieving piece 37: used serial already exists in store
error retrieving piece 40: used serial already exists in store
error retrieving piece 42: used serial already exists in store
error retrieving piece 79: used serial already exists in store
error retrieving piece 89: used serial already exists in store
failed to download part 0: context canceled
1 
uplink cp -p 1 -t 1 sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst .
download sj://akash-snapshots/rpc-archival/akashnet-2_2023-10-08T05:00:02.tar.zst to akashnet-2_2023-10-08T05:00:02.tar.zst
failed to download part 0: uplink: eestream: failed to download stripe 0:
error retrieving piece 07: used serial already exists in store
error retrieving piece 105: used serial already exists in store
error retrieving piece 107: used serial already exists in store
error retrieving piece 21: used serial already exists in store
error retrieving piece 38: used serial already exists in store
error retrieving piece 43: used serial already exists in store
error retrieving piece 46: used serial already exists in store
error retrieving piece 70: used serial already exists in store
error retrieving piece 72: used serial already exists in store
error retrieving piece 79: used serial already exists in store
error retrieving piece 88: ecclient: rpc: dial tcp 77.228.5.223:28967: connect: no route to host

Unfortunately no luck yet

6

Thank you for the information. Are you aware if this issue occurs in any previous versions of Uplink?

1 Like
7

We had used uplink in the past (~December 2022) to download an earlier version of this very same file, and to my knowledge we didn’t face these issues, however this was quite a while ago so I might not remember correctly.

8

He meant to use an older binary of uplink, like v1.76.2

9

Thanks @Alexey , it worked perfectly right away with the version you suggested!

2 Likes
10

9 posts were split to a new topic: Uplink: failed to upload enough pieces (needed at least 80 but got 78)