Understanding what is being logged under "download started" / "downloaded"

Node Operators
1

Say I want to understand, which “download started” matches which “downloaded”. Is there any way to do that? I seem to miss some unique identifier.

[root@localhost ~]# grep RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ /storj/node.log | tail -10
2022-12-26T21:42:36.488Z        INFO    piecestore      download started        {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:43:34.828Z        INFO    piecestore      download started        {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:43:36.057Z        INFO    piecestore      downloaded      {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:44:09.087Z        INFO    piecestore      download started        {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:44:09.935Z        INFO    piecestore      downloaded      {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:44:27.675Z        INFO    piecestore      downloaded      {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:57:06.643Z        INFO    piecestore      download started        {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:59:39.926Z        INFO    piecestore      downloaded      {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T21:59:42.178Z        INFO    piecestore      download started        {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
2022-12-26T22:02:26.847Z        INFO    piecestore      downloaded      {"Process": "storagenode", "Piece ID": "RPHWUNFW536OAM4JTA6X5Q2IJGL326TGTM34YOEDBJLGMTHTKOYQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "GET"}
[root@localhost ~]#
2

I don’t think it’s possible, especially if the customer wants to download pieces from multiple locations. There is no something like session-id.

3

So “download started” even means that someone started overall file download, not that piece on my node was started to be downloaded?

4

Yeah, each download started means that there is a new request from some customer (or Storj for repairs, audits, etc.) requesting some part of the piece whose ID is as shown.

Multiple download started just mean there are concurrent requests for the same piece. These may be different customers requesting the same file, or a single customer requesting different parts of the file, or even a single customer re-requesting the same piece.

5

No what I meant is that from Alexeys comment he suggests that “download started” doen’t mean my node’s piece download has started, but rather overall file download has started.

6

As far as I’m aware there are no scenarios which would cause a piece download on your node, but not others. It’s always some form of file access which will hit other nodes as well, either a download, repair or audit action.

3 Likes
7

hello,
i want to kwow the difference between [“download started” / “downloaded”] or upload started / upload

upload means : ???
upload without started means : ???

is it bad to have many xxxx STARTED ?

image

thanks for reply :slight_smile:

8

Think of this as a train (file) coming to your platform (computer). The train has started arriving (upload started) to the platform. Train (file) has arrived (uploaded).

FILE is Uploaded TO YOUR COMPUTER.

No it is not bad but if you just see upload/download started but no uploaded/downloaded then there is a problem.

3 Likes
9

@nerdatwork
thx :slight_smile: all clear
best regards

2 Likes