Changelog v0.26.2

Product Discussions STORJLINGS
1

Satellite names in storage node webUI
Instead of satelliteIDs you can now see the satellite names on the storage node webUI.

Increase default difficulty Part 2
As mentioned in the last changelog we are increasing the difficulty from 30 to 36. Now the certificate authority is updated as well. This change is needed to protect the network against different attacks. This change only effects the identity generation and signing. You can still use an old identity with a lower difficulty as long as it is already signed.

dRPC by default
Now all binaries are compiled with dRPC. If you are compiling from source you can remove -tags=grpc

Several performance improvements
This release contains many performance improvements. If you are running an uplink or gateway please update and test the new performance.

6 Likes
2

Nice!

Quick question, is the satellite url stored in the local db’s somewhere?
I was trying to see if I could pull the url from somewhere for the earnings calculator instead of deriving it using a hardcoded list (which is not exactly future proof). I couldn’t find it though.

3

How about this one: https://github.com/storj/storj/blob/6a4389d3e14d6dd190ebeb367be395e6a8f38042/pkg/rpc/known_ids.go#L18-L24

1 Like
4

Ah, thanks. My search skills apparently have failed me.

Looks like it’s hard coded on your end as well. I’ll leave it as is for now then. I could use the API, but that requires some more setup for the end user as the script would need to know the IP and port to use and the port actually has to be forwarded etc. I don’t think that trade-off is worth it for now.

5

See somthing new (errors):

docker logs storagenode 2>&1 | grep "delete failed"

2019-11-20T20:21:09.236Z        ERROR   piecestore      delete failed   {"Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Piece ID": "SAANASYMFRNV6QT6KERLTDJKFK42MFITJW6UYWDDOLSBUOHI4S2Q", "error": "pieces error: context canceled; v0pieceinfodb error: context canceled", "errorVerbose": "pieces error: context canceled; v0pieceinfodb error: context canceled\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:275\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Delete:156\n\tstorj.io/storj/pkg/pb.DRPCPiecestoreDescription.Method.func3:846\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51"}
2019-11-22T14:01:13.026Z        ERROR   piecestore      delete failed   {"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Piece ID": "YQGZTHURYHWTQFXSYQHTUY77KPV7AYZVZVCMNZYSULESVZAJMLUA", "error": "pieces error: context canceled; v0pieceinfodb error: context canceled", "errorVerbose": "pieces error: context canceled; v0pieceinfodb error: context canceled\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:275\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Delete:156\n\tstorj.io/storj/pkg/pb.DRPCPiecestoreDescription.Method.func3:846\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51"}
2019-11-22T14:35:25.898Z        ERROR   piecestore      delete failed   {"Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Piece ID": "LCWLUQOR4AV2RBNCLHIVVS2GP2XHHH4ZGHVB4Q6U7TUFNKPWPPAA", "error": "pieces error: context canceled; v0pieceinfodb error: context canceled", "errorVerbose": "pieces error: context canceled; v0pieceinfodb error: context canceled\n\tstorj.io/storj/storagenode/pieces.(*Store).Delete:275\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Delete:156\n\tstorj.io/storj/pkg/pb.DRPCPiecestoreDescription.Method.func3:846\n\tstorj.io/drpc/drpcserver.(*Server).doHandle:175\n\tstorj.io/drpc/drpcserver.(*Server).HandleRPC:153\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:114\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:147\n\tstorj.io/drpc/drpcctx.(*Tracker).track:51"}
6

Another interesting thing, satellite ask (gRPC) storagenode many times for repair piece that never exist on storagenode:

2019-11-22T20:01:32.900431052Z 2019-11-22T20:01:32.900Z INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T20:01:32.900816041Z 2019-11-22T20:01:32.900Z INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T20:01:32.900817383Z 2019-11-22T20:01:32.900Z ERROR   server  gRPC stream error response      {"error": "file does not exist"}

Details about piece:
docker logs storagenode 2>&1 | grep "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A"

Summary 
2019-11-22T10:17:09.233Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T10:17:09.233Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T10:19:07.532Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T10:19:07.532Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T11:17:09.296Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T11:17:09.297Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T11:27:04.025Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T11:27:04.025Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T12:17:09.320Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T12:17:09.320Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T13:17:09.770Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T13:17:09.771Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T14:17:12.575Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T14:17:12.576Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T15:17:10.705Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T15:17:10.705Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T15:27:12.366Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T15:27:12.367Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T16:17:15.521Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T16:17:15.521Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T16:27:02.800Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T16:27:02.801Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T17:17:10.527Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T17:17:10.528Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T18:17:09.723Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T18:17:09.724Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T19:17:10.045Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T19:17:10.046Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}
2019-11-22T20:01:32.900Z        INFO    piecestore      download started        {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR"}
2019-11-22T20:01:32.900Z        INFO    piecestore      download failed {"Piece ID": "2J5QUJ2QCYNH4IA6U56WJ5BQKKALRC6S54FXXUDRJZZQEG6HFO4A", "Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "Action": "GET_REPAIR", "error": "file does not exist"}

docker logs storagenode 2>&1 | grep -c "file does not exist"
446