Storage node CPU usage unusualy high

Hi. im seeing unusual CPU usage today, and yesterday too, looking weird,
just want to ask, is it normal there are 2 sometimes 4 sub services?
i though there should be 1 under storagenode program for Storj (its Windows GUI, 1.94.2)
is node being hacked or attacked by windows stupid antimalware lol?
Node seems working normally, traffic actually smaller than last weeks, logs shows normal activity uploads and downloads, no errors, no warns, just that CPU usage behaving weird. Momentally its 60-80 but only 1 node. Normally its 4-10% max. rest of nodes i see pretty normal CPU, mayby sometimes 2 times higher in few more nodes(up to 20%CPU), but thats it so far hmm.



Wich cpu?

i have 30%usage but the cpu throttles down to 400Mhz from time to time.
never seen those windows services but you use a vm?
tell about the setup…

I would recommend to stop the service (make sure all these processes disappeared too) and replace the binary with the fresh downloaded from GitHub.
If there is some malware attacked your node, it should gone with replace.

Today i looked at that node, and it has only 2 subservices, the AppX deployment and module installer disappeared, maybe it was doing some work for satelites? or GC-walker? and that triggered antimalware? idk.

i mean, let me people know, how’s Yours services looks like.

I have good margin of free CPU power, a 19800 passmark points 8core 16 threds, and anode instance tamed with 1 core and 2 Threds just in case, as You can see a Virtual Machine is usefull, if it would be a 100% CPU usage bug and it would be outside a VM, it would almost freeze entire computer machine…

I more suspect that windows 10 antimalware is trying to do something than its hacked, as win10 antimalware is craaaazy insane, and W10 it self is a spyware and does what it wants…
Also if im inspecting those, 1 other node i discovered a case when an storagenode.exe is doubled, and working lol, check this out:

points to same exe file in orginal directory sooo its maybe a bug? that updater alowed same exe to be opened 2 times?

Oh and i must say its the only node, that has someones other node in the same subnet, so this node share a IP subnet with someones else node, maybe updater f’ed up something and installed 2 times on my computer and runned exe 2 times because of that lol?

@Alexey oh i don’t bother, i just post it for You, to maybe have chance to make sure Your download source for automatic updates is not compromissed

edit: okay its not that, i just found 2nd node with 2 storagenode.exe running in same time, and it has no neigbors according to storjnet.info/neighbors

worry not, thats the (lazy) filewalker process. node uses bandwith too, filewalker does not.

Luckily i have
debug. addr: 127.0.0.1:5998
active on this node, i can check whatever You want and post

coz now it looks like this

not too much storagenode processes? is it normal?

looks like normal filewalk in a vm, maybe gc also?

Here some help from microsoft:

The high CPU usage by the Microsoft Software Protection Platform service (sppsvc.exe) can be caused by a number of factors. Here are some steps that might help you resolve the issue:

Restart the service: The first step you should try is to restart the sppsvc.exe service. To do this, press the Windows key + R to open the Run dialog box, then type “services.msc” and press Enter. Locate the “Microsoft Software Protection Platform” service in the list, right-click on it, and select “Restart”.

Update Windows: Outdated Windows can cause various issues, including high CPU usage by sppsvc.exe. Check for Windows updates and install any available updates.

Disable the service: If the service is not needed, you can disable it. Keep in mind that disabling the service might impact your ability to use certain software. To disable the service, follow the steps in the first bullet, but select “Stop” instead of “Restart”. Then, right-click on the service again and select “Properties”. In the Properties window, select the “Startup type” drop-down menu and select “Disabled”.

Scan for malware: Malware can cause high CPU usage and other issues. You should scan your system using an updated antivirus software to ensure that your system is not infected.
(try malwarebytes)
Repair or reinstall the software that uses sppsvc.exe: If the high CPU usage is caused by a specific software, repairing or reinstalling that software may resolve the issue.
(note: that is suggested by alexey)

Regards.

also i recommend to update the vmware drivers of the container.

these are Windows services, not related to the node. We do not install anything (but if it was infected with a malware - the malware can), especially with a storagenode process. We use a storagenode-updater service, which can update only storagenode and itself. It is also do not use Windows installers to do so.
So in my opinion something is fishy happened, I suspect virus and/or malware. This is why I recommend to replace the binary with a fresh one from GitHub.
Since it is now showed under storagenode-updater, this could mean that the malware is spreading out, slowly infecting each running process.
We do not use neither of these services in our code.

Two storagenode processes - one is storagenode, the second is a lazy filewalker - it’s running as a separate process.

If you use only the Windows Antimalware solution, no wonder you could have a virus. That crap should be banned from default installation; even though it came from a verry good av solution, Microsoft managed to make it crap.
Use a good licensed and payed av solution, and don’t rely only on Microsoft’s one.
You should stop to node, make what Alexey suggests, and scan the system with an online solution. I believe every major vendor offers free online scanning tools; see Bitdeffender, Kaspersky, Eset.

OT

Ok, you opened the door to hell :grimacing:
You really do not Need a paid AV suite. They can nothing, the Microsoft Tool cannot.

The opposite: These Kind of Software slows down your system and opens Potential attacking vectors to your System.

The best you can do is ne careful with attachments, Surfing and Software you dont know. And use a Router/Firewall and the Windows Tools.

Just my 2 cents

5 Likes

oh, i work in the pc field, and trust me, norton saved my ass at least 3 times.

with windows defender even an bing search for firefox can get you you multiple malicious links.

If you want nightmares, read hackernews and alike :grin:…
https://thehackernews.com/2024/01/new-docker-malware-steals-cpu-for.html

For now the biggest malware (beside Win10) is storagenode.exe :smiley:
it occasionally spikes CPU, (but not to 100%), and just for some tens of seconds soo yea…


and nothing in logs, just a normal uploads downloads, even almost no ERROR for failed uploads
and filewalker’s work up to this point goes bye bye, coz of auto-update to 1.95.1 … NOICE!

edit:
all i notice after 5 minutes of that CPU spike was:

2024-01-19T18:06:31+01:00	WARN	console:service	unable to get Satellite URL	{"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "error": "console: trust: satellite is untrusted", "errorVerbose": "console: trust: satellite is untrusted\n\tstorj.io/storj/storagenode/trust.init:29\n\truntime.doInit1:6740\n\truntime.doInit:6707\n\truntime.main:249"}

and later:


2024-01-19T18:17:36+01:00	WARN	console:service	unable to get Satellite URL	{"Satellite ID": "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW", "error": "console: trust: satellite is untrusted", "errorVerbose": "console: trust: satellite is untrusted\n\tstorj.io/storj/storagenode/trust.init:29\n\truntime.doInit1:6740\n\truntime.doInit:6707\n\truntime.main:249"}

and then a series of some database locked:


2024-01-19T18:27:29+01:00	WARN	contact:service	Your node is still considered to be online but encountered an error.	{"Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Error": "contact: failed to ping storage node using QUIC, your node indicated error code: 0, rpc: quic: timeout: no recent network activity"}
2024-01-19T18:27:29+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "N47YJPDID35GZ4N3NO42GMXJZRKZ2YZK6XY3WL2KBGMW7BPQ6NJQ"}
2024-01-19T18:27:29+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "S4RXYL6TVMCAIFJOB6AF743JNZNZW57TVX3UVD3CRX23VRHTVQ4A"}
2024-01-19T18:27:29+01:00	INFO	piecestore	upload started	{"Piece ID": "MKPPBYOWP62FF5EW2OGEFPEY67IBB4JHANLLXVM6AEOSFSCOVKVQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094164819968, "Remote Address": "147.12.134.58:48686"}
2024-01-19T18:27:29+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "H2EH3QMMK56MFRD4CD66HJ7UJVOYOHCW2F5OWPKIBMW4AIZTEDUQ"}
2024-01-19T18:27:29+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "HV3MU6NC3JHGMMLVFCCUBV5GBQWJ45XZ6RY72CUV2MCSFEEUAMAQ"}
2024-01-19T18:27:29+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "YV6FAWMOSNHORAJKGGOV3SMKN6N6WEWM2ZB5AAGWFHV7IXITSZBQ"}
2024-01-19T18:27:30+01:00	WARN	contact:service	Your node is still considered to be online but encountered an error.	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Error": "contact: failed to ping storage node using QUIC, your node indicated error code: 0, rpc: quic: timeout: no recent network activity"}
2024-01-19T18:27:30+01:00	WARN	contact:service	Your node is still considered to be online but encountered an error.	{"Satellite ID": "1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE", "Error": "contact: failed to ping storage node using QUIC, your node indicated error code: 0, rpc: quic: timeout: no recent network activity"}
2024-01-19T18:27:30+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "2O6Q7JSB3AKULWDCFXZSK4IO4KX2YPUSEWVY74CSMJOW3EKDYDHQ"}
2024-01-19T18:27:30+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "MGNIBTW5EQL5GA6DRP42HPIOAU3URWYLYVIPJNH6EA6M5NT5EIMA"}
2024-01-19T18:27:30+01:00	INFO	piecestore	upload started	{"Piece ID": "TNGYAOP4KLDT56GYAOG6AHSEAA2TH32YAZMSL3WNU6AQ46UKJTSA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094165381120, "Remote Address": "5.161.128.79:14936"}
2024-01-19T18:27:30+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "43JFXRTCFQ7YEJHHTQMIHC4XP3QQNJ6CQPJUV44UCPSUSSLDWSYA"}
2024-01-19T18:27:30+01:00	INFO	piecestore	download started	{"Piece ID": "6L7VJOAV4RNBZ52MWNBDM7EGJ3L5L3DEZSPRUPNCQX7XJRIL55PA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 579584, "Size": 290304, "Remote Address": "5.161.104.6:39212"}
2024-01-19T18:27:30+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "GNJCG5BXFNPSV4AXUOTJKEIXZJ7Y6B5WVRIV64OMSBFKOQLKHAOQ"}
2024-01-19T18:27:30+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "HB7KA4PDSLOS7K2SH2ADB2FZIP4YE3UVK4OWPJ2VEZWT22D57VDA"}
2024-01-19T18:27:30+01:00	WARN	contact:service	Your node is still considered to be online but encountered an error.	{"Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Error": "contact: failed to ping storage node using QUIC, your node indicated error code: 0, rpc: quic: timeout: no recent network activity"}
2024-01-19T18:27:30+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "EJ5TPUQRZDN4XCIPIBAS7JMMXTRL2FD73UFITWSSNFR3FNG4HWPQ"}
2024-01-19T18:27:30+01:00	INFO	piecestore	upload started	{"Piece ID": "5PBQ77CCDVVULP5YFKNMUOPKTBSMW4HQDRABUGOKVWGAVSLEQTMA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094166171648, "Remote Address": "79.127.226.97:60142"}
2024-01-19T18:27:31+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Piece ID": "SOPJ2GGJS7Q7S5TOEBYIMUFCMZ5FWWIEFCF4ZL6BW7J4FYRQCVPA"}
2024-01-19T18:27:31+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "6J7IZXDRF5QGBFWNRPBSZ7MGJE5YRUF4NEMJ3FMA7NUYIEJ2PWCA"}
2024-01-19T18:27:31+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "DKNPH3GNLMBZQK2UJYJ6I2XYHALMIMMI4FOJBR3DJYBSVVA6WM7Q"}
2024-01-19T18:27:31+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "QU33EMCVACK4GLV4BAHYBREXXLFHGP2GT6J64B3P4QH6VXCSTQXQ"}
2024-01-19T18:27:31+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "3LDQRS73DDPRNH6JQGBXGBYT5T2QSSJT7DXVQACTYZZTWFWSFZEQ"}
2024-01-19T18:27:31+01:00	INFO	piecestore	upload started	{"Piece ID": "YZ4GU5DFI63YISAHHPJ24W6RRVPETVUTL4PQGWGQU6RTIZJSC7RA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094167367680, "Remote Address": "49.13.27.176:47012"}
2024-01-19T18:27:31+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "T5ESHMQX55XK5LRHJK3ACQOW6AM6FLBA2KLTJSHWKUCCQUB26XRQ"}
2024-01-19T18:27:31+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "VY3RCAYKYSJYZO7U4J5J22LR75K6XOHGS6XT2YQWOQ7KNUYQDZAQ"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "35JP2DMD7NPPOI5OGRCD64SNFG25EF4TDTWJNYQH5ONQJLTUFAGQ"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "WB2HX2NH2RKRRXIWFKE7XPCO2QKPI5SQCWJ3P3DFOJJLRDP6ECQA"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "WHN3ROVAS4KZLC5QCUQSCWKIA7WU6CN6QA3EWFIHJTPEVVITG4MA"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "PBW2EKLW4AXCXONWISLZEK3TF57ZT6H77NTQA7TT63OWN6WPEP6Q"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "FU3WJAZ3CQNPU7YCCJCTP2ORQHDAXO77VLJIVZG5QWOMXHTXZVKA"}

2024-01-19T18:27:32+01:00	INFO	piecestore	upload started	{"Piece ID": "YKWERFISU5Y2D2ITKKVBPM7Y4MWFCUSZVVDST5OD24HSFIS4LX6Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094164267008, "Remote Address": "5.161.211.187:32064"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "QSJ7MOVUWMRUTQDPOYNUALLDW67ENB6CMMDXLRL7NRDQ5MAG7YPA"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "FUXK354CXKHK3YEKTPVO7V7Y7QBO3S2H2GT67VDG5UBT3PLWS7JA"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "EHSQIUONM53WAYKKXVPROB4CATGRPWUPR3OTJ2WMQQCHRRM4BRFA"}
2024-01-19T18:27:32+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "MFE4EKZFIRQSDFMAYYSY3IFMNOY5JYSAKX3FLOKINFVEKZC4TR4A"}
2024-01-19T18:27:33+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "THDQE3GONU3QTVYQCHCCYJW3UW4DCQUOHFIOGVCTS7JZUXPF4GTQ"}
2024-01-19T18:27:33+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "KWK3WGL3YW4AHYQFLI6E5T6Q2NFAREIGVDBAQLZU5UQQBEMJK4NA"}
2024-01-19T18:27:33+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "WZMYZBQONKF6YCRHODYQULJKLCULH223ERN2L746YM3CLPMMIQUQ"}
2024-01-19T18:27:33+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "A3AYVEXORYWU6BQ37ERMAR4MY4WJ7AMQ6FJCG5IQY3KRGPEA2HMQ"}
2024-01-19T18:27:33+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "A7CL35KBRWCBIJAGV27FC3OGJWYRFL5MJMQFXXBHFAAZLZFWK6RQ"}
2024-01-19T18:27:33+01:00	INFO	piecestore	upload started	{"Piece ID": "4FWX4ATAWMDRZ65RHLAUEVZH3OYN3OGTXHELWC2NSHHMA4VMV3XQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094165532672, "Remote Address": "49.13.27.176:58956"}
2024-01-19T18:27:33+01:00	INFO	piecestore	upload started	{"Piece ID": "DNVXF2N3CM444BOKLJS5A5IRWU6MUX36JZS7Y4AUEQ76NQNZKYKQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "Available Space": 7094165532672, "Remote Address": "88.198.206.145:47782"}
2024-01-19T18:27:33+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "UY2PZWWBYGUJCUAXFGI3DOYXOGAF7AUR6V4S3ZSXG5CM3ICEZLIQ"}
2024-01-19T18:27:33+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:517\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:33+01:00	INFO	piecestore	upload canceled (race lost or node shutdown)	{"Piece ID": "JFIFSBMZOOP6FQ3XZKWGILGMKRAZSAR7CTMLE7GVWFKDENK7Y6WQ"}
2024-01-19T18:27:33+01:00	INFO	piecestore	upload started	{"Piece ID": "E2FZIYKYZBTRTR6L76QH2QY5AV44SLPIQMRXQFVLAT4AVEPHEDMQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094159020032, "Remote Address": "79.127.219.33:34058"}
2024-01-19T18:27:33+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8.1:782\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8:820\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:837\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:251\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:33+01:00	INFO	piecestore	downloaded	{"Piece ID": "NF75ZSJK7WA5IMDEBXD7JNZNISKUKYRPQCNU6VFPKZZXSISL7ENA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1676800, "Size": 5376, "Remote Address": "5.161.55.227:26746"}
2024-01-19T18:27:33+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "OWF6QGQOBAP3QO43UIOCIUNUBF7U6CCPZ4VW53AUDECBXXFRJ57A"}
2024-01-19T18:27:33+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8.1:782\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8:820\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:837\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:251\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:33+01:00	INFO	piecestore	downloaded	{"Piece ID": "B3LRMM5IM363LETVE2UO7TAEMOULRVGUHQD3ZRMB4SB4LGJFH44Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 72192, "Remote Address": "79.127.226.99:53296"}
2024-01-19T18:27:33+01:00	INFO	piecestore	upload started	{"Piece ID": "527RI5DJUC3PTZ7T3I745S2IZWLTH5EZHMHOOTLOUR6AWG5WGHUA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094163034112, "Remote Address": "79.127.226.99:53296"}
2024-01-19T18:27:33+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:517\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:33+01:00	INFO	piecestore	upload canceled (race lost or node shutdown)	{"Piece ID": "EDZTYT2YWGFHRJUOKWN7DN5ADE74NOVFHTRXKPLBJIMJFR5HJTQA"}
2024-01-19T18:27:33+01:00	INFO	piecestore	upload started	{"Piece ID": "N37HHJVYECQOG7HKULM6OES5BSAV3OZZMNBEH6NG4YJTRNRDBHIQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094163034112, "Remote Address": "79.127.219.33:51856"}
2024-01-19T18:27:34+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "YNAV7OAD7WBU5VFI2Y2CUVTRDKVPKJEZYPU6QWQRWH64GOXOREPA"}
2024-01-19T18:27:34+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "DNRKG7QO4XWESB2VNZNKIZUA3WAN7FL2QPJRHCD6V5TV3O7IQHIQ"}
2024-01-19T18:27:34+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "AWYXJNLQBYNAFLIYMKJCGIG3BMDFCO6KICI2H2P3OZZRGX2SSU7Q"}
2024-01-19T18:27:34+01:00	INFO	piecestore	upload started	{"Piece ID": "3FZ5AOGMBI2QDL42LYA6YZYB4OXTO3MWEKLX7GXP2A7RJLNF5MJQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094167052288, "Remote Address": "5.161.192.57:51178"}
2024-01-19T18:27:34+01:00	INFO	piecestore	download started	{"Piece ID": "6L7VJOAV4RNBZ52MWNBDM7EGJ3L5L3DEZSPRUPNCQX7XJRIL55PA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1449216, "Size": 290304, "Remote Address": "5.161.61.225:42440"}
2024-01-19T18:27:34+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "AE7MSWNXLAUMKWD4FCYHQDPBOWKI4MWQSDHYJ2AR7FJ4ZMSFBSVQ"}
2024-01-19T18:27:34+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "PDOZOV5XWI3NIY2JHGIJPT7PPCIP2G5NPDWEJFC5JXMDZBBNFSTQ"}
2024-01-19T18:27:35+01:00	INFO	piecestore	download started	{"Piece ID": "NF75ZSJK7WA5IMDEBXD7JNZNISKUKYRPQCNU6VFPKZZXSISL7ENA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 353280, "Size": 256, "Remote Address": "5.161.55.227:26746"}
2024-01-19T18:27:35+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "A2DGZJVQ2CMEGPALQTTDGORTDDCWI3RPPPDT6KTTSS6EAMVQF4KA"}
2024-01-19T18:27:35+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "5QXRU2TZAYZH4RRIRNHDHDDS3AGM272GM66IK3RI57VGSWST6NIQ"}
2024-01-19T18:27:35+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "BUFSYRFUC5BSSWCBIPNDT7I2NMEREHGZ6HYJ4AQDPCYBDCAPRHMA"}
2024-01-19T18:27:35+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4M7LYP4RADBZA34R2XINZZRO7HO7ZFCMD22VOY2JQKZWTXD4DYPQ"}
2024-01-19T18:27:36+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "LIGUSG4ZDNTPYLGKFAHNNG5XZIKJ6BFZ6LWISAEOEADESXLWRGBA"}
2024-01-19T18:27:36+01:00	INFO	piecestore	upload started	{"Piece ID": "5BRLUPOFVQRG5P2QSPZ75VBVCKDDZLORYY3MCOLSVY55BXZ2T6NQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094167982080, "Remote Address": "144.76.92.5:54050"}
2024-01-19T18:27:36+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "TKOZ7UTOO2HR2CUQ34CDFO7X54QAAARGCCTRXP6S62IRYVCGHQEQ"}
2024-01-19T18:27:36+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "V5K2QFFNZAYAMRVTUR24UPQB4C5FPLVEMHSYV3LKTPM3HXLVBUXA"}
2024-01-19T18:27:36+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "7YZP6LZPIZ5FRUF4EGQNDB56SGL37MTZ2RRJLOSZ36BM7QORGSOA"}
2024-01-19T18:27:37+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "V5IESLEG54DJKAFFQJG3V2EP3QCJP7BJGRGZO4L65WNHOT7EGIGA"}
2024-01-19T18:27:37+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "O7MZZJY6ITYH4N4FZ6ZGHMIMWOOZMH2V6MKT3OTYBQHP6ATDLBRA"}
2024-01-19T18:27:37+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "JNYHKUXWJNBWF3W2Q6T42EEXKKEW7ZEF5QLHGEU5C235A3J4I2NA"}
2024-01-19T18:27:37+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "VQN2SPSW3AIUNDVNZ7LPR3VZPBNWONBPDH6RYRJHBAJ2TVICHY7Q"}
2024-01-19T18:27:37+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "PODHTMX5GZEFVSYF5XMAQAQZ76FGBFKJYQUBZHL54JHNKMV234SA"}
2024-01-19T18:27:38+01:00	INFO	piecestore	upload started	{"Piece ID": "EQG4UV5VRBCQFM52YYVFIICW5YKFWAV42M7QOVVYUHSC3LJFUMZQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094169931776, "Remote Address": "135.181.212.77:43260"}
2024-01-19T18:27:38+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "3OXKZMIRWK7PQHJAF5IERBQOEE5HWQXSD3UK2V4WLYAIMKWAGCGQ"}
2024-01-19T18:27:38+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "KVGP23TTNJCMWBNWP3GVH5Q63LV5W6JYAAJXUDQNIB735PN4WPGQ"}
2024-01-19T18:27:38+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "62CJYDJ2O2U4KWYK7I53AXQUJL3Y5DUX3BOMJIBQNU3NYREXCSJA"}
2024-01-19T18:27:38+01:00	INFO	piecestore	upload started	{"Piece ID": "BCDASHJCFGXILIYG6VRCAJE7GQLCBBN35VDFFAB6EQWOLVL2HVAA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094166183936, "Remote Address": "79.127.220.98:33774"}
2024-01-19T18:27:38+01:00	INFO	piecestore	upload started	{"Piece ID": "THT333DVJLXYAOOVWTAICO5Y2QPMJYUPRLMAI2SRNSPR6WIGPL4A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094166163456, "Remote Address": "79.127.219.33:39480"}
2024-01-19T18:27:38+01:00	INFO	piecestore	upload started	{"Piece ID": "DE3NARTNC4YN677R7LYSQSPB4VY64NFTSWQCSHS7SZ6AQSVVJIIQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094166142976, "Remote Address": "79.127.220.98:53654"}
2024-01-19T18:27:38+01:00	INFO	piecestore	upload started	{"Piece ID": "HJNQETUVB5NAJBUK7YXG53EL3Z2D3D5TXA5CU4E4HPVSKLR3HQHQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094161952768, "Remote Address": "49.13.27.176:58974"}
2024-01-19T18:27:39+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "RYNWKYTR7MF4W4GY6LZND4YNXMHYIQEBXNDYPGSZRUM4XHXFC67A"}
2024-01-19T18:27:39+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "JQ7OO7RVUQVC4JWD6JRYMASEFLP2WMOTZOR6ZMHMIGVSKVHYDCWQ"}
2024-01-19T18:27:39+01:00	INFO	piecestore	upload started	{"Piece ID": "OXZMX3OJALVOTNRBDI33VOTKPXLNBCJXBSZBLQ2WVACKEJFXEHQA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094162587648, "Remote Address": "49.13.27.176:59000"}
2024-01-19T18:27:39+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "IZIIK6V544YHMWJQWAQLTWNIMRZHBJDDUC5GKKEODSUXRUNWZGIQ"}
2024-01-19T18:27:39+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "W67ZAKGBBBHQQNRMCFAVTMP5OHVXUMT76H5AEYRY4SZRBEVT6Q5Q"}
2024-01-19T18:27:39+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "XIZOK35CRZ2JRUVV2TXEB6USQA2IC364CSXA5JBTGMYCYSQKIO5Q"}
2024-01-19T18:27:40+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6", "Piece ID": "GCNAJACI367CTHLWLQRT3TSKMPXJEPFIW5ZNGAWSXX5DEMCU7VKQ"}
2024-01-19T18:27:40+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "Q3RB4NN5P4Q3PB4D6WBOZDTWIOBJG2GA2NXA7SZ455MTHUOQFK7Q"}
2024-01-19T18:27:40+01:00	INFO	piecestore	download started	{"Piece ID": "SR2RYZIZFZMO7WKGTLMTO42VK22NGW4BDXYUVAIP6TALHWBV4XEQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 11008, "Remote Address": "79.127.201.209:37866"}
2024-01-19T18:27:40+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "S5SHDFS2W5AZU6TIYJNDZTOF6W74DXYXVMPXMAM4H2WFJPCN5I5A"}
2024-01-19T18:27:40+01:00	INFO	piecestore	upload started	{"Piece ID": "7RNSEXY2LLTMEFLHFENDGNQHDSQ53ZCVH3GXRJLBO5MVWGXEDRSA", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094161063936, "Remote Address": "49.13.27.176:59038"}
2024-01-19T18:27:40+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "EU3YHY5CXKDHHTQKCQYSUL44MFCNC2JQVJONUN3MDQ4HZL2673LQ"}
2024-01-19T18:27:40+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "BVPEUB2NJSUNQPLEHRLSUMJ5FCCGKHSUQPNWTGHDN55I7DI5N3RA"}
2024-01-19T18:27:41+01:00	INFO	piecestore	upload started	{"Piece ID": "XXY2A4I3CCJ34MSNXYDZIOOYIYC26AWEJTSXPMQ2DH5LEJRN5SYQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094157930496, "Remote Address": "79.127.226.99:53322"}
2024-01-19T18:27:41+01:00	INFO	piecestore	upload started	{"Piece ID": "EICLEIQZJ7DWFYW57EZEXDXVCXKCC24D63TRBUJJWQOYUZMWYRAQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094157914112, "Remote Address": "65.109.18.102:53670"}
2024-01-19T18:27:41+01:00	INFO	piecestore	upload started	{"Piece ID": "C6ICXTZFT2LGGR7ERBCTEWM775H5K6OM23USMPRLVFBUNTQURK4A", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094153719808, "Remote Address": "79.127.226.99:58630"}
2024-01-19T18:27:41+01:00	INFO	piecestore	download started	{"Piece ID": "PANVEFAFVORL6FLYKXW4APZDH3GJZBIOTH3FD7BYDPPDVNCY4A7Q", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 29440, "Remote Address": "79.127.220.99:50028"}
2024-01-19T18:27:42+01:00	INFO	piecestore	upload started	{"Piece ID": "YEP5MJGLBM677WVOQPQJM72IT6U33JBYPSIHLDXNKSBBF3MONDWQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT_REPAIR", "Available Space": 7094153310208, "Remote Address": "162.55.215.41:44596"}
2024-01-19T18:27:42+01:00	INFO	piecestore	upload started	{"Piece ID": "NCF4YZMUGIGDVXRQ6GTJT2JL2GUH5SA547YIXCLJUHBPT3GNCUTQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094153216000, "Remote Address": "5.161.143.41:50040"}
2024-01-19T18:27:42+01:00	INFO	piecestore	download started	{"Piece ID": "3ZWYHGQSEVZWHA2K6WMA5WBPRNKOVV7PFBK4ALX6LMQ5IDUJVN2A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 12800, "Remote Address": "79.127.220.99:56782"}
2024-01-19T18:27:43+01:00	INFO	piecestore	download started	{"Piece ID": "NF75ZSJK7WA5IMDEBXD7JNZNISKUKYRPQCNU6VFPKZZXSISL7ENA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1024000, "Size": 9216, "Remote Address": "5.161.55.227:30990"}

C.D.

2024-01-19T18:27:45+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "IKSK2MFOP7XVIGGLIJT3N3YISOW4R7VSBJHRKDQQGXWMRWSARMGA"}
2024-01-19T18:27:45+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8.1:782\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8:820\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:837\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:251\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:45+01:00	INFO	piecestore	downloaded	{"Piece ID": "NF75ZSJK7WA5IMDEBXD7JNZNISKUKYRPQCNU6VFPKZZXSISL7ENA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 208384, "Size": 9216, "Remote Address": "5.161.92.43:23266"}
2024-01-19T18:27:45+01:00	INFO	piecestore	download started	{"Piece ID": "NF75ZSJK7WA5IMDEBXD7JNZNISKUKYRPQCNU6VFPKZZXSISL7ENA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 525568, "Size": 9216, "Remote Address": "5.161.92.43:23266"}
2024-01-19T18:27:45+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:517\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:45+01:00	INFO	piecestore	upload canceled (race lost or node shutdown)	{"Piece ID": "KALJNKHSUPTCRW366TP2EIVEMO3GJ4VEYQ2V6YAPPUXD3QXJ3YQA"}
2024-01-19T18:27:45+01:00	INFO	piecestore	upload started	{"Piece ID": "FIWRQWZTGMBPNZVFPQSW3DRMLNTLQC4NPOSBWJP23EH4VCGE5QMQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094164615168, "Remote Address": "79.127.220.98:53670"}
2024-01-19T18:27:45+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:517\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:45+01:00	INFO	piecestore	upload canceled (race lost or node shutdown)	{"Piece ID": "TC7BQW4JOT2LAAYYHCHQZY5GFKERIOU7J6V3UGRCPYSDF3KF5PRA"}
2024-01-19T18:27:45+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:517\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:45+01:00	INFO	piecestore	upload canceled (race lost or node shutdown)	{"Piece ID": "55FR2UA52ONZ7JE7VXLL3VU4HG5OSK6XBVXG7EEPBR6YS43UMBJQ"}
2024-01-19T18:27:45+01:00	INFO	piecestore	upload started	{"Piece ID": "Y7ZEOGKXQFYXRSNDBIDYHHZWTSHLWSKSNV7PCE5OLHO67742WVGA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094164615168, "Remote Address": "79.127.219.33:34042"}
2024-01-19T18:27:45+01:00	INFO	piecestore	upload started	{"Piece ID": "QCWU5FLN5KENGKFWOEJRJXJDPU7QJJWI3UN6HCVBLRDTIZE3SYSQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094164615168, "Remote Address": "79.127.220.97:49968"}
2024-01-19T18:27:45+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "2A6N5NIYOI7WAU7OYIU4RWR323REIBKLUKD3YQQ6YPMMNGUBTJJA"}
2024-01-19T18:27:45+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "NZBDI6X53YGNZNDSK6KFBRVBTH4IIVUEOAYXPE7XD6TBWHZXSMPQ"}
2024-01-19T18:27:45+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "KRAI7T42PQH4JFV5MXTFHVWYFC2MRHGJZ4RLRJA7OPZHW5GFFB6Q"}
2024-01-19T18:27:45+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "VNNON5HPOIOWII7U234MBXGSLATUVD7NQ2PQK4CWQDA5FFMJ6PDA"}
2024-01-19T18:27:45+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "6V6T3SNWBGJPCU3NGPMYU3ZFSB3V7X4IRSBSCRDT7VZVYGNCMRVQ"}
2024-01-19T18:27:46+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "RNQZXVSV565ETVC4OXQK2DIAPXFUTUTDYXUNH3H554LJGDJVULQA"}
2024-01-19T18:27:46+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4XI7EME664GJK6NZRRQ3X3DSMHJASU75OCEOWXBUAIEYERECXJXQ"}
2024-01-19T18:27:46+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "GFJE7Z2DPJPPXYPEMSNZX25JNBUPZYTGW2ZWDKFXHKY77UGRZJWA"}
2024-01-19T18:27:46+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "LFOWEH3ABPKQUDP4E4AC4M5RGAI3ACN52CBE6LSJMILLMJE2K6NQ"}
2024-01-19T18:27:47+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "REUYBYMHZECOJJ5GHLUKUFVW6NBOH2YPVDGM4L2WCP5KPPUUUI7Q"}
2024-01-19T18:27:47+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "IXMNMOUW6Z4AJ55CW6BEXYOLMRCGABN62TEQPMJVPMRPXLJ6W43Q"}
2024-01-19T18:27:47+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "2FJJ2Y57E5SJGNRSKITKGJPJ67PJGWJEDDHBCPHBK35CFMFCDJ5Q"}
2024-01-19T18:27:47+01:00	INFO	piecestore	download started	{"Piece ID": "UFTXKYZG4LFOOZWRNRS3PI4HPJTRMRYB55UGAJKZGPFILE2K42NQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 9728, "Remote Address": "79.127.205.225:45332"}
2024-01-19T18:27:47+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "SKVWGIUUVCKCCK5WELA6RQ36SBIP5EXOPRRBP3JGRYWRJZQGCK4A"}
2024-01-19T18:27:47+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "2BGBZ4WBHVG5RQOMFLHHSHXHEMU32WQNFDVH64AZJJD6YXKCUHNQ"}
2024-01-19T18:27:48+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "HEEHUUE6EHB27EJSOHG5ZVIKZMUZQXBSDEAECOGP232ZO4GQBTNA"}
2024-01-19T18:27:48+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "POVFRN7KXS7J5ITCKXP7PWEHTGMZQDCFDJDETJJC6LKM2T6TI5HA"}
2024-01-19T18:27:48+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "BC63MQRBXIFOVIPV7QP5D2MKIHANUODYPQJWC3VWU56TQU6RVV7A"}
2024-01-19T18:27:48+01:00	INFO	piecestore	upload started	{"Piece ID": "M3FHWMWXGLXLXD62A2VUKCIVXUOLQYRGBJFEGX6YSIVFVITDUZPQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094168248320, "Remote Address": "79.127.220.97:38228"}
2024-01-19T18:27:48+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "KCDXZSSLYVQU3AHAAAVLB6FLDM2QAY6LW55HO6PAJTFCRZHDJGRA"}
2024-01-19T18:27:48+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "YKHV3GAIHTXRZRZTPEJ5DUSQISSD6B6BTBSZKRNYBJINTSBZ4TAQ"}
2024-01-19T18:27:49+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "M3DM4HNPE5H3SWY752JXCFF7TUWHT7MTNO4FWOCHODUOMGH5THBQ"}
2024-01-19T18:27:49+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4KT2KPCEM7TEKVKAONPFCRTQKQWH2GRGQ3CBTKXUH3SA7SKUV36A"}
2024-01-19T18:27:49+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "QKSLHZULBQVGO5LZL4VEJWMHDAQVLQJBXJRB5JVSC6KURJBEOWWA"}
2024-01-19T18:27:49+01:00	INFO	piecestore	upload started	{"Piece ID": "XFCX6MBKRVI33X3OHJWDREZO4XBL7I6FMLMOSWNF2QGZLXSAJO3A", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094172950528, "Remote Address": "65.21.199.8:39938"}
2024-01-19T18:27:49+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4TEXPCP6BT7C3B6OKT5UIKVF7CNNJGX5IYB3Y3PEGCHUK4HPLZNQ"}
2024-01-19T18:27:49+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "JPETVDKUFEN74YPZIMBW6I37PFZC3VMRTW4MCTGUAWOVBWIJXDVA"}
2024-01-19T18:27:49+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "6AYBXQI2KIIOPONX7CRLZUX5Q6HN46BVCPKNSMH6R5VRFK6HPPNA"}
2024-01-19T18:27:49+01:00	INFO	piecestore	upload started	{"Piece ID": "N4VMTMGO2YCPA7DGD3CET74Z3NTM42VFIUPYPOKKJMUCHT2AOJCQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094169321472, "Remote Address": "5.161.143.41:46624"}
2024-01-19T18:27:49+01:00	INFO	piecestore	upload started	{"Piece ID": "ESV3W66CUBMF6CK6MMRTZUPRXSMKIGNP4JMBJX4V3BWI3UEL5J3Q", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094165139456, "Remote Address": "49.13.27.176:56128"}
2024-01-19T18:27:49+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4NN25FHYN4GXND3WHQIHXS4LLBPH6L5IUVR3XMOJHGUPYVHOKFJQ"}
2024-01-19T18:27:50+01:00	INFO	orders.1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE	sending	{"count": 7}
2024-01-19T18:27:50+01:00	INFO	orders.12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S	sending	{"count": 26184}
2024-01-19T18:27:50+01:00	INFO	orders.12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs	sending	{"count": 2389}
2024-01-19T18:27:50+01:00	INFO	orders.121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6	sending	{"count": 1007}
2024-01-19T18:27:50+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "6C4YIWYW6V7K33MFB6RTK3CO3RIJ4RDWZPZLAO3ZGZONFTMCHOFQ"}
2024-01-19T18:27:50+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "LPVYSLAOIHXBFRWL6OM2D6DA5BIGB7SF2M5DMS3IU73LJO2YPKCQ"}
2024-01-19T18:27:50+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "HY674U4QYM7GGUENVRXWECVD7ETTQSBH2TDIOHCVAJD4DVMY4ATA"}
2024-01-19T18:27:50+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "K77NJ3GUMKL3DHBBGPZ6BZQW7B4VVAXDZDRB53EAYX4DAZF7N6MA"}
2024-01-19T18:27:50+01:00	INFO	orders.1wFTAgs9DP5RSnCqKV1eLf6N9wtk4EAtmN5DpSxcs8EjT69tGE	finished
2024-01-19T18:27:50+01:00	INFO	orders.12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs	finished
2024-01-19T18:27:50+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "QGW4DE6UXWGFSWKU6A6JX4XPFWVOJZEKRQ2P6IDQTNPN2JYQCWRA"}
2024-01-19T18:27:50+01:00	INFO	piecestore	upload started	{"Piece ID": "AG5ZZSD4XD5IVVZJRCMLZGX672J2G3WWOPFA6UT6VO7EECVCGMMA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT_REPAIR", "Available Space": 7094167326720, "Remote Address": "5.161.71.1:51448"}
2024-01-19T18:27:51+01:00	INFO	piecestore	upload started	{"Piece ID": "EKH23ZDQWCKPXFVOUVAYHBMRQUXIUQCYXFLYTVVRXKODQSXS7LAQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT_REPAIR", "Available Space": 7094167416832, "Remote Address": "5.161.65.137:37220"}
2024-01-19T18:27:51+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4C5DEHARW7NL37RFFPPOPOPLGFWWOTRJE6JVTULJTHCHE5P4C6VQ"}
2024-01-19T18:27:51+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "FU3CICZJCQFJZ5QCP4BFAZXH7IXHHA2XJ3O4P6SPASBHX764W3XQ"}
2024-01-19T18:27:51+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "CO4CAWESNWYO6WI2LA6NC2CPZUKW75QFQ6DWKJ4OMHFN5GJ42FLA"}
2024-01-19T18:27:51+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "6QMI5CE6J2HB473DEFHGFAMUD7D3QWAXGB2WHO6EVSSNSOA4QZUQ"}
2024-01-19T18:27:51+01:00	INFO	piecestore	download started	{"Piece ID": "2AOT4YOF4UKPQ2REPXRVTDSHXTNUNEQLMAH6BMJBEJUNUV3UTYUQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 8704, "Remote Address": "79.127.220.99:56798"}
2024-01-19T18:27:51+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "ZTBZDE6JF4KQ24IAIE6SALGDX4DQAI3DWAUSTK7AXXLV5EJVVB3A"}
2024-01-19T18:27:52+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "LXJ2FRTY4HINXZM56NFU57LFFRFJ6IFIMH4LJ7F7B6IVZGKVUCDQ"}
2024-01-19T18:27:52+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "ZC4PCQW6U4KLKFXZEQANHKXZFMR5MJQ632R3YYFY52CPJ5N3WJWQ"}
2024-01-19T18:27:52+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "NZE7YYOFSXDJZ42QWZXREDSH7ZVRU55LBPVD4SGIUWWKBPB7556A"}
2024-01-19T18:27:52+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "ETP44JXI2F6LLTLUQMKSV2H7FBHNQJKJM26LF6UQ64GSOAHUXK2Q"}
2024-01-19T18:27:52+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "WA3WLDLRR5USQZEHAOJUBJQA76YTGL6XMNE6CNXDNTBF6J2BJB3Q"}
2024-01-19T18:27:52+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "JEYO5QZPKMC6L637ZMJGQYSX23EEGCRTBCCCXE5DUP7AOHES664Q"}
2024-01-19T18:27:52+01:00	INFO	piecestore	download started	{"Piece ID": "VQFUZJBEVZAQBXQNYSYA3IYJQRNLIECXRW4FNMGK4AMW27JIXLRA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 0, "Size": 14336, "Remote Address": "79.127.220.98:36334"}
2024-01-19T18:27:52+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "XVQYUPENQJYB4OSMFG5LXKTZOYMWDHOART7IM5O3HKACKU4442RQ"}
2024-01-19T18:27:53+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4CAZSQIVNHFDYDFZFOGHAXTTQZOGL4BKT6DIV42UH2I3EVQSPWDA"}
2024-01-19T18:27:53+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "CEDNL3QNFMWS7LAPIX2BQEKYK4BZG7XLKYZQLHZWK36ANCWI2KQA"}
2024-01-19T18:27:53+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "FMVAX4BLWMWE7SS6IPKJKKYEWBESXPSANWHR7TGDS42C6SWFR7EQ"}
2024-01-19T18:27:53+01:00	INFO	orders.121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6	finished
2024-01-19T18:27:53+01:00	INFO	piecestore	upload started	{"Piece ID": "AKJ3S65FZSPQBOLHLIX3VZAU5SOH7ZZ7YN3NUSVD35R2YF64M4MQ", "Satellite ID": "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs", "Action": "PUT", "Available Space": 7094179336192, "Remote Address": "144.76.92.5:55974"}
2024-01-19T18:27:53+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "W4UKNACWASERTYNLUIPL73UXOLSNRLZAJLEBM3C3TYLWA26GWG3A"}
2024-01-19T18:27:53+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "4GACUCBDAZFC4HGCPW6JYAK4ARX4GLEBZKVUHUK7CABFXYJ7VP5A"}
2024-01-19T18:27:53+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "MD3CDGIITMSYIVP2ICMWM6BR2CVNDBCN5ZS5GMINVJVTIDWTJWYA"}
2024-01-19T18:27:53+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "5DOE2IF5T4AAKAA4ZLGDYQPKK7L3A2CPZQE267JVPXKQ5HPXWPEQ"}
2024-01-19T18:27:54+01:00	INFO	piecestore	upload started	{"Piece ID": "GCW6OYWXZVGKYM4P62K5BGAB72VBDQX5EK7CIWBQ32H6I5C3OU5A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094180163584, "Remote Address": "79.127.220.98:36356"}
2024-01-19T18:27:54+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "WVXE4QYAKCOG6FITJ2SWYLWKSPTP3GNUJKSTUHV32725VPTZINAQ"}
2024-01-19T18:27:54+01:00	INFO	piecestore	upload started	{"Piece ID": "2YOG7DGSVACE4PL4WPRQYM33MZX5YRCCJFCDH25WO6KBVI7VHATQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094180114432, "Remote Address": "79.127.220.98:36364"}
2024-01-19T18:27:54+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "PGQ43FOSLKPT7OWEF23HOFQQUMMJIXM6XJOZTZ3VTM64EBWCWQ5A"}
2024-01-19T18:27:54+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "MPF67VYBASZOTMY3E2BH4URTEBI6XF3XZ4F5MZG2EQWR7HZ6O6MQ"}
2024-01-19T18:27:54+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "RYDAHS3OKH3OIKW7AMVUI45O3NTZ2ABRBU5VSVXRY5Y2WT7V6ANQ"}
2024-01-19T18:27:54+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "JNVYRFMT5Q5AKFA6PEMPPCBRCZM2BHYUKNZI2FOLGEFGUFVDAD7Q"}
2024-01-19T18:27:54+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "XBVQGNRLA6TZ2MKHPUPKZU2RENKKXRIXWEWGQFU5IOR2TQUFP64Q"}
2024-01-19T18:27:55+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "752NCKKGK2C2H5QWEKICBFNGB3ANZYYJUUHJCTEEYPQVRVLSBPYQ"}
2024-01-19T18:27:55+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "HHJMKV7EMW7TGZKSRR6M6D2MYC6ERR3VKC4N53WUH2OCAMFNZBEA"}
2024-01-19T18:27:55+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:517\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:55+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:517\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:55+01:00	INFO	piecestore	upload canceled (race lost or node shutdown)	{"Piece ID": "QCKQSLFMFHBGSXRM2EIXRP4ZLRUGU47WWOZPDB72A2OOQJKV5YQQ"}
2024-01-19T18:27:55+01:00	INFO	piecestore	uploaded	{"Piece ID": "DE3NARTNC4YN677R7LYSQSPB4VY64NFTSWQCSHS7SZ6AQSVVJIIQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Size": 2560, "Remote Address": "79.127.220.98:53654"}
2024-01-19T18:27:55+01:00	INFO	piecestore	upload started	{"Piece ID": "J3WQQXDMPSBITUENJLZ346AYZUWMQV4L2ODDTWWJVTQUSVWY3EKA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094180569088, "Remote Address": "79.127.220.99:48444"}
2024-01-19T18:27:55+01:00	INFO	piecestore	upload started	{"Piece ID": "PWQ5DNT4WDOEFLC3SP5DFBUJ4WKI5P3D7ZKTDGMM4YUVPDZSRLBQ", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094180569088, "Remote Address": "79.127.220.98:53654"}
2024-01-19T18:27:55+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Upload:542\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func1:243\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:55+01:00	ERROR	piecestore	failed to add bandwidth usage	{"error": "bandwidthdb: database is locked", "errorVerbose": "bandwidthdb: database is locked\n\tstorj.io/storj/storagenode/storagenodedb.(*bandwidthDB).Add:60\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).beginSaveOrder.func1:913\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8.1:782\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download.func8:820\n\tstorj.io/storj/storagenode/piecestore.(*Endpoint).Download:837\n\tstorj.io/common/pb.DRPCPiecestoreDescription.Method.func2:251\n\tstorj.io/drpc/drpcmux.(*Mux).HandleRPC:33\n\tstorj.io/common/rpc/rpctracing.(*Handler).HandleRPC:61\n\tstorj.io/common/experiment.(*Handler).HandleRPC:42\n\tstorj.io/drpc/drpcserver.(*Server).handleRPC:124\n\tstorj.io/drpc/drpcserver.(*Server).ServeOne:66\n\tstorj.io/drpc/drpcserver.(*Server).Serve.func2:114\n\tstorj.io/drpc/drpcctx.(*Tracker).track:35"}
2024-01-19T18:27:55+01:00	INFO	piecestore	downloaded	{"Piece ID": "NF75ZSJK7WA5IMDEBXD7JNZNISKUKYRPQCNU6VFPKZZXSISL7ENA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "GET", "Offset": 1999360, "Size": 9216, "Remote Address": "5.161.92.43:23438"}
2024-01-19T18:27:55+01:00	INFO	piecestore	upload canceled (race lost or node shutdown)	{"Piece ID": "KUJXGZKJIEVX7RPNFYAU7SN3356GHLV4NDKEU3WZ26FFDXS67BIQ"}
2024-01-19T18:27:55+01:00	INFO	piecestore	upload started	{"Piece ID": "HUR52HXGEVWV363TXSRAWER7TCDVWMKOJKP3XZWEHAIGXXUJWK7A", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094180556800, "Remote Address": "79.127.226.100:45232"}
2024-01-19T18:27:55+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "2CPPBT4YCIUI754I5NK45WF7ZSIDEFJFRTZHPQCULVOGOZJ4QRIQ"}
2024-01-19T18:27:55+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "GGMWO73ZNJPG2HK5PSYZKR7ULRA53FPL3WGZY2OFJZU75RHOGQOQ"}
2024-01-19T18:27:55+01:00	INFO	piecestore	upload started	{"Piece ID": "OHVGJKSL477ZAWJPWW447OEZ3JK5TZWSQ443S3WVJ2DT5YODVBUA", "Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Action": "PUT", "Available Space": 7094180593664, "Remote Address": "79.127.201.209:38438"}
2024-01-19T18:27:55+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "SQUDUBVJKWRNEFDEHXXARH2UAKJ6GRK2KPV6U5R3UUMHRG4ZVZ3A"}
2024-01-19T18:27:56+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "ANU472OPPWDEEJAO3B6YIWW3RS46TWIFGPKT3PERG35ZP6JPCJPQ"}
2024-01-19T18:27:56+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "FBX57K5KFS65FNDFEV4JPQKOPBGROYNTWU6M6YHHALQTQYANAH5Q"}
2024-01-19T18:27:56+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "MXJHE6Q6ZSHFUQKNL7DXU3M5DAZWQ55MBVDW5JVEX6LZP54DR7AQ"}
2024-01-19T18:27:56+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "ICROZKATLE2LS2AKHVUQMBQTSDQ7VNEC4IYQKW26LK3YD6TMDZVQ"}
2024-01-19T18:27:56+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "NVTW7MRFBJ56GQOA4XBHGDZXVRSH62FV5FXKI73RMJIEHO3XBQDA"}
2024-01-19T18:27:57+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "C4SR5LBUNO6OC5B26JX4VWTUQL277KWHH6W7YWINIQUVYEI3EBXQ"}
2024-01-19T18:27:57+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "MTOILDCU72JTAH4MH4E4D4A4553KPC665CSFTZ5ISK3R5WHTY3UQ"}
2024-01-19T18:27:57+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "VM4VTP25T7TXDRORVVYRU7GVXYHJFRZMCYYWGCZBD3RPSEHLWFYA"}
2024-01-19T18:27:57+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "KAFECSP3ASVW4L3VT6HCOAOU7QSDFP26SUPXU3LU4CI2UJZT5KFQ"}
2024-01-19T18:27:57+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "BKG6LB53IRIBWEZVBRZB5R7C5MKNHYJEM2GKOG6RC5ZR3KE74Z4Q"}
2024-01-19T18:27:57+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "GHHEAPRFQGXXSX6WRLJAXEFHEKHFHUXR7UN64L72JNCUYERVISZQ"}
2024-01-19T18:27:58+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "PIEAZKSS6OG6OR32AAK5ONTZ2C4QDF45AXWPTLB7YFFHCCKIHA7Q"}
2024-01-19T18:27:58+01:00	INFO	collector	deleted expired piece	{"Satellite ID": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "Piece ID": "7JLFDTPU6JZRRQNRWTWFCDJ2THCNIGDNHSC37S722N4FCS3YPXGA"}

and a some orders finished:


2024-01-19T18:27:58+01:00	INFO	orders.12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S	finished

Im investigating futher:
Later at 19:00 the same CPU spike occured again,
and Storj’s HDD work stopped temporarily i saw for some seconds in the win manager graph ,
but nothing in logs, just a normal uploads and downlaod.
(no more any database locks)

Did you check your system for the actual malware? (I have a Windows Storagenode - and there is no such behavior under my Windows 10 instance. But it’s pretty old though - 10.0.19043 N/A Build 19043) and there is no such behavior. But I do not have any additional AV, only the MS Defender. But I do not use this server for my workload anymore.

You can try to remove this satellite as well: How To Forget Untrusted Satellites

Yes those behavior i see only on 2 mayby 5 nodes, other nodes behave normally,
If You can say what anti-malwere results You will honor, then sure.

I did Forget all decomisioned sattelites on all my nodes using powershell comands yes.
Only that one benten left, did not want to be gone, i added now to config.yaml this:

storage2.trust.exclusions: "118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW@satellite.stefan-benten.de:7777"

Edit: i mean what nowadays to use for W10 anti-maleware scan?

1 Like

malwarebytes
(free trial afaik)

Can I assume that all these nodes are Windows and they are configured as a separate VMs?
If so, what Windows versions on those which behave like this and versions on which it doesn’t have this behavior? Maybe the newer Windows doing so (more tracking and reporting to MS for example).
It also could be possible that you used an infected image.

Yup, biggest malware are av suites and game anti-cheat software. They run usually in kernel mode and can send your data where ever they want. We are not living in early 2000 with Win 98 or WinXP to install all that kind of crap.
But if people still open attachments from ‘you win at lottery’, click on images with ‘make your penis bigger for free’ and install untrusted software… like games from torrents… .
npm and other repos are full of compromised/outdated/vurnerable packages which are dependencies of other packages which are dependencies of other packages and so on.
IMO best way to deal with this is to have separate computer with important and sensitive stuff with only minimal needed software installed. You can use soft like Veracrypt and keep important files with it’s containers.

1 Like

…and backup it to Storj

2 Likes