Past week several developers looked into storage node performance. We started the week with a benchmark tool that creates all the files a storage node would do at maximum speed. How fast can we write pieces to spinning disks? We know there are some low hanging fruites that would give us better stora…

[image] Ambifacient: Are you using the same exporter? No. I don’t like the idea of running some third party tool that basically gets full access to my storage node. Instead I use the build in metrics endpoint that works without any additional log scraping tool.

Ah gotcha. I will have to check that out. In the meantime I’ll see if I can patch this.

Any hints on how to graph JSON data in Grafana? The exporter mentioned here is reading Storagenode API and exposing the data for Prometheus to scrape, but what would be a best way to do the same directly with Storagenode API?

[image] zip: what would be a best way to do the same directly with Storagenode API? Not storagenode API. Just the metrics endpoint with prometheus.

Thank you, didn’t know about that. For anyone else wondering, it is at /metrics at the debug.addr port.

[image] [Tech Preview] Email alerts with Grafana and Prometheus STORJLINGS I would like to setup email alerts for my storage nodes. It turns out the storage node already has a Prometheus endpoint. It is running on the debug endpoint /metrics. If you haven’t set the debug e…

try this suggestion: [image] Node goes down/restarts every 10-15 minutes. thread allocation error in logs docker run -m “1024m” --memory-reservation=“768m”

I think the issue is that the used key in the bandwidth dictionary is not being updated on the /api/sno/ route. It’s probably reading from the database and not the cache. Similar for /api/sno/satellites/, the bandwidthDaily list is not updated for the latest day.

[image] vovannovig: Is there a ready-made EXE file planned for Windows? for this version: [image] littleskunk: git fetch https://review.dev.storj.io/storj/storj refs/changes/99/13099/3 https://link.storjshare.io/s/jwdo3ucon6mler5ch2hxqebnx6aa/test/piecestore-benchmark.exe.zip The lin…

On Windows it’s failed with panic piecestore-benchmark.exe -pieces-to-upload 100000 panic: main.go:173: order: grace period passed for order limit [recovered] panic: main.go:173: order: grace period passed for order limit [recovered] panic: main.go:173: order: grace period passed fo…

Upcoming storage node improvements including benchmark tool

Product Discussions STORJLINGS

littleskunk May 10, 2024, 4:47pm 129