Looking for some Monitoring informations (Beginner)

MadeInGermany · January 15, 2020, 9:38am

Hey,

since a few Days i run my first node whit 4TB on my Raspberry.
Until this time, i check the Dashboard and when i am at home the status of the pi via SSH every few minutes.
I do this just because im new whit Storj and some Raspberry Stuff.
But im not happy, that i do this all over SSH and only at home.

Is there anybody who can explain me, how i can get good monitoring of my PI (CPU/Ram/Temp), HDD and Storj (Audits, earnings, Upload, Download an much more).

So i say thanks to anybody who can help me whit a little tutorial or something.

Thanks

naxbc · January 15, 2020, 10:06am

I´ve been using Netdata and uptimerobot on my both RPI nodes

greener · January 15, 2020, 1:23pm

check out https://forum.storj.io/t/prometheus-storj-exporter for monitoring with prometheus/grafana

MadeInGermany · January 15, 2020, 2:26pm

@greenerbut i dont see there any informations about my node like cpu/ram usage?

anon56100668 · January 15, 2020, 4:06pm

Hi, i use this, very good

Krawi · January 16, 2020, 5:59am

The installation of Prometheus server has also an client ‘Node Exporter’ installed (cpu, ram, network, …), you just need a second dashboard for it.

This client is also available as a separate installation.

greener · January 16, 2020, 10:42am

Storj-exporter translates metrics available in storj node api to prometheus format. Same metrics are used in native storj dashboard but you can have multiple nodes on the same page with grafana and customise as needed. With prometheus you can also setup alerts for specific events you want to watch for.

There are lots of solutions available to also monitor generic system metrics with prometheus/grafana as it’s becoming one of industry standard monitoring systems. You can extend my dashboard to include system metrics or find the one that works for you in grafana community.

MadeInGermany · January 17, 2020, 3:22pm

Hey guys,

i install the Storj-Exporter whit this command:

docker run -d --link=storagenode --name=storj-exporter -p 9651:9651 anclrii/storj-exporter:latest

After that i install grafana whit the Guide from the Grafana Homepage.

I restart my Storj node whit this command:

docker run -d --restart always -p 28967:28967 -p 127.0.0.1:14002:14002 -e WALLET=“i dont show here” -e EMAIL=“i dont show here” -e ADDRESS=“i dont show here” -e BANDWIDTH=“141‬TB” -e STORAGE=“3.4TB” --mount type=bind,source=/home/pi/.local/share/storj/identity/storagenode,destination=/app/identity --mount type=bind,source=/mnt/storagenode,destination=/app/config --name storagenode storjlabs/storagenode:beta

After all i try to start the Storj-Exporter but it exit after a few seconds.

> 
> CONTAINER ID        IMAGE                           COMMAND                  CREATED             STATUS                      PORTS                                                NAMES
> 2e5b2bc108bf        anclrii/storj-exporter:latest   "python ./storj-expo…"   51 seconds ago      Exited (1) 48 seconds ago                                                        storj-exporter

If i delet this docker, and check ps -ef| grep storj-exporter i get this:

pi 30879 30272 0 14:43 pts/0 00:00:00 grep --color=auto storj-exporte

if i try to kill this, it restarts every time whit a new id.

So, what can i do, that all works?
(If someone here who can help me in german, please DM me)

MadeInGermany · January 17, 2020, 9:56pm

It seems to work.
I build my own Docker Image and now it Works
I have one last problem.
The Node explorer data in Grafana is very slow while updating. Maybe every 2 Minutes.

But i only can add the Ip´s to this line:

static_configs:
- targets: ['localhost:9090', 'localhost:9100', 'localhost:9651']

If I try to add ths lines to my prometheus.yml, Prometheus dont want to start:

# Exporters: client servers
  - job_name: 'nodes'
     static_configs:
     - targets: ['localhost:9100']

#Storj-Exporter
job_name: ' storj'
static_configs:
- targets: ['localhost:9651']

Krawi · January 18, 2020, 6:54am

This is my config with 3 nodes:
(The first targets line has only one ip!)

static_configs:
  - targets: ['localhost:9090']

- job_name: node
  static_configs:
    - targets: ['localhost:9100']

- job_name: node_home_01
  static_configs:
    - targets: ['<name>.dynv6.net:9100']

- job_name: node_storj_01
  static_configs:
    - targets: ['storj-01.<domain>.<tld>:9100']

- job_name: storj
  static_configs:
    - targets: ['localhost:9651']
      labels:
        instance: 'Cloud'

    - targets: ['<name>.dynv6.net:9651']
      labels:
        instance: 'Home1'

    - targets: ['storj-01.<domain>.<tld>:9651']
      labels:
        instance: 'Node1'

MadeInGermany · February 15, 2020, 8:02pm

i try to set up my second node where i want to grab the data of node 1 and 2.
But when i write this in the config, prometheus dont want to start:

  - job_name: 'prometheus'

# metrics_path defaults to '/metrics'
# scheme defaults to 'http'.

static_configs:
- targets: ['localhost:9090']

job_name: node_storj_02
static_configs:
- targets: [‘name.ddns.net:9100’]
job_name: node_storj_01
static_configs:
- targets: [‘localhost:9100’]
job_name: storj
static_configs:
- targets: [‘name.ddns.net:9651’]
  labels:
  instance: ‘Node2’
- targets: [‘localhost:9651’]
  labels:
  instance: ‘Node1’

heunland · February 15, 2020, 8:58pm

I use the RaspController app on android to monitor RPi Temperature, CPU, RAM, uptime and more