Prometheus Storj-Exporter

Hey, this looks pretty damn useful, however I am having an issue with the grafana part. I’m able to see the exported data if I browse to localhost:9651, so I know the exporter is working correctly. However grafana is telling me “Cannot read property ‘status’ of undefined” for all the different gauges. Any idea what could be causing that? I’ve never used grafana before, so it’s probably something simple.

You need to install the right plugin in grafana to make it works

I just installed grafana docker, set up my prometheus data source, imported the dashboard from json and selected my prometheus datasource. After that it worked.

If you use the docker from repository, you are fine, but if you installed grafana from scratch you have to install few plugins to make the dashboard functional well.

I had to modify the docker run command a bit to get it to work with the unraid version of the storj node i’m using. Maybe that’s why. This is the command I used.
docker run -d -e “STORJ_HOST_ADDRESS=10.133.xxx.xxx” --name=storj-exporter -p 9651:9651 anclrii/storj-exporter:latest

I get this error while running

python3 storj-exporter.py

Traceback (most recent call last):
File “storj-exporter.py”, line 129, in
start_http_server(int(storj_exporter_port))
File “/usr/local/lib/python3.7/dist-packages/prometheus_client/exposition.py”, line 193, in start_http_server
httpd = _ThreadingSimpleServer((addr, port), CustomMetricsHandler)
File “/usr/lib/python3.7/socketserver.py”, line 452, in init
self.server_bind()
File “/usr/lib/python3.7/http/server.py”, line 137, in server_bind
socketserver.TCPServer.server_bind(self)
File “/usr/lib/python3.7/socketserver.py”, line 466, in server_bind
self.socket.bind(self.server_address)
OSError: [Errno 98] Address already in use

Whats about it?

I guess you run this twice, check if you have another instance that running use the smae port.
ps -ef| grep storj-exporter

Ok there is a task already runnung but i cant stop it

root@storj-debian:~# ps -ef| grep storj-exporter
root 14110 13271 0 16:52 pts/1 00:00:00 grep storj-exporter

not by docker stop storj-exporter nor by kill 9 14110 (it start again with another id)

docker container ls
CONTAINER ID        IMAGE                        COMMAND                  CREATED             STATUS              
PORTS                                                  NAMES
5a228b5258d7        storjlabs/storagenode:beta   "/entrypoint"            3 hours ago         Up 3 hours          
127.0.0.1:14002->14002/tcp, 0.0.0.0:28967->28967/tcp   storagenode
8f6cc65a1f6a        storjlabs/watchtower         "/watchtower storage…"   2 weeks ago         Up 5 days                                                                  
watchtower

Try pkill -9 storj-exporter

This output:

root 14110 13271 0 16:52 pts/1 00:00:00 grep storj-exporter

is reporting the grep process, not the storj-exporter process.

I did

ps -A | grep storj-exporter is empty but your command with -ef is not and never - it shows always

root 19139 19121 0 17:21 ? 00:00:00 python ./storj-exporter.py

I also restarted debian 10

Looks like this
juerg@storj-debian:~/Storj-Exporter$ ps -ef| grep storj-exporter
juerg 4989 1604 0 17:30 pts/0 00:00:00 grep storj-exporter
root 19139 19121 0 17:21 ? 00:00:01 python ./storj-exporter.py

Ok when i stop the docker now it gone but after start same error

@web4yougmbhch it does look like something’s already listening on that port, probably another instance of storj-exporter.

As already mentioned 14110 is the id of grep process, not storj-exporter.

You can try kill -9 19139 for the above output, but if it’s a docker container it will probably be restarted again with a different id. You can check what’s restarting it by checking the parent pid with ps -ef | grep 19121 for above output to see what the parent process is.

For docker it would show up in docker ps output. Also try curl 127.0.0.1:9651 for exporter output to see if the currently running instance works already.

lsof -i

should give a list of which processes are using which ports.

curl 127.0.0.1:9651

give me all outputs like:

python_gc_objects_collected_total{generation=“0”} 205.0
python_gc_objects_collected_total{generation=“1”} 149.0
python_gc_objects_collected_total{generation=“2”} 0.0

storj_sat_audit_alpha{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 19.99999999999995
storj_sat_audit_alpha{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 19.99999999999995
storj_sat_audit_alpha{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 19.99999999999995
storj_sat_audit_alpha{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 19.99999999999995

and so on so i think anything should be ok.

But i cant get any information to grafana. It looks like:

But Prometheus is ok

I have only one output with this port:

sudo lsof -i | grep 9651
docker-pr 1809 root 4u IPv6 336318 0t0 TCP *:9651 (LISTEN)

IPv6 ???

The default GNU/Linux networking is dual stack IPv4 and IPv6. Connections to localhost are typically IPv6 link local unless explicitly set to use IPv4 addresses in the 127.0.0.0.1/8 subnet.

Will there be a windows version?

It’s a python script that should work on windows.

Now my query inspector tells me:

Object
xhrStatus:“complete”
request:Object
method:“GET”
url:“api/datasources/proxy/18/api/v1/query_range?query=sum(storj_total_diskspace%7Btype%3D%22used%22%7D)%20by(instance)&start=1572248175&end=1572258975&step=15”
response:"# HELP python_gc_objects_collected_total Objects collected during gc # TYPE python_gc_objects_collected_total counter python_gc_objects_collected_total{generation=“0”} 205.0 python_gc_objects_collected_total{generation=“1”} 149.0 python_gc_objects_collected_total{generation=“2”} 0.0 # HELP python_gc_objects_uncollectable_total Uncollectable object found during GC # TYPE python_gc_objects_uncollectable_total counter python_gc_objects_uncollectable_total{generation=“0”} 0.0 python_gc_objects_uncollectable_total{generation=“1”} 0.0 python_gc_objects_uncollectable_total{generation=“2”} 0.0 # HELP python_gc_collections_total Number of times this generation was collected # TYPE python_gc_collections_total counter python_gc_collections_total{generation=“0”} 214.0 python_gc_collections_total{generation=“1”} 19.0 python_gc_collections_total{generation=“2”} 1.0 # HELP python_info Python platform information # TYPE python_info gauge python_info{implementation=“CPython”,major=“3”,minor=“7”,patchlevel=“4”,version=“3.7.4”} 1.0 # HELP process_virtual_memory_bytes Virtual memory size in bytes. # TYPE process_virtual_memory_bytes gauge process_virtual_memory_bytes 2.70336e+07 # HELP process_resident_memory_bytes Resident memory size in bytes. # TYPE process_resident_memory_bytes gauge process_resident_memory_bytes 2.1630976e+07 # HELP process_start_time_seconds Start time of the process since unix epoch in seconds. # TYPE process_start_time_seconds gauge process_start_time_seconds 1.57225022112e+09 # HELP process_cpu_seconds_total Total user and system CPU time spent in seconds. # TYPE process_cpu_seconds_total counter process_cpu_seconds_total 9.22 # HELP process_open_fds Number of open file descriptors. # TYPE process_open_fds gauge process_open_fds 6.0 # HELP process_max_fds Maximum number of open file descriptors. # TYPE process_max_fds gauge process_max_fds 1.048576e+06 # HELP storj_nodeID_info Storj nodeID # TYPE storj_nodeID_info gauge storj_nodeID_info{nodeID=“1CMJNQVn5obKXVwoxDat9GtFZkL85m5fzCEFRpb8aMc5Q1uwae”} 1.0 # HELP storj_wallet_info Storj wallet # TYPE storj_wallet_info gauge storj_wallet_info{wallet=“0xmypayoutaddresshere”} 1.0 # HELP storj_lastPinged_info Storj lastPinged # TYPE storj_lastPinged_info gauge storj_lastPinged_info{lastPinged=“2019-10-28T10:36:21.631476185Z”} 1.0 # HELP storj_lastPingFromID_info Storj lastPingFromID # TYPE storj_lastPingFromID_info gauge storj_lastPingFromID_info{lastPingFromID=“1111111111111111111111111111111112m1s9K”} 1.0 # HELP storj_lastPingFromAddress_info Storj lastPingFromAddress # TYPE storj_lastPingFromAddress_info gauge storj_lastPingFromAddress_info{lastPingFromAddress=""} 1.0 # HELP storj_upToDate_info Storj upToDate # TYPE storj_upToDate_info gauge storj_upToDate_info{upToDate=“True”} 1.0 # HELP storj_diskSpace_used Storj diskSpace used # TYPE storj_diskSpace_used gauge storj_diskSpace_used 2.725345146112e+012 # HELP storj_diskSpace_available Storj diskSpace available # TYPE storj_diskSpace_available gauge storj_diskSpace_available 3.2e+012 # HELP storj_bandwidth_used Storj bandwidth used # TYPE storj_bandwidth_used gauge storj_bandwidth_used 1.01746716416e+012 # HELP storj_bandwidth_available Storj bandwidth available # TYPE storj_bandwidth_available gauge storj_bandwidth_available 1e+013 # HELP storj_sat_audit_totalCount Storj satellite totalCount # TYPE storj_sat_audit_totalCount gauge storj_sat_audit_totalCount{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 34084.0 storj_sat_audit_totalCount{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 52557.0 storj_sat_audit_totalCount{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 28031.0 storj_sat_audit_totalCount{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 48429.0 # HELP storj_sat_audit_successCount Storj satellite successCount # TYPE storj_sat_audit_successCount gauge storj_sat_audit_successCount{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 34069.0 storj_sat_audit_successCount{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 52529.0 storj_sat_audit_successCount{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 28021.0 storj_sat_audit_successCount{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 48417.0 # HELP storj_sat_audit_alpha Storj satellite alpha # TYPE storj_sat_audit_alpha gauge storj_sat_audit_alpha{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 19.99999999999995 storj_sat_audit_alpha{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 19.99999999999995 storj_sat_audit_alpha{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 19.99999999999995 storj_sat_audit_alpha{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 19.99999999999995 # HELP storj_sat_audit_beta Storj satellite beta # TYPE storj_sat_audit_beta gauge storj_sat_audit_beta{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 9.470814442923435e-230 storj_sat_audit_beta{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 1.106e-320 storj_sat_audit_beta{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 6.971964537857068e-127 storj_sat_audit_beta{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 4.4e-323 # HELP storj_sat_audit_score Storj satellite score # TYPE storj_sat_audit_score gauge storj_sat_audit_score{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 1.0 storj_sat_audit_score{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 1.0 storj_sat_audit_score{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 1.0 storj_sat_audit_score{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 1.0 # HELP storj_sat_uptime_totalCount Storj satellite totalCount # TYPE storj_sat_uptime_totalCount gauge storj_sat_uptime_totalCount{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 84614.0 storj_sat_uptime_totalCount{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 148737.0 storj_sat_uptime_totalCount{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 68542.0 storj_sat_uptime_totalCount{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 106291.0 # HELP storj_sat_uptime_successCount Storj satellite successCount # TYPE storj_sat_uptime_successCount gauge storj_sat_uptime_successCount{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 84186.0 storj_sat_uptime_successCount{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 148113.0 storj_sat_uptime_successCount{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 68308.0 storj_sat_uptime_successCount{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 105811.0 # HELP storj_sat_uptime_alpha Storj satellite alpha # TYPE storj_sat_uptime_alpha gauge storj_sat_uptime_alpha{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 99.99993291063394 storj_sat_uptime_alpha{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 99.99610392401908 storj_sat_uptime_alpha{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 99.99999831299723 storj_sat_uptime_alpha{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 99.99473289980504 # HELP storj_sat_uptime_beta Storj satellite beta # TYPE storj_sat_uptime_beta gauge storj_sat_uptime_beta{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 6.708936591858408e-05 storj_sat_uptime_beta{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 0.00389607598080344 storj_sat_uptime_beta{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 1.6870026634154512e-06 storj_sat_uptime_beta{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 0.005267100194847124 # HELP storj_sat_uptime_score Storj satellite score # TYPE storj_sat_uptime_score gauge storj_sat_uptime_score{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 0.9999993291063408 storj_sat_uptime_score{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 0.999961039240192 storj_sat_uptime_score{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 0.9999999831299733 storj_sat_uptime_score{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 0.9999473289980516 # HELP storj_sat_storageSummary Storj satellite storageSummary # TYPE storj_sat_storageSummary gauge storj_sat_storageSummary{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 2.5312616396968048e+011 storj_sat_storageSummary{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 1.8312529851280098e+015 storj_sat_storageSummary{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 1.2649600033978415e+011 storj_sat_storageSummary{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 3.521062839042433e+014 # HELP storj_sat_bandwidthSummary Storj satellite bandwidthSummary # TYPE storj_sat_bandwidthSummary gauge storj_sat_bandwidthSummary{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”} 2.08490752e+08 storj_sat_bandwidthSummary{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”} 7.98854861312e+011 storj_sat_bandwidthSummary{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”} 1.007673344e+010 storj_sat_bandwidthSummary{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”} 2.08327078656e+011 # HELP storj_total_diskspace Storj total diskspace metrics # TYPE storj_total_diskspace gauge storj_total_diskspace{type=“used”} 2.725345146112e+012 storj_total_diskspace{type=“available”} 3.2e+012 # HELP storj_total_bandwidth Storj total bandwidth metrics # TYPE storj_total_bandwidth gauge storj_total_bandwidth{type=“used”} 1.01746716416e+012 storj_total_bandwidth{type=“available”} 1e+013 # HELP storj_sat_summary Storj satellite summary metrics # TYPE storj_sat_summary gauge storj_sat_summary{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“storageSummary”} 2.5312616396968048e+011 storj_sat_summary{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“bandwidthSummary”} 2.08490752e+08 storj_sat_summary{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“storageSummary”} 1.8312529851280098e+015 storj_sat_summary{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“bandwidthSummary”} 7.98854861312e+011 storj_sat_summary{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“storageSummary”} 1.2649600033978415e+011 storj_sat_summary{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“bandwidthSummary”} 1.007673344e+010 storj_sat_summary{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“storageSummary”} 3.521062839042433e+014 storj_sat_summary{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“bandwidthSummary”} 2.08327078656e+011 # HELP storj_sat_audit Storj satellite audit metrics # TYPE storj_sat_audit gauge storj_sat_audit{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“totalCount”} 34084.0 storj_sat_audit{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“successCount”} 34069.0 storj_sat_audit{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“alpha”} 19.99999999999995 storj_sat_audit{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“beta”} 9.470814442923435e-230 storj_sat_audit{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“score”} 1.0 storj_sat_audit{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“totalCount”} 52557.0 storj_sat_audit{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“successCount”} 52529.0 storj_sat_audit{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“alpha”} 19.99999999999995 storj_sat_audit{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“beta”} 1.106e-320 storj_sat_audit{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“score”} 1.0 storj_sat_audit{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“totalCount”} 28031.0 storj_sat_audit{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“successCount”} 28021.0 storj_sat_audit{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“alpha”} 19.99999999999995 storj_sat_audit{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“beta”} 6.971964537857068e-127 storj_sat_audit{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“score”} 1.0 storj_sat_audit{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“totalCount”} 48429.0 storj_sat_audit{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“successCount”} 48417.0 storj_sat_audit{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“alpha”} 19.99999999999995 storj_sat_audit{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“beta”} 4.4e-323 storj_sat_audit{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“score”} 1.0 # HELP storj_sat_uptime Storj satellite uptime metrics # TYPE storj_sat_uptime gauge storj_sat_uptime{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“totalCount”} 84614.0 storj_sat_uptime{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“successCount”} 84186.0 storj_sat_uptime{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“alpha”} 99.99993291063394 storj_sat_uptime{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“beta”} 6.708936591858408e-05 storj_sat_uptime{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“score”} 0.9999993291063408 storj_sat_uptime{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“totalCount”} 148737.0 storj_sat_uptime{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“successCount”} 148113.0 storj_sat_uptime{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“alpha”} 99.99610392401908 storj_sat_uptime{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“beta”} 0.00389607598080344 storj_sat_uptime{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“score”} 0.999961039240192 storj_sat_uptime{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“totalCount”} 68542.0 storj_sat_uptime{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“successCount”} 68308.0 storj_sat_uptime{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“alpha”} 99.99999831299723 storj_sat_uptime{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“beta”} 1.6870026634154512e-06 storj_sat_uptime{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“score”} 0.9999999831299733 storj_sat_uptime{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“totalCount”} 106291.0 storj_sat_uptime{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“successCount”} 105811.0 storj_sat_uptime{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“alpha”} 99.99473289980504 storj_sat_uptime{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“beta”} 0.005267100194847124 storj_sat_uptime{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“score”} 0.9999473289980516 # HELP storj_sat_month_egress Storj satellite egress since current month start # TYPE storj_sat_month_egress gauge storj_sat_month_egress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“repair”} 0.0 storj_sat_month_egress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“audit”} 2.173184e+06 storj_sat_month_egress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“usage”} 1.580544e+06 storj_sat_month_egress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“repair”} 1.052536832e+09 storj_sat_month_egress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“audit”} 4.9664e+06 storj_sat_month_egress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“usage”} 5.92465209344e+011 storj_sat_month_egress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“repair”} 4.634112e+06 storj_sat_month_egress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“audit”} 1.297664e+06 storj_sat_month_egress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“usage”} 1.0059839488e+010 storj_sat_month_egress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“repair”} 1.82938624e+08 storj_sat_month_egress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“audit”} 4.805888e+06 storj_sat_month_egress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“usage”} 6.3716600576e+010 # HELP storj_sat_month_ingress Storj satellite ingress since current month start # TYPE storj_sat_month_ingress gauge storj_sat_month_ingress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“repair”} 0.0 storj_sat_month_ingress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“usage”} 2.04737024e+08 storj_sat_month_ingress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“repair”} 2.8217728e+08 storj_sat_month_ingress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“usage”} 2.05049971456e+011 storj_sat_month_ingress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“repair”} 2.317056e+06 storj_sat_month_ingress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“usage”} 8.64512e+06 storj_sat_month_ingress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“repair”} 7.9360256e+07 storj_sat_month_ingress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“usage”} 1.44343373312e+011 # HELP storj_sat_day_egress Storj satellite egress since current day start # TYPE storj_sat_day_egress gauge storj_sat_day_egress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“repair”} 0.0 storj_sat_day_egress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“audit”} 20992.0 storj_sat_day_egress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“usage”} 0.0 storj_sat_day_egress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“repair”} 2.317056e+06 storj_sat_day_egress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“audit”} 73472.0 storj_sat_day_egress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“usage”} 1.1937857024e+010 storj_sat_day_egress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“repair”} 0.0 storj_sat_day_egress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“audit”} 20224.0 storj_sat_day_egress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“usage”} 1.94620416e+08 storj_sat_day_egress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“repair”} 0.0 storj_sat_day_egress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“audit”} 82432.0 storj_sat_day_egress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“usage”} 7.45728512e+08 # HELP storj_sat_day_ingress Storj satellite ingress since current day start # TYPE storj_sat_day_ingress gauge storj_sat_day_ingress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“repair”} 0.0 storj_sat_day_ingress{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“usage”} 0.0 storj_sat_day_ingress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“repair”} 0.0 storj_sat_day_ingress{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“usage”} 5.622022912e+09 storj_sat_day_ingress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“repair”} 0.0 storj_sat_day_ingress{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“usage”} 0.0 storj_sat_day_ingress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“repair”} 0.0 storj_sat_day_ingress{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“usage”} 1.20720384e+08 # HELP storj_sat_day_storage Storj satellite data stored on disk since current day start # TYPE storj_sat_day_storage gauge storj_sat_day_storage{satellite=“12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S”,type=“atRestTotal”} 1.7693095338090143e+09 storj_sat_day_storage{satellite=“118UWpMCHzs6CvSgWd9BfFVjw5K9pZbJjkfZJexMtSkmKxvvAW”,type=“atRestTotal”} 9.942885042092459e+012 storj_sat_day_storage{satellite=“121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6”,type=“atRestTotal”} 7.793223222489196e+08 storj_sat_day_storage{satellite=“12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs”,type=“atRestTotal”} 2.6615505367959927e+012 "

But

The red sign is

Cannot read property ‘result’ of undefined

My query inspector seams to bo ok like

but the red signt tells me cannot read property ‘result’ of undefined