API metrics addition

kevink · February 2, 2021, 5:44pm

Please add back the metric audit successCount so we can track the progress of the vetting.

Additionally please expose the space used by different satellites. This is already done when pretending to start a Graceful Exit but doesn’t exist in the storagenode API.
Edit:

Odmin · February 2, 2021, 5:50pm

I use atRestTotal parameter from API

kevink · February 2, 2021, 7:12pm

This is quite inaccurate because it’s TBh

kevink · February 2, 2021, 7:13pm

I’m sorry, I didn’t check the API carefully enough. Looks like it got added at some point under /api/sno/satellite/<sat_id>/CurrentStorageUsed

cameron · February 2, 2021, 8:52pm

I’ve asked the SNO growth team if we can put the audit metrics back into the API, and they said they can. They just need to schedule the work.

Pentium100 · February 2, 2021, 9:00pm

Until they do that, you can get the data from one of the databases.

My script as an example:

github.com

Pentium100MHz/storjv3-tools/blob/02fcdfafd3a3c066445f77e2ce4f846a24bf2711/satspace.php

<?php

$db_file="/storj/node/storage/piece_spaced_used.db";

function bc_arb_encode($num, $basestr) {
    if( ! function_exists('bcadd') ) {
        Throw new Exception('You need the BCmath extension.');
    }

    $base = strlen($basestr);
    $rep = '';

    while( true ){
        if( strlen($num) < 2 ) {
            if( intval($num) <= 0 ) {
                break;
            }
        }
        $rem = bcmod($num, $base);
        $rep = $basestr[intval($rem)] . $rep;

This file has been truncated. show original

Set the db_file variable to point to the location of that file.
run the script like this
php satspace.php 12rfG3sh9NCWiX3ivPjq2HtdLmbqCrvHVEzJubnzFzosMuawymB content
“content” can also be “trash” or “total” (which returns content+trash).

kevink · February 2, 2021, 9:02pm

Thanks but it’s for the prometheus exporter. Adding db access would be more complicated.

fmoledina · February 8, 2021, 2:43am

@kevink @greener challenge accepted?

Just kidding, having the vetting metrics back in the API would be best. Glad to hear that they may be back soon.

kevink · February 8, 2021, 6:00am

I have a challenge for you Learn go and the go prometheus exporter library and integrate it into the storagenode directly

fmoledina · February 8, 2021, 2:43pm

Hah! That would be quite the heavy lift for me haha. I’m okay at configuration, but I’m not really a dev. Hopefully they can incorporate that in the near future.