I keep seeing this in my log, for a fully migrated 1.5TB node, ver. v1.123.4, Ubuntu+Docker, 32GB RAM, 1node. What dose it do and why does it do it non stop for the last 30 min? My drive is crunching endlessly.
2025-03-11T20:49:10Z INFO hashstore hashtbl rewritten {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "total records": 2031487, "total bytes": "459.4 GiB", "rewritten records": 3485, "rewritten bytes": "610.6 MiB", "trashed records": 0, "trashed bytes": "0 B", "restored records": 0, "restored bytes": "0 B", "expired records": 0, "expired bytes": "0 B"}
2025-03-11T20:49:10Z INFO hashstore compact once finished {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "duration": "32.446330339s", "completed": false}
2025-03-11T20:49:10Z INFO hashstore compact once started {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "today": 20158}
2025-03-11T20:49:10Z INFO hashstore compaction computed details {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "nset": 2031487, "nexist": 2031487, "modifications": false, "curr logSlots": 22, "next logSlots": 22, "candidates": [129, 75, 212, 100, 155, 183, 151, 172, 243, 205, 28, 226, 53, 152, 301, 222, 74, 238, 189, 63, 245, 159, 150, 146, 162, 160, 295, 213, 302, 191, 49, 107, 85, 248, 169, 135, 122, 156, 166, 81, 261], "rewrite": [63], "duration": "335.165545ms"}
2025-03-11T20:49:31Z INFO hashstore hashtbl rewritten {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "total records": 2031487, "total bytes": "459.4 GiB", "rewritten records": 2416, "rewritten bytes": "615.2 MiB", "trashed records": 0, "trashed bytes": "0 B", "restored records": 0, "restored bytes": "0 B", "expired records": 0, "expired bytes": "0 B"}
2025-03-11T20:49:31Z INFO hashstore compact once finished {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "duration": "20.537926123s", "completed": false}
2025-03-11T20:49:31Z INFO hashstore compact once started {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "today": 20158}
2025-03-11T20:49:31Z INFO hashstore compaction computed details {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "nset": 2031487, "nexist": 2031487, "modifications": false, "curr logSlots": 22, "next logSlots": 22, "candidates": [162, 53, 155, 18, 89, 144, 291, 166, 202, 61, 98, 49, 59, 5, 272, 207, 47, 172, 107, 39, 110, 102, 147, 142, 213, 85, 194, 22, 25, 31, 13, 77, 148], "rewrite": [272], "duration": "327.361028ms"}
2025-03-11T20:50:04Z INFO hashstore hashtbl rewritten {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "total records": 2031487, "total bytes": "459.4 GiB", "rewritten records": 3339, "rewritten bytes": "0.7 GiB", "trashed records": 0, "trashed bytes": "0 B", "restored records": 0, "restored bytes": "0 B", "expired records": 0, "expired bytes": "0 B"}
2025-03-11T20:50:04Z INFO hashstore compact once finished {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "duration": "33.470132945s", "completed": false}
2025-03-11T20:50:04Z INFO hashstore compact once started {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "today": 20158}
2025-03-11T20:50:04Z INFO hashstore compaction computed details {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "nset": 2031487, "nexist": 2031487, "modifications": false, "curr logSlots": 22, "next logSlots": 22, "candidates": [89, 161, 223, 147, 97, 209, 81, 110, 30, 190, 159, 222, 58, 166, 22, 13, 135, 265, 150, 50, 87, 221, 14, 90, 114, 189, 167, 59, 253, 164, 104, 191, 151, 256, 210, 18, 98, 169, 208, 74, 92, 125, 119], "rewrite": [13], "duration": "324.498437ms"}
2025-03-11T20:50:22Z INFO hashstore hashtbl rewritten {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "total records": 2031487, "total bytes": "459.4 GiB", "rewritten records": 2554, "rewritten bytes": "609.8 MiB", "trashed records": 0, "trashed bytes": "0 B", "restored records": 0, "restored bytes": "0 B", "expired records": 0, "expired bytes": "0 B"}
It started here:
2025-03-11T20:20:10Z INFO hashstore beginning compaction {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "stats": {"NumLogs":613,"LenLogs":"573.3 GiB","NumLogsTTL":78,"LenLogsTTL":"44.7 GiB","SetPercent":0.9990557414583201,"TrashPercent":0.2275130766712878,"Compacting":false,"Compactions":1,"TableFull":0,"Today":20158,"LastCompact":20154,"LogsRewritten":17,"DataRewritten":"0 B","Table":{"NumSet":2676991,"LenSet":"572.7 GiB","AvgSet":229717.37643944265,"NumTrash":570824,"LenTrash":"130.4 GiB","AvgTrash":245332.5526887447,"NumSlots":8388608,"TableSize":"512.0 MiB","Load":0.31912219524383545,"Created":20154},"Compaction":{"Elapsed":0,"Remaining":0,"TotalRecords":0,"ProcessedRecords":0}}}
2025-03-11T20:23:46Z INFO hashstore compaction acquired locks {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "duration": "3m36.057967936s"}
2025-03-11T20:23:46Z INFO hashstore compact once started {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "today": 20158}
2025-03-11T20:23:48Z INFO hashstore compaction computed details {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "nset": 2031487, "nexist": 2676995, "modifications": true, "curr logSlots": 23, "next logSlots": 22, "candidates": [130, 91, 201, 134, 443, 291, 154, 473, 432, 274, 118, 180, 142, 125, 186, 141, 262, 290, 287, 382, 53, 279, 188, 298, 181, 254, 16, 177, 13, 74, 239, 272, 212, 46, 8, 29, 381, 413, 119, 371, 374, 455, 407, 45, 461, 406, 172, 168, 442, 100, 300, 422, 463, 209, 56, 408, 18, 253, 173, 373, 48, 128, 68, 232, 257, 467, 22, 167, 395, 409, 171, 109, 375, 431, 472, 434, 196, 59, 372, 265], "rewrite": [375, 382, 455, 407, 467, 395, 128, 372, 46, 381, 473, 239, 374, 463, 408, 472, 443, 461, 371, 413, 279, 406, 422, 373, 431, 434, 442, 409, 432], "duration": "2.235317701s"}
2025-03-11T20:23:51Z INFO hashstore hashtbl rewritten {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "total records": 2031487, "total bytes": "459.4 GiB", "rewritten records": 0, "rewritten bytes": "0 B", "trashed records": 464026, "trashed bytes": "42.6 GiB", "restored records": 0, "restored bytes": "0 B", "expired records": 645508, "expired bytes": "113.1 GiB"}
2025-03-11T20:23:54Z INFO hashstore compact once finished {"Process": "storagenode", "satellite": "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S", "store": "s1", "duration": "7.644854218s", "completed": false}
Edit: Ouh, I see someone else stumbled upon this and littleskunk offered the explanation. Now I understand what he was reffering to.
Finnaly finished after 2 hours.