I would like to suggest add metadata buffer to Selfhosted gateway.
GW will hold in buffer its owned files node metadata, that when it need download it start to do it directly from nodes, bypass request of nodes from satellite.
This will lower significantly time till start of download, as will disappear packet round till satellite and wait time of response from satellite DB.
Gateway will ask updates time to time of metadata from satellite.
Satellite will send static ip or domain name and gateway will resolve it by itself after receive and every X time.
As Stroj operate also own Gateway this will allow also much faster response for video stream from this GW.
GW will hold in buffer its owned files node metadata, that when it need download it start to do it directly from nodes, bypass request of nodes from satellite.
The request isn’t just for the node metadata, but also to handle billing, permissions and request limits. Also, pieces move around due to repair and node exits, which needs to be accounted for.
As for potential other solutions, maybe a partial cache would be a better idea. e.g. caching 4MB for each video. This would allow a concurrent download and start serving immediately. Of course, this comes with a downside of needing to keep the cache and satellite information in-sync (and potentially dealing with the missing data on satellite side, due to deletion).
2 Likes
Note, it’s already possible to enable a regular cache Gateway ST Advanced Usage - Storj DCS Docs
5 Likes