I am creating a service for data collection from diverse stock/crypto martkets based on Storj.
The data structure is quite easy:
bucket = some specific asset (e.g. Bitcoin), which will include various 1 level folders (exchanges) and finally the minute ohlc charts.
To be more precise, this is an examplary structure:
myProject → bitcoin (bucket) → binance (folder) → bitcoin_1min.csv (file)
myProject → bitcoin (bucket) → kraken (folder) → bitcoin_1min.csv (file)
myProject → storj (bucket) → binance (folder) → storj_1min.csv (file)
myProject → storj (bucket) → kraken (folder) → storj_1min.csv (file)
To be flexible in terms of scalability I have to create folders on demand (e.g. further exchange added) and do this programmatically from the application.
I found the CreateBucket() function which does exactly what I need to do one layer lower Is there any CreateFolder() function with a similar functionality? Or alternatively, how do I include a bucket in a bucket? The trick with multiple buckets aka “bitcoin_binance” and “bitcoin_kraken” can be ofc used, but I would like to avoid this dirty style