Data Lake Structure - martajs/music-lake GitHub Wiki
Storage in this project uses concept of Data Lake to organize files, which is reflected with appropriate zones and folders structure.
At this moment we have following convention:
-
Zone: raw
Folder structure:raw/<source type>/<source>/<schema>/<version>/<date partitioning>/
Example:raw/rest/spotify/album/v1/2021/09/01/