Data Lake Structure - martajs/music-lake GitHub Wiki

Storage in this project uses concept of Data Lake to organize files, which is reflected with appropriate zones and folders structure.

At this moment we have following convention:

  • Zone: raw
    Folder structure: raw/<source type>/<source>/<schema>/<version>/<date partitioning>/
    Example: raw/rest/spotify/album/v1/2021/09/01/
⚠️ **GitHub.com Fallback** ⚠️