Reporting Cache - ja-guzzle/guzzle_docs GitHub Wiki
Ideally there will be requirement to maintain reporting cache in the SQL server and in some cases on SQL Warehouse.
- Suggestion is to limit this data to : only required tables, use features of reporting tool to navigate to details when required,
- Dimension table should be copied fully (except dated ones), fact table should be loaded incrementally.
- Ensure end to end batch flow covers loading from staging to foundation to aggregate to reporting cache.
- Ideal to leverage the computation
- Use appropriate Spark connector for better performance
- Perform recon to ensure the data ties back
- Ensure there are no data type alignment issues - including number and date types