2.1 ETL Tool - Gs1TestTeam/MongoDB_Task GitHub Wiki

2.1 ETL (Extract, Transform, Load) Tool

Commercial VS. Own solution

Query Language

Data Migration using Node.js

Query Language

Query Language

Inside node.js: ​

  1. Check the depth from Schema Mapping Chart Metadata to figure out which parent or child collection is​
  2. Select parent from RDBMS // using mssql-npm JS​
  3. Select child from RDBMS // using mssql-npm JS ​
  4. Insert data using nested loop into MongoDB // using mongoose JS​

pseudo code:

while (parent != null) {1) create parent object in JSON formatwhile (child != null) {2) create child object in JSON format3) insert parent-child // or update parent-child object into MongoDB​
    }}

More consider: ​

  • How to migrate the incremental data​
  • How to prove the integrity of migration data
  • Why not add Backup & Recovery, Archiving & Purging functions later

Refer to the following document to follow the Best Practices while using ETL tools for MongoDB.

ETL Best Practices

SSIS and Node.js are being explored as ETL tools

⚠️ **GitHub.com Fallback** ⚠️