Deploying Data Pipelines in Microsoft Azure 6. Implementing Continuous Integration and Delivery of Azure Data Factory Pipelines Using Azure DevOps - Kripadhn/Data-Engineering GitHub Wiki

  1. Getting Started with Azure Data Factory and CICD Using Azure DevOps
  2. Creating Variable Groups in Azure DevOps
  3. Creating a Release Pipeline in Azure DevOps
  4. Selecting an Artifact
  5. Adding Tasks to the Pipeline Stage
  6. Adding Pre and Post Deployment PowerShell Scripts
  7. Cloning Stages, Linking Variable Groups, and Configuring Permissions
  8. Enabling Continuous Deployment Trigger and Pre-deployment Conditions
  9. Implementing a New Feature in the Development Environment
  10. Deploying to the Staging Environment
  11. Deploying to the Production Environment

1. Getting Started with Azure Data Factory and CICD Using Azure DevOps

image

2. Creating Variable Groups in Azure DevOps

image

3. Creating a Release Pipeline in Azure DevOps

image

4. Selecting an Artifact

image

image

5. Adding Tasks to the Pipeline Stage

image

image

image

image

6. Adding Pre and Post Deployment PowerShell Scripts

image

7. Cloning Stages, Linking Variable Groups, and Configuring Permissions

image

image

image

image

image

image

image

image

image

image

image

For production- set access policies principles

image

8. Enabling Continuous Deployment Trigger and Pre-deployment Conditions

image

9. Implementing a New Feature in the Development Environment

image

10. Deploying to the Staging Environment

image

image

image

11. Deploying to the Production Environment

image