3

I have created Azure Data Factory with Copy Activity using C# and Azure SDK. How can deploy it using CI/CD ?

Any URL or link will help

NSS
  • 1,835
  • 2
  • 29
  • 66

4 Answers4

1

Data Factory continuous integration and delivery is now possible with directly through the web user interface using ARM Templates or even Git (Github or Azure DevOps).

Just click on "Set up Code Repository" and follow the steps.

Check the following link for more information, including a video demostration: https://aka.ms/azfr/401/02

Julio Batista Silva
  • 1,861
  • 19
  • 19
0

One idea that I got from Microsoft was that using the same Azure SDK you could deserialize the objects and save down the JSON files following the official directory structure into your local GitHub/Git working directory

Official repository structure

In other words you would have to mimic what the UI Save All/Save button does from the portal.

Then using Git bash, you can just commit and push to your working branch (i.e. develop) and from the UI you can just publish (this will create an adf_publish release branch with the ARM objects)

Official reference for CI using VSTS and the UI Publish feature: https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment

dim_user
  • 969
  • 1
  • 13
  • 24
-1

Unfortunately, CI/CD for ADF is not very intuitive at first glance. Check out this blog post where I'm describing what/how/why step by step:

Deployment of Azure Data Factory with Azure DevOps

Let me know if you have any questions or concerns and finally - if that works for you.

Good luck!

Kamil Nowinski
  • 486
  • 3
  • 9
-1

My resources on how to enable CI/CD using Azure DevOps and Data Factory comes from the Microsoft site below:

Continuous integration and delivery (CI/CD) in Azure Data Factory

I am still new to DevOps and CI/CD, but I do know that other departments had this set up and it looks to be working for them.

Vitali Dedkov
  • 198
  • 3
  • 13
  • While this link may answer the question, it is better to include the essential parts of the answer here and provide the link for reference. Link-only answers can become invalid if the linked page changes. – csabinho Nov 19 '19 at 19:09
  • Thanks for the comment @csabinho I will keep that in mind next time I post. – Vitali Dedkov Nov 20 '19 at 14:07