Data Factory Scheduling

Often questions arise on how to correctly schedule Azure Data Factory pipelines. In this post we will look at some of the possible options and how they can affect your scheduling. The first two options revolve around changing when the datasets will become available for a pipeline to run. A pipeline may be set to…

1

Azure Data Factory – using a Stored Procedure as a destination

Azure Data Factory allows data to move from a multitude of sources to a multitude of destinations. A common usage case is to take on premise data and place it into a cloud database such as Azure SQL Database. Often this is done as a two-stage operation. Firstly, load the data into a data lake…