This is the third (and last) part of our HOW-TO (second part can be found here). Here we cover the creation of the actual Azure Data Factory Pipeline.
To start creating pipelines, you must select the Author icon and then click on the three dots icon ( … ) and select ‘New pipeline’:
This is the second part of our HOW-TO (first part is here). This is where we are going to set up the Azure Data Factory resources. Pipelines will be covered in part 3.
For the previously created RG, click on the data factory resource:
This is a step-by-step tutorial to copy data from Google BigQuery to Azure SQL using Azure Data Factory. It may also be useful as an introduction to the basics of Azure Data Factory.
This tutorial will be split into different parts, the first one being this introduction, plus the Azure Cloud setup required fo the tutorial. The second part will focus on the configuration of the Azure Data Factory itself. We are currently working on 3rd part where we will show how to further customize the Data Factory pipelines with parameters and dynamic content. …
In this article I attempt to provide an easy-to-digest explanation of what Deep Learning is and how it works, starting with an overview of the enabling technology; Artificial Neural Networks. As this is not an in-depth technical article, please take it as a starting point to get familiar with some basic concepts and terms. I will leave some links along the way, for curious readers to investigate further.
I am working as a Data Engineer at Bedrock, and my interest in the topic arose due to my daily exposure to doses of Machine Learning radiation emitted by the wild…
Data Engineer @Bedrockdbd.com