Real world project for Data Engineers using Azure Data Factory, SQL, Data Lake, Databricks, HDInsight, CI/CD [DP203]
Instructed by Ramesh Retnasamy 12.5 hours on-demand video, 20 articles & 34 downloadable resources
What you’ll learn
-
You will learn how to build a real-world data pipeline in Azure Data Factory (ADF). This course has been taught using real world data used to report Covid-19 trends.
-
You will acquire good Data Engineering skills in Azure using Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage and Azure Monitor
-
You will learn how to ingest data from sources such as HTTP and Azure Blob Storage into Azure Data Lake Gen2 using Azure Data Factory (ADF)
-
You will learn how to transform data using Data Flows in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2
-
You will learn how to transform data using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2
-
You will learn how to transform data using Azure HDInsight Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2
-
You will learn how to load transformed data from Azure Data Lake Storage Gen2 to Azure SQL Database using Azure Data Factory (ADF)
-
You will learn extensively about Triggers in Azure Data Factory (ADF) and how to use them to schedule the data pipelines.
-
You will learn how to monitor pipelines using Azure Data Factory (ADF), Azure Monitor and Log Analytics with a real-world project.
-
You will learn how to build production ready pipelines and good practices and naming standards
-
You will gain most of the skills required to pass the Azure Data Engineer Associate certification exams DP200 and DP200, but the primary objective of the course is not to teach you to pass the exams.
Who this course is for:
- University students looking for a career in Data Engineering
- IT developers working on other disciplines trying to move to Data Engineering
- Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Technologies
- Data Architects looking to gain an understanding about Azure Data Engineering stack
- Data Scientists who want extend their knowledge into data engineering
Recommended Courses
Deal Score+1
Disclosure: This post may contain affiliate links and we may get small commission if you make a purchase. Read more about Affiliate disclosure here.