What you’ll learn
-
Azure Data Factory
-
Azure Blob Storage
-
Azure Gen 2 Data Lake Storage
-
Azure Data Factory Pipelines
-
Data Engineering Concepts
-
Data Lake Concepts
-
Metadata Driven Frameworks Concepts
-
Industry Example on How to build Ingestion Frameworks
-
Dynamic Azure Data Factory Pipelines
-
Email Notifications with Logic Apps
-
Tracking of Pipelines and Batch Runs
-
Version Management with Azure DevOps
Creating your first Pipeline
What will be covered is as follows;
1. Introduction to Azure Data Factory
2. Unpack the requirements and technical architecture
3. Create an Azure Data Factory Resource
4. Create an Azure Blob Storage account
5. Create an Azure Data Lake Gen 2 Storage account
6. Learn how to use the Storage Explorer
7. Create Your First Azure Pipeline.
Metadata Driven Ingestion
1. Unpack the theory on Metadata Driven Ingestion
2. Describing the High-Level Plan for building the User
3. Creation of a dedicated Active Directory User and assigning appropriate permissions
4. Using Azure Data Studio
5. Creation of the Metadata Driven Database (Tables and T-SQL Stored Procedure)
6. Applying business naming conventions
7. Creating an email notifications strategy
8. Creation of Reusable utility pipelines
9. Develop a mechanism to log data for every data ingestion pipeline run and also the batch itself
10. Creation of a dynamic data ingestion pipeline
11. Apply the orchestration pipeline
12. Explanation of T-SQL Stored Procedures for the Ingestion Engine
13. Creating an Azure DevOps Repository for the Data Factory Pipelines
Event-Driven Ingestion
1. Enabling the Event Grid Provider
2. Use the Getmetadata Activity
3. Use the Filter Activity
4. Create Event-Based Triggers
5. Create and Merge new DevOps Branches
Who this course is for:
- Aspiring Data Engineers
- Developers that are curious about Azure Data Factory as an ETL alternative
Can I download Azure Data Engineering – Build Data Ingestion Engine Project course?
You can download videos for offline viewing in the Android/iOS app. When course instructors enable the downloading feature for lectures of the course, then it can be downloaded for offline viewing on a desktop.Can I get a certificate after completing the course?
Yes, upon successful completion of the course, learners will get the course e-Certification from the course provider. The Azure Data Engineering – Build Data Ingestion Engine Project course certification is a proof that you completed and passed the course. You can download it, attach it to your resume, share it through social media.Are there any other coupons available for this course?
You can check out for more Udemy coupons @ www.coursecouponclub.comDisclosure: This post may contain affiliate links and we may get small commission if you make a purchase. Read more about Affiliate disclosure here.