Azure Databricks & Spark For Data Engineers (PySpark / SQL)

• You will learn how to build a real world data project using Azure Databricks and Spark Core. This course has been taught using real world data from Formula1 motor racing
• You will acquire professional level data engineering skills in Azure Databricks, Delta Lake, Spark Core, Azure Data Lake Gen2 and Azure Data Factory (ADF)
• You will learn how to create notebooks, dashboards, clusters, cluster pools and jobs in Azure Databricks
• You will learn how to ingest and transform data using PySpark in Azure Databricks
• You will learn how to transform and analyse data using Spark SQL in Azure Databricks
• You will learn about Data Lake architecture and Lakehouse architecture. Also, you will learn how to implement a solution for Lakehouse architecture using Delta Lake.
• You will learn how to create Azure Data Factory pipelines to execute Databricks notebooks
• You will learn how to create Azure Data Factory triggers to schedule pipelines as well as monitor them.
• You will gain the skills required around Azure Databricks and Data Factory to pass the Azure Data Engineer Associate certification exam DP203, but the primary objective of the course is not to teach you to pass the exams.
• You will learn how to connect to Azure  

Who this course is for:

• University students looking for a career in Data Engineering
• IT developers working on other disciplines trying to move to Data Engineering
• Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Data Technologies
• Data Architects looking to gain an understanding about Azure Data Engineering stack

Recommended Courses

• Mastering Databricks SQL Warehouse and Spark SQL
• Microsoft Azure Databricks Administration – ETL Workflow
• Databricks Certified Data Engineer Professional -Preparation
• Azure Databricks administration – ETL Workflow
• Master Apache Spark using Spark SQL and PySpark 3