Azure Databricks & Spark Core For Data Engineers(Python/SQL)
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English + srt | Duration: 147 lectures (15h 12m) | Size: 3.76 GB
Real World Project on Formula1 Racing for Data Engineers using Azure Databricks, Delta Lake, Azure Data Factory DP203
What you'll learn:
You will learn how to build a real world data project using Azure Databricks and Spark Core. This course has been taught using real world data from Formula1 motor racing
You will acquire professional level data engineering skills in Azure Databricks, Delta Lake, Spark Core, Azure Data Lake Gen2 and Azure Data Factory (ADF)
You will learn how to create notebooks, dashboards, clusters, cluster pools and jobs in Azure Databricks
You will learn how to ingest and transform data using PySpark in Azure Databricks
You will learn how to transform and analyse data using Spark SQL in Azure Databricks
You will learn about Data Lake architecture and Lakehouse architecture. Also, you will learn how to implement a solution for Lakehouse architecture using Delta Lake.
You will learn how to create Azure Data Factory pipelines to execute Databricks notebooks
You will learn how to create Azure Data Factory triggers to schedule pipelines as well as monitor them.
You will gain the skills required around Azure Databricks and Data Factory to pass the Azure Data Engineer Associate certification exam DP203, but the primary objective of the course is not to teach you to pass the exams.
You will learn how to connect to Azure Databricks from Pow
Requirements
All the code and step-by-step instructions are provided, but the skills below will greatly benefit your journey
Basic Python programming experience will be required
Basic SQL knowledge will be required
Knowledge of cloud fundamentals will be beneficial, but not necessary
Azure subscription will be required, If you don't have one we will create a free account in the course
Description
Welcome!
I am looking forward to helping you with learning one of the in-demand data engineering tools in the cloud, Azure Databricks! This course has been taught with implementing a data engineering solution using Azure Databricks and Spark core for a real world project of analysing and reporting on Formula1 motor racing data.
,
