Databricks Certified Data Engineer Associate Cert Prep: 3 Incremental Data Processing
28mIntermediate2024-01-24
Authors
Noah Gift
MLOps Expert | Solopreneur | Author | Adjunct Professor | CTO
Course details
The Databricks Certified Data Engineer Associate certification exam assesses your ability to use the Databricks Lakehouse Platform to complete basic data engineering tasks. It also assesses your ability to use Apache Spark SQL and Python to perform multihop architecture ETL tasks that incrementally process new data from a variety of data sources to power analytic applications and dashboards in the Lakehouse.
In this course, instructor Noah Gift provides hands-on, practical instruction on the core concepts and skills covered in the third section of the exam: Incremental Data Processing. Explore the fundamentals of data management with Delta Lake, including efficient data transformation with Spark SQL, using Catalog Explorer, creating tables from files, querying external data sources and inspecting tables, ACID transactions, Z-ordering, and more.
In this course, instructor Noah Gift provides hands-on, practical instruction on the core concepts and skills covered in the third section of the exam: Incremental Data Processing. Explore the fundamentals of data management with Delta Lake, including efficient data transformation with Spark SQL, using Catalog Explorer, creating tables from files, querying external data sources and inspecting tables, ACID transactions, Z-ordering, and more.
Skills covered
DatabricksData EngineeringData AnalysisCert PrepData ScienceBusiness Analysis and StrategyBusiness Software and Tools
Concepts
1. Data Management with Delta Lake
- 01 - Efficient data transformation with Spark SQL
- 02 - Using Catalog Explorer
- 03 - Creating tables from files
- 04 - Querying external data sources
- 05 - Inspecting tables
- 06 - Reliable data pipelines with Delta Lake
- 07 - ACID transactions
- 08 - Z-ordering optimization
Related courses
- Databricks Certified Data Engineer Associate Cert Prep: 5 Data Governance
- Databricks Certified Data Engineer Associate Cert Prep: 6 Data Access with Unity Catalog
- Databricks Certified Data Engineer Associate Cert Prep: 2 ELT with Spark SQL and Python
- Databricks Certified Data Engineer Associate Cert Prep: 4 Production Pipelines
- Databricks Certified Data Engineer Associate Cert Prep: 1 Databricks Lakehouse Platform
- Databricks Certified Data Engineer Associate Cert Prep
- Databricks Certified Data Analyst Associate Cert Prep
- Exam Review: Designing and Implementing a Data Science Solution on Azure (DP-100)
Related learn paths
- Prepare for the Databricks Certified Data Engineer Associate Certification
- Prepare for the Azure Data Scientist Associate (DP-100) Certification
- Advance Your Data Skills in Apache Spark
- Advance Your Skills in the Hadoop/NoSQL Data Science Stack
- Hands-On Data Science
- Prepare for the Azure Data Engineer Associate (DP-203) Certification
- Explore AI for Data Engineering