Hands-On with Apache Iceberg
1h 37mIntermediate2024-10-22
Authors
Dremio
Course details
Iceberg brings the reliability and simplicity of SQL tables to big data, while also making it possible to safely work with engines like Apache Spark at the same time. In this course, learn how to use Apache Spark and Dremio to get hands-on experience with creating, querying, and maintaining tables in Apache Iceberg. Develop a more comprehensive understanding of Apache Iceberg and its pivotal role in modern data lakehouse architectures. Learn how to configure an Iceberg catalog, create Apache Iceberg tables, insert records into tables, query tables, run maintenance operations, and much more. Upon completing this course, you’ll also know how to query different metadata tables in both Spark and Dremio.
Skills covered
ApacheFull-Stack Web DevelopmentWeb DevelopmentOpen SourceOne-Off
Concepts
0. Introduction
- 01 - Apache Iceberg
1. Hands-On with Apache Spark
- 02 - Setting up your environment
- 03 - Creating Iceberg tables
- 04 - Inserting data into tables
- 05 - Partitioning
2. Hands-On with Dremio
- 06 - Setting up your environment
- 07 - Creating Iceberg tables
- 08 - Inserting data into tables
- 09 - Partitioning
3. Maintaining Apache Iceberg Tables
- 10 - Maintenance operations
- 11 - Time travel queries
- 12 - The metadata tables
Conclusion
- 13 - Conclusion
Related courses
- DataOps with Apache Iceberg using Spark, Nessie, and Dremio
- Manage and Optimize Big Data with Apache Iceberg
- Apache Iceberg: From Zero to Production Data Lakehouse
- Hands-On Data Science: 4 Services Analysis in Spark
- Apache PySpark by Example
- Databricks Certified Data Engineer Associate Cert Prep: 2 ELT with Spark SQL and Python
- PySpark Essential Training: Introduction to Building Data Pipelines
- Building Recommender Systems with Machine Learning and AI
Related learn paths
- Data Engineering Foundations Professional Certificate by Astronomer
- Master Data Engineering
- Hands-On Data Science
- Advance Your Data Skills in Apache Spark
- Getting Started with Software Testing
- Prepare for the Databricks Certified Data Engineer Associate Certification
- Introduction to Fundamental Skills for Data Work: Data Strategy and Planning
- Explore a Career in Data Engineering