Hadoop for Data Science Tips, Tricks, & Techniques

Hadoop—the hugely popular big data platform—offers a vast array of capabilities designed to help data scientists deliver their insights. In this course, Ben Sullins helps you get up to speed with Hadoop by sharing a series of tips and tricks for doing data science work in this powerful platform. He starts by looking at how to work with Hadoop data in HDFS, and then explores using Hive—the Hadoop SQL engine—where a lot of data science work happens. To wrap up the course, Ben covers techniques for running fast queries in the Hive engine.

Learning objectives
Explain which commands are used to make changes in HDFS.
Identify the commands used to upload data from the command line to the HDFS.
Recognize two operations the HDFS performs when a user moves files.
Summarize how to remove files recursively in HDFS.
Recall how to select and implement partitions.
Explain how to flatten a Struct data type in HiveQL.