Course details
Hadoop is indispensable when it comes to processing big data—as necessary to understanding your information as servers are to storing it. This course is your introduction to Hadoop; key file systems used with Hadoop; its processing engine, MapReduce, and its many libraries and programming tools. Developer and big-data consultant Lynn Langit shows how to set up a Hadoop development environment, run and optimize MapReduce jobs, code basic queries with Hive and Pig, and build workflows to schedule jobs. Plus, learn about the depth and breadth of available Apache Spark libraries available for use with a Hadoop cluster, as well as options for running machine learning jobs on a Hadoop cluster.
Instructor
-
Lynn Langit
Cloud Architect, Developer, Angel Investor
Lynn Langit is a cloud architect who works with Amazon Web Services and Google Cloud Platform.
Lynn specializes in big data projects. She has worked with AWS Athena, Aurora, Redshift, Kinesis, and the IoT. She has also done production work with Databricks for Apache Spark and Google Cloud Dataproc, Bigtable, BigQuery, and Cloud Spanner.
Lynn is also the cofounder of Teaching Kids Programming. She has spoken on data and cloud technologies in North and South America, Europe, Africa, Asia, and Australia.
Skills covered in this course
Viewers of this course
Getting started with Hadoop
- [Lynn] Hi, I'm Lynn Langit, and welcome to Hadoop Fundamentals. Hadoop is a set of technologies that's used to store and process huge amounts of data. In this course, I'll focus on using Hadoop to process data, rather than setting up and administering it. We'll take a look at business scenarios where Hadoop is an appropriate tool. I'll also cover libraries, such as MapReduce 1.0, and MapReduce 2.0. In addition, we'll take a look at Hive and Pig, which are often used in Hadoop implementations. Finally, I'll show you how to tune MapReduce and I'll give you a sneak peek at some of the other new Hadoop libraries. The Hadoop ecosystem is making big data projects possible for businesses and other organizations. So let's get started!
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.