All campus visitors must be fully vaccinated (boosted). Masks are highly recommended. Instructors & staff are required to submit a daily symptom check. COVID updates.
The first half of the course includes an overview of the frameworks for MapReduce and Spark. You will learn how to write MapReduce/Spark jobs and how to optimize data processing applications. The second half of the course covers SQL based tools for Big Data. We use Hive to build ETL jobs. The course also includes the fundamentals of NoSQL databases like HBase and Kafka.
The course consists of interactive lectures, hands-on labs in class, and take home practice exercises. Upon completion of this course, you will possess a strong understanding of the tools used to build Big Data applications using MapReduce, Spark, and Hive.
At the conclusion of the course, you should be able to
- Describe the role Hadoop plays in the analysis of big data
- Discuss the inner workings of Hadoop's computing framework, including MapReduce processing and Hadoop's file system (HDFS)
- Develop MapReduce applications - with exposure to both traditional MR2 and Spark
- Use Hive and NOSQL databases for data analysis
- Leverage the Hadoop ecosystem to become productive in analyzing data
- Big Data applications architecture
- Understanding Hadoop distributed file system (HDFS)
- How MapReduce framework works
- Introduction to HBase (Hadoop NoSQL database)
- Introduction to Apache Kafka
- Developing MapReduce applications
- Introduction to Spark and SparkSQL
- Developing Spark/SparkSQL applications
- Managing tables and query development in Hive
- Introduction to data pipelines
Note(s): This course uses EMR Hadoop distribution. Students are required to bring laptops—with 64bit CPU and a minimum of 8GB of memory—to class.
Skills Needed: Basic SQL skills and the ability to create simple programs in a modern programming language are required. An understanding of database, parallel or distributed computing is helpful.
- Save Your Seat
Help us confirm course scheduling. Enroll at least seven days before your course starts.
- Accessing Canvas
Learn more about gaining access to your course on Canvas in our FAQ section.
Accessibility and Accommodation
For accessibility questions or to request an accommodation, please visit Access for Students with Disabilities or email the Extension registrar.
Finance Your Education
Here are ways to pay for your education.
Sections Open for Enrollment:
|Date:||Start Time:||End Time:||Meeting Type:||Location:|
|Sat, 08-06-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 08-13-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 08-20-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 08-27-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 09-10-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 09-17-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 09-24-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 10-01-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 10-08-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|
|Sat, 10-15-2022||9:00 a.m.||12:00 p.m.||Flexible||SANTA CLARA / REMOTE|