How are you harnessing the immense amount of data embedded inside The Internet of Things (IoT)? This phenomenon promises many new technological innovations and business benefits. The prospect of connecting potentially millions or even billions of embedded devices, sensors, appliances and other data-collecting gear to the cloud is daunting yet exciting. It requires new processes and tools for collecting and processing IoT big data and analyzing the device information to glean insights embedded within vast amounts of data. This course introduces the data and analytic flows with a specific focus on IoT.

The course first defines IoT and why IoT data processing is very different from typical big data analytics, with its unique requirements for data security, device identity, huge data volume, and real-time processing. The course reviews the challenges and current architectures of IoT data collection to the cloud. Using a hands-on approach in Amazon Web Services (AWS) with simulated data, you will learn to build a messaging and data streaming system with Apache Spark, Storm and Kafka. You will learn to perform a real-time pattern analysis with IoT data, utilizing the Hadoop ecosystem and gaining further predictive insights to set up actionable triggers for business and data mining applications.

You will use AWS accounts to work on assignments that let you design and analyze your own IoT device data and explore valuable insights. The course demonstrates data flow and offers hands-on experience gaining business intelligence from IoT big data. The instructor will share industrial practices of IoT big data processing and analytics. The course focuses on how to use tools and provides a basic overview; in-depth of the data processing tools and frameworks are covered in other courses. Some programming will be needed to customize the data flow at the Hbase layer in Spark.

Learning Outcomes
At the conclusion of the course, you should be able to

• Describe characteristics and requirements of IoT specific data
• Demonstrate how to build a data flow to connect an IoT system or device data to the cloud in specific formats
• Explain how to use big data tools to process IoT data in distributed computing
• Employ algorithms (including Kafka data stream processing and machine learning) to analyze IoT data patterns and extract intelligence

Skills Needed:

Software installation and some programming experience in C, Java or Python (one of the three) is required.