Streaming Big Data with Spark Streaming and Scala - Hands On

BY
Udemy

Mode

Online

Fees

₹ 475 1299

Quick Facts

particular details
Medium of instructions English
Mode of learning Self study
Mode of Delivery Video and Text Based

Course and certificate fees

Fees information
₹ 475  ₹1,299
certificate availability

Yes

certificate providing authority

Udemy

The syllabus

Getting Started

  • Tip: Apply for a Twitter Developer Account now!
  • Introduction, and Getting Set Up
  • [Activity] Stream Live Tweets with Spark Streaming!
  • Udemy 101: Getting the Most From This Course

A Crash Course in Scala

  • [Activity] Scala Basics
  • [Exercise] Flow Control in Scala
  • [Exercise] Functions in Scala
  • [Excercise] Data Structures in Scala

Spark Streaming Concepts

  • Introduction to Spark
  • The Resilient Distributed Dataset (RDD)
  • [Activity] RDD's in action: simple word count application
  • Introduction to Spark Streaming
  • [Activity] Revisiting the PrintTweets application
  • Windowing: Aggregating data over longer time spans
  • Fault Tolerance in Spark Streaming

Spark Streaming Examples with Twitter

  • [Exercise] Saving Tweets to Disk
  • [Exercise] Tracking the Average Tweet Length
  • [Exercise] Tracking the Most Popular Hashtags

Spark Streaming Examples with Clickstream / Apache Access Log Data

  • [Exercise] Tracking the Top URL's Requested
  • [Exercise] Alarming on Log Errors
  • [Exercise] Integrating Spark Streaming with Spark SQL
  • Intro to Structured Streaming
  • [Activity] Analyzing Apache Log files with Structured Streaming

Integrating with Other Systems

  • Integrating with Apache Kafka
  • Integrating with Apache Flume
  • Integrating with Amazon Kinesis
  • [Activity] Writing Custom Data Receivers
  • Integrating with Cassandra

Advanced Spark Streaming Examples

  • [Exercise] Stateful Information in Spark Streams
  • [Activity] Streaming K-Means Clustering
  • [Activity] Streaming Linear Regression

Spark Streaming in Production

  • [Activity] Packaging and running Spark code in production
  • [Activity] Packaging your code with SBT
  • Running on a real Hadoop cluster with EMR
  • Troubleshooting and Tuning Spark Jobs

You Made It!

  • Learning More
  • Bonus Lecture: More courses to explore!

Instructors

Mr Frank Kane

Mr Frank Kane
Founder
Freelancer

Trending Courses

Popular Courses

Popular Platforms

Learn more about the Courses