Big Data

Spark Basics and Streaming



Skill level


Course cost

About this course

Our ability to collect and analyze data is evolving at an exponential rate. We collect vast quantities of data every second and are only beginning to understand the true potential impact it can have on our businesses. All this data is an ever-expanding mountain of gold, waiting to be mined and transferred into new, profound capabilities that will help us become more adept at predicting the future. Fundamentally, this capability transforms organizations from reactive environments -- being managed by static and aged data -- to automated continuous learning environments in real time. Today’s analytical capabilities don’t stop at the physical or virtual boundaries of any organization. Relationships across the entire business model and value chain -- including customers, suppliers and partners -- do and should share real-time data. This allows companies to extend or acquire knowledge and feedback, significantly reducing performance risk, waste and costs while driving performance and growth. In this course you will understand what real time data is, and how to analyze it to get useful insights using Spark and Spark Streaming.

Skills covered

  • check Pyspark
  • check Spark
  • check Spark Streaming
  • check Real time Analytics

Course Syllabus

Spark Basics and Streaming

  • play Introduction to Spark
  • play Spark vs hadoop
  • play Spark architecture
  • play RDDs
  • play Spark terminologies
  • play Hands on PySpark
  • play Spark MLIB
  • play Moving from RDD to dataframe API
  • play Clustering with pyspark
  • play Music data case studies
  • play Overview of real time analytics and spark streaming
  • play Spark streaming architecture
  • play Understand real time analytics with twitter example
  • play Ad tech case study

Course Certificate

Get Spark Basics and Streaming course completion certificate from Great learning which you can share in the Certifications section of your LinkedIn profile, on printed resumes, CVs, or other documents.

GL Academy Sample Certificate
popup asset

Welcome to Great Learning Academy