Apache Spark for Data Engineering and Machine Learning

Module 1 – Spark for Data Engineering

• Spark Structured Streaming

• GraphFrames on Apache Spark

• ETL Workloads

• Hands-on Lab: ETL for ML Pipelines

Module 2 – Spark ML for Machine Learning

• Spark ML Fundamentals

• Spark ML Regression and Classification

• Spark ML Clustering

Module 3 – Final Project

o Lab: Setup & Practice Assignment

o Project Overview

o Lab: Final Assignment Project

o Project Submission & Grading

• Final Quiz