Data Engineering with Apache Spark

Workshop Description

Learn big data processing with Apache Spark in this virtual workshop. Process terabytes of data using distributed computing.

Topics

• •Spark architecture — driver, executors, DAG scheduler
• •RDDs, DataFrames, and Spark SQL
• •Streaming data with Spark Structured Streaming
• •Integrating with Hadoop, Kafka, and AWS S3

Hands-On Lab

Process a real-world 10GB dataset and build an ETL pipeline that runs on a Spark cluster.

Participants will receive cloud credits for AWS EMR.