Data Engineering using Kafka and Spark Structured Streaming

Coupon Verified on April 4th, 2025


Course Name : Data Engineering using Kafka and Spark Structured Streaming
Students : 1,995
Duration : 9.5 hrs
Avg Rating : 4.1
Original Price : $119.99
Discount Price : $9.99
Instructor / Provider : Udemy
Course Type : Self Paced Online Course. Lifetime Access
Coupon : Click on ENROLL NOW to apply discount code

What you’ll learn

  • Setting up self support lab with Hadoop (HDFS and YARN), Hive, Spark, and Kafka
  • Overview of Kafka to build streaming pipelines
  • Data Ingestion to Kafka topics using Kafka Connect using File Source
  • Data Ingestion to HDFS using Kafka Connect using HDFS 3 Connector Plugin
  • Overview of Spark Structured Streaming to process data as part of Streaming Pipelines
  • Incremental Data Processing using Spark Structured Streaming using File Source and File Target
  • Integration of Kafka and Spark Structured Streaming – Reading Data from Kafka Topics

Here is a brief outline of the course. You can choose either Cloud9 or GCP to provision a server to set up the environment.

  • Setting up Environment using AWS Cloud9 or GCP
  • Setup Single Node Hadoop Cluster
  • Setup Hive and Spark on top of Single Node Hadoop Cluster
  • Setup Single Node Kafka Cluster on top of Single Node Hadoop Cluster
  • Getting Started with Kafka
  • Data Ingestion using Kafka Connect – Web server log files as a source to Kafka Topic
  • Data Ingestion using Kafka Connect – Kafka Topic to HDFS a sink
  • Overview of Spark Structured Streaming
  • Kafka and Spark Structured Streaming Integration
  • Incremental Loads using Spark Structured Streaming

Who this course is for:

  • Experienced ETL Developers who want to learn Kafka and Spark to build streaming pipelines
  • Experienced PL/SQL Developers who want to learn Kafka and Spark to build streaming pipelines
  • Beginner or Experienced Data Engineers who want to learn Kafka and Spark to build streaming pipelines

Recommended Courses 

  1. Apache Kafka Series – Kafka Cluster Setup & Administration
  2. Kafka fundamentals for java developers
  3. Apache Kafka Series – Kafka Monitoring & Operations
Deal Score-1
Disclosure: This post may contain affiliate links and we may get small commission if you make a purchase. Read more about Affiliate disclosure here.

FAQs on Udemy Coupon

Are there any limitations to access udemy coupon Code?

Yes, Data Engineering using Kafka and Spark Structured Streaming coupon code is valid for the first 1,000 enrollments or for 30 days, whichever comes first. After that, the coupon will expire.

Is Data Engineering using Kafka and Spark Structured Streaming free download available?

No, you cannot download Udemy course directly from the website. However, Udemy’s mobile app for iOS and Android allows you to download courses for offline viewing within the app.

Can I get a refund for the Data Engineering using Kafka and Spark Structured Streaming course, If I purchased with a coupon?

Yes, Udemy offers a 30-day money-back guarantee for all courses purchased on the website, even if you used a coupon to purchase the course.
Course Coupon Club
Logo
Follow us on Telegram