What you’ll learn
-
How to Set Up a Production Ready Architecture for Airflow on AWS EKS From A-Z
-
How to deploy DAGs from Git (public and private)
-
How to Create CI/CD Pipelines with AWS CodePipeline Deploy DAGs
-
How to Share DAGs and Store Logs with AWS EFS
-
How to Enable Remote Logging with AWS S3 in EKS
-
How to Test your DAGs in CI/CD pipelines
-
How to Store Sensitive Data in AWS Secret Manager
WARNING:
- The course is not meant to learn the basic of Airflow, you must be already familiar with it.
- If you already know Kubernetes/Docker/AWS your learning will be easier, but no worries I explain everything you need.
- YOU WON’T learn how to interact with AWS in your DAGs. This course is about designing an architecture not about DAGs.
- The course is NOT free-tier eligible as we are going to use many AWS services and set up a real world architecture.
Who this course is for:
- Data engineers
- Software Engineers
- DevOps
Deal Score0
Disclosure: This post may contain affiliate links and we may get small commission if you make a purchase. Read more about Affiliate disclosure here.