🚀 7 Data Engineering Projects for FREE!

Don't Burst Your Head !!

👨🏻‍💻 Here are the 7 Projects that you can start this weekend


1. Building Data Model and Writing ETL Job - https://lnkd.in/dQSm-d_k

Data modeling is an essential part of Data Engineering, DO NOT SKIP THIS!!!

What will you learn?
✅ Python
✅ SQL
✅ Building Data Models
✅ Basics of DBMS
✅ Writing ETL Job
✅ Querying Data Programmatically
✅ PostgreSQL


2. ETL Pipeline on AWS Cloud - https://lnkd.in/d4iy9Dgd

If have no idea about Cloud Computing then this project is for you

What will you learn?
✅ Python
✅ SQL
✅ Cloud Computing Basics
✅ AWS Services - Athena, Glue, Redshift, S3, IAM
✅ Creating Data Pipeline

3. Covid Data Analysis Project - https://lnkd.in/d2u4tS3R

This will be your first end-to-end Data Engineering project on Covid-19 Data

What will you learn?
✅ Python
✅ SQL
✅ Building Data Model
✅ AWS Services - Athena, Glue, Redshift, S3, IAM
✅ Creating Data Pipeline
✅ PostgreSQL


4. YouTube Data Analysis (End-To-End Data Engineering Project) - https://lnkd.in/dS8FwupT

This is a 3-hour long project where you will execute a complete Data Engineering project

What will you learn?
✅ Python and PySpark
✅ SQL
✅ How to understand the business problem
✅ AWS Services - Athena, Glue, Redshift, S3, IAM, Lambda, Quicksight
✅ Building Data Pipeline and Scheduling it

5. Twitter Data Pipeline using Airflow - https://lnkd.in/dkwdmPnS

If you are someone who wants to learn the basics about Airflow and how to build a data pipeline this project is for you

What will you learn?
✅ Python
✅ Basics of Airflow
✅ Working with Twitter Data and Package - Tweepy
✅ Python Package - Pandas
✅ Writing ETL job and storing data on S3

6. Extract Data From Amazon Website - https://lnkd.in/dccEasSH

Learn how to extract data from one source and build a dataset from it.
What will you learn?
✅ HTML Basics
✅ Web Scraping fundamentals
✅ Python
✅ Packages (BeautifulSoup, Pandas, Numpy)
✅ How to build a CSV file

7. Stock Market Real-Time Data Analysis using Kafka, AWS, and Python - https://lnkd.in/dWSjqcFf

What will you learn?
✅ Build a Real-Time simulation app using Python
✅ Understand the basics of Kafka (Broker, Producer, Consumer, Zookeeper, and many more)
✅ How install Kafka on EC2 (or any VM)
✅ Write Producer and Consumer code in Python
✅ Generate a real-time streaming pipeline and store data in S3
✅ Analyze Data in Real-Time using Athena

Credit Darshil Parmar for this Amazing Post !! This Guy is Doing a Amazing Job for the DE Folks out there !!

Tagging W3Schools.com as well for these best Resources !!


Tagging Neel shah , Suraz G. , POOJA JAIN , Arif Alam , Ashish Patel 🇮🇳


#dataengineering #dataengineer #dataanalytics #bigdata #dataanalysis #datasciences #sql #server #datasciences #python #data #pandas #business #html #aws #project #building #amazon #covid #projects #cloud #cloudcomputing #writing #career #stockmarket #pipeline #streaming #comment