Tomorrow at 17:00 Berlin time we have office hours with Will
We will quickly go over frequent problems and then answer your questions
You can ask your questions in advance here: https://app.sli.do/event/aFZgu1o3nbgJTyX1AH1dtF
The questions should be about workflow orchestration or Kestra
See you tomorrow!
We will quickly go over frequent problems and then answer your questions
You can ask your questions in advance here: https://app.sli.do/event/aFZgu1o3nbgJTyX1AH1dtF
The questions should be about workflow orchestration or Kestra
See you tomorrow!
app.sli.do
Join Slido: Enter #code to vote and ask questions
Participate in a live poll, quiz or Q&A. No login required.
We're starting in one hour!
You can ask your questions in advance here: https://app.sli.do/event/aFZgu1o3nbgJTyX1AH1dtF
We will share the link to the stream here 5-10 minutes before the start
You can ask your questions in advance here: https://app.sli.do/event/aFZgu1o3nbgJTyX1AH1dtF
We will share the link to the stream here 5-10 minutes before the start
app.sli.do
Join Slido: Enter #code to vote and ask questions
Participate in a live poll, quiz or Q&A. No login required.
Workflow Orchestration office hours
Stream: https://www.youtube.com/watch?v=aBQulSpOgfY
Questions: https://app.sli.do/event/aFZgu1o3nbgJTyX1AH1dtF
Join now or watch later in recording
Stream: https://www.youtube.com/watch?v=aBQulSpOgfY
Questions: https://app.sli.do/event/aFZgu1o3nbgJTyX1AH1dtF
Join now or watch later in recording
YouTube
Data Engineering Zoomcamp 2025 Office Hours (Kestra)
🔗 CONNECT WITH DataTalksClub
Join the community - https://datatalks.club/slack.html
Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5k…
Join the community - https://datatalks.club/slack.html
Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5k…
We started module 3 yesterday
Materials: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/03-data-warehouse
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/03-data-warehouse/homework.md
Have fun!
Materials: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/03-data-warehouse
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/03-data-warehouse/homework.md
Have fun!
GitHub
data-engineering-zoomcamp/03-data-warehouse at main · DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering. - DataTalksClub/data-engineering-zoomcamp
The dlt workshop happens today at 16:30 Berlin time
We will share the link to the stream here 5-10 minutes before we start
If you can't make it, don't worry, the stream will be recorded
See you all soon!
We will share the link to the stream here 5-10 minutes before we start
If you can't make it, don't worry, the stream will be recorded
See you all soon!
Workshop stream: https://www.youtube.com/watch?v=pgJWP_xqO1g
https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/cohorts/2025/workshops/dlt
watch now or later in recording
https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/cohorts/2025/workshops/dlt
watch now or later in recording
YouTube
Data Ingestion From APIs to Warehouses and Data Lakes - Violetta Mishechkina
Links:
- Workshop: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/cohorts/2025/workshops/dlt
- Course: https://github.com/DataTalksClub/data-engineering-zoomcamp/
- Community: https://dlthub.com/community
- 2024 Workshop: https://w…
- Workshop: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/cohorts/2025/workshops/dlt
- Course: https://github.com/DataTalksClub/data-engineering-zoomcamp/
- Community: https://dlthub.com/community
- 2024 Workshop: https://w…
You asked how to get a dlt T-shirt
The answer: use dlt in your course project!
We will have 10 T-shirts, so we'll do a raffle if more than 10 people use dlt. But virtual hugs from the entire dlt team are guaranteed to everyone!
The answer: use dlt in your course project!
We will have 10 T-shirts, so we'll do a raffle if more than 10 people use dlt. But virtual hugs from the entire dlt team are guaranteed to everyone!
We scored homework 3 - you can see the results in the course management platform
We start module 4 next week on Monday, so you have a few days to catch up with the workshop
Have fun!
We start module 4 next week on Monday, so you have a few days to catch up with the workshop
Have fun!
Did somebody do the extra dlt homework that we gave at the end of the workshop? We're still waiting for the PR!
We're starting module 4 on dbt and analytics engineering!
Module: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/04-analytics-engineering
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/04-analytics-engineering/homework.md
Have fun!
Module: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/04-analytics-engineering
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/04-analytics-engineering/homework.md
Have fun!
GitHub
data-engineering-zoomcamp/04-analytics-engineering at main · DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering. - DataTalksClub/data-engineering-zoomcamp
Hi everyone!
We are extending module 4 by 3 days. We will start module 5 (spark) on Thursday
Happy learning!
We are extending module 4 by 3 days. We will start module 5 (spark) on Thursday
Happy learning!
Hi everyone!
Today we started module 5: batch processing
Materials: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/05-batch
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/05-batch/homework.md
Have fun!
The form for submitting homework 4 will remain open for some time
Today we started module 5: batch processing
Materials: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/05-batch
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/05-batch/homework.md
Have fun!
The form for submitting homework 4 will remain open for some time
GitHub
data-engineering-zoomcamp/05-batch at main · DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering. - DataTalksClub/data-engineering-zoomcamp
Hi everyone!
We will record module 6 on streaming live. It'll be tomorrow (Monday) at 17:00 CET. We'll send a reminder one hour before the start and share the link here too.
See you tomorrow!
We will record module 6 on streaming live. It'll be tomorrow (Monday) at 17:00 CET. We'll send a reminder one hour before the start and share the link here too.
See you tomorrow!
Hi everyone!
We accidentally discovered that for Q3 homework 5 different versions of Spark give different answers
We're still trying to figure out why it's happening, but if you came across this issue, select the closest option - it will still be the correct one
We accidentally discovered that for Q3 homework 5 different versions of Spark give different answers
We're still trying to figure out why it's happening, but if you came across this issue, select the closest option - it will still be the correct one
We're starting a stream about streaming in 1 hour. May the stream be with you!
Stream about streaming with Zach: https://www.youtube.com/watch?v=P2loELMUUeI
(Available for replay later)
(Available for replay later)
YouTube
Data Engineering Zoomcamp 2025 - Streaming - with Zach Wilson
Links:
- Repo: https://github.com/EcZachly/flink-training
- Course: https://github.com/DataTalksClub/data-engineering-zoomcamp
0:00 - Introduction to the Workshop
0:33 - Overview of the Session and Goals
1:04 - Tools and Technologies Used: Docker, Flink…
- Repo: https://github.com/EcZachly/flink-training
- Course: https://github.com/DataTalksClub/data-engineering-zoomcamp
0:00 - Introduction to the Workshop
0:33 - Overview of the Session and Goals
1:04 - Tools and Technologies Used: Docker, Flink…
We're still preparing homework for module 6, so you can continue working on module 5 in the meantime. We leave the homework form open for some time
Hi everyone!
The content and the homework for module 6 are ready
You can start working on the module
Module: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/06-streaming
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/06-streaming/homework.md
The homework is based on the PyFlink stream that Zach did, so you can treat the rest of the videos in module 6 as optional
Have fun and let us know in Slack if you have any problems
The content and the homework for module 6 are ready
You can start working on the module
Module: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/06-streaming
Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/06-streaming/homework.md
The homework is based on the PyFlink stream that Zach did, so you can treat the rest of the videos in module 6 as optional
Have fun and let us know in Slack if you have any problems
GitHub
data-engineering-zoomcamp/06-streaming at main · DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering. - DataTalksClub/data-engineering-zoomcamp
If you're looking for a project idea and interested in Blockchain, check this:
https://bush-thrill-4c5.notion.site/Solana-on-chain-analytics-competition-1aa9ca5fcbe7806dbee4eb96570c10a6?pvs=4
Our friend Dmitry Dremov is organizing a series of analytics competition on Solana data
You can check the past and ongoing competitions to learn more about the dataset or play with the data yourself and see if it's interesting for you to make a project about it
https://bush-thrill-4c5.notion.site/Solana-on-chain-analytics-competition-1aa9ca5fcbe7806dbee4eb96570c10a6?pvs=4
Our friend Dmitry Dremov is organizing a series of analytics competition on Solana data
You can check the past and ongoing competitions to learn more about the dataset or play with the data yourself and see if it's interesting for you to make a project about it
Hi everyone!
We hope you're enjoying the course! Now it's time to put everything we learned into practice
We start working on our projects
Here you can find more information about it: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/projects/README.md
You'll find the links for submitting your projects in the course management platform (and also here: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/project.md)
We hope you're enjoying the course! Now it's time to put everything we learned into practice
We start working on our projects
Here you can find more information about it: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/projects/README.md
You'll find the links for submitting your projects in the course management platform (and also here: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2025/project.md)
GitHub
data-engineering-zoomcamp/projects/README.md at main · DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering. - DataTalksClub/data-engineering-zoomcamp
We hope you're enjoying the project!
A reminder that if you use dlt in your project, you can get one of their T-shirts!
A reminder that if you use dlt in your project, you can get one of their T-shirts!