Share with your friends : The data engineering channel with Andrea Kretz

https://t.me/learndataengineering

By the way, here's today's YouTube video. Also need to get better sharing content that we create

I've been looking into MLOps and how to manage your models in production. I think one of the best ideas is to actually use a document store to manage the models. There's a way with Keras to ex and import your model to JSON: https://keras.io/api/models/model_saving_apis/?utm_source=pocket_mylist#tojson-method

For just saving the weights you would still need to use h5 files though https://stackoverflow.com/questions/42621864/difference-between-keras-model-save-and-model-save-weights

Hell Yeah Brother!! DATA ENGINEERING!! 😎

Been looking into creating APIs with Python. Really like the FastAPI library. Super easy and you dont have to learn new langauges. I even did a course about it in the academy.
https://youtu.be/xU_F-KqzrV4

It's actually like this in almost every company 🙈

Guys worked hard all day to publish my new MongoDB course:
🤩
https://learndataengineering.com/p/mongodb-fundamentals-course

Interesting answers about NoSQL databases
https://www.linkedin.com/posts/andreas-kretz_datascience-datascientist-dataengineer-activity-6825409358491344896-qLrt

Having 6 rounds of job interviews is dumb! Check out the 66 comments here what other people think about it:

https://www.linkedin.com/posts/andreas-kretz_dataengineer-dataengineering-datascientist-activity-6823220184526938112-SRYo

This hits home with me. You as well?

https://www.linkedin.com/posts/loai-skouti-01361071_he-will-be-an-engineer-activity-6825073906395750400-TsnT

Join the Data Engineering Chat: https://t.me/teamdatascience

Just did a live stream on YouTube about my next Data Engineering project for the academy:

https://youtu.be/R5vrqbKJGdM

Nr.8 of the top 21 Influencers. Yeah Baby!!!

The most inspiring list, with our Top 21 Influencers in Data for 2021:
https://rivery.io/blog/big-data-science-analytics-influencers-list-2021/

Everyone, the chat group is getting bombarded with spam. I'm wondering how I can do it that it's closed, but people can still comment on the posts here. Anybody knows?

Very interesting and true. Haven't read through it fully, but what I have seen is enough to know it's very accurate

https://markewbie.weebly.com/too-many-managers.html

Been a guest at the Monday Morning Data Show today. Over 50 minutes talking about Data Engineering:

https://youtu.be/MDn7jtwd1DY

We now have a Hadoop course by Suyog Nagaokar in our Data Engineering academy at Learn Data Engineering!
You know, it is still a great decision to look into Hadoop. It helps you to learn the basics of distributed storage and processing.

These concepts you will find everywhere!

Hadoop File System HDFS?
"Looks like S3!"

MapReduce?
"Hey, I see the same concepts in Spark!"

Hive, a Data Warehouse that can also turn files into tables?
"This is the same that AWS is doing with Athena and Redshift Spectrum!"

Suyog is currently working on part 3 and 4 of the course.
We thought to already release the first two, so you can start with the basics today 🙂

Here's the link to the course & the curriculum:
https://learndataengineering.com/p/data-engineering-with-hadoop

Have fun and please give Suyog a follow on LinkedIn !!
https://www.linkedin.com/in/suyog-nagaokar/