Data Quality Fundamentals

2022 O'Reilly Media, Inc.

- Build more trustworthy and reliable data pipelines
- Write scripts to make data checks and identify broken pipelines with data observability
- Program your own data quality monitors from scratch
- Develop and lead data quality initiatives at your company
- Generate a dashboard to highlight your company's key data assets
- Automate data lineage graphs across your data ecosystem
- Build anomaly detectors for your critical data assets

Dataviz-inspiration.com aims at being the biggest list of chart examples available on the web. It showcases 104 of the most beautiful and impactful dataviz projects I know. The collection is a good place to visit when you're designing a new graph, together with data-to-viz.com that shares dataviz best practices.
https://www.dataviz-inspiration.com/

Curated list of project-based tutorials
https://github.com/practical-tutorials/project-based-learning

Understanding Change Data Capture (CDC): Definition, Methods and Benefits | Airbyte
https://airbyte.com/blog/change-data-capture-definition-methods-and-benefits

The Data Engineering Cookbook
Mastering The Plumbing Of Data Science
September 12, 2021

https://github.com/andkret/Cookbook code examples

https://cookbook.learndataengineering.com/docs/01-Introduction - free online version

Introduction to Data Engineering (Daniel Beach).pdf

With the rise of Data Science and Machine Learning, Data Engineering is quickly becoming an in-demand skill. Data Engineering requires a unique skill set that is hard to learn without experience. I will teach you how to write scalable data pipelines and more!

Introduction
Chapter 1 - The Theory
Chapter 2 - Data Pipeline Basics
Chapter 3 - Pipeline Architecture
Chapter 4 - Storage
Chapter 5 - Compute and Resources
Chapter 6 - Mastering SQ
Chapter 7 - Data Warehousing / Data Lakes
Chapter 8 - Data Modeling
Chapter 9 - Data Quality
Chapter 10 - DevOps for Data Engineers

Урок из марафона с разбором Airbyte
https://www.youtube.com/watch?v=bzjXuilsUuU

Материалы марафона https://github.com/Arkronus/cooking-data

GitHub - ozlerhakan/datacamp: 🍧 DataCamp data-science and machine learning courses
https://github.com/ozlerhakan/datacamp

Как построить систему аналитики на open-source — туториал по cube.js
https://habr.com/ru/post/658581/

Apache Superset 1.5: Release Notes | Preset
https://preset.io/blog/apache-superset-1-5-release-notes/

Embed Power BI analytics - Learn | Microsoft Docs
https://docs.microsoft.com/en-us/learn/paths/power-bi-embedded/

dbt известны своей относительной простотой, так как дает возможность создавать все трансформации данных на SQL. Согласно их roadmap на 2022 год, они добавляют поддержку Python - Python-language dbt models

How to measure data quality. Practical guidelines for how to measure… | by Mikkel Dengsøe | May, 2022 | Medium
https://medium.com/@mikldd/how-to-measure-data-quality-cc3d81dd98be

5 ways to measure the ROI of Data & Analytics (The simple way) | by Santiago Tacoronte | Medium
https://santiagotacoronte.com/5-ways-to-measure-the-roi-of-data-analytics-the-simple-way-a61790eff7d1

Если вы рассматриваете варианты для замены западных вендоров - советую присмотреться к FineBI.

Чтобы получать оперативную информацию по продукту - подпишитесь на канал https://t.me/finebi_russia

#реклама

FlowingData
Graphics by Nathan Yau, borne out of everyday curiosities, learning experiments, and mild insomnia.
https://flowingdata.com/category/projects/

Интересный проект на тему Data Lineage

Generate and Visualize Data Lineage from query history
https://github.com/tokern/data-lineage