This post’s goal is to continue engaging data engineering teams to automate their ETLs. Coding Step-by-Step guide.

Key data predictions from industry experts and vendors to help enterprises drive growth with operational efficiency in 2023.

Managing an enterprise data catalog manually is error-prone and time-consuming. These 20 popular tools can help your team maintain consistent data definitions.

Everything you need to know about choosing a complete data governance solution.

DataOps observability startup Chaos Genius is looking to expand after closing on a $3.3 million seed funding round led by Elevation Capital.Y Combinator also participated in the round, together w

Article description

Metadata, Statistics on Row Groups, Partitions discovery, and Repartitioning

Devices are everywhere. Smartphones, refrigerators, doorbells, watches, medical sensors, security systems, and fitness trackers, to name a few, are now commonplace and constantly recording (potentially high-frequency) information. These devices form a network…

Migrating to the Data Cloud, you have to be selective about what you keep and what needs to go. That’s where a data

Some data structures which are used in tools used in the field of Data Engineering

Startup pgEdge, with a fully distributed database for use in the cloud and at the network edge, emerged from stealth with $9M in seed funding.

How many Data Analysts are in US? More than 93,471. Learn more about 2025 demographics based on factors such as age, race, sex, salary and location.

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, Du...

We’re excited to announce the release of the pg_tiktoken extension on Neon. This new Postgres extension provides fast and efficient tokenization using the BPE (Byte Pair Encoding) algorithm. pg_tiktoken is a wrapper around OpenAI’s tokenizer, known for its…

Fivetran...is DEAD!

This year, Snowflake will (allegedly) announce native support for Fivetran's highest revenue connectors.

Fivetran has 1000+ employees. What are 80% of these people doing all day long?

Jeff Richman lays out a good overview here.

ht…

We all heard a mantra saying “each microservice should have its own database” but is this always true? What about a situation when we split one business domain (bounded context) into several microservices because of some technical reasons. Does this statement…

Two years ago, Snowflake versus ClickHouse was a straightforward comparison. Back then, Snowflake was fully managed, expensive, and broadly featured…