Data1984

Netflix shared it's first Data engineering summit 2023 talks.

Our First Netflix Data Engineering Summit

Holden Karau Elizabeth Stone Pedro Duarte Chris Stephens Pallavi Phadnis Lee Woodridge Mark Cho Guil Pires Sujay Jain Tristan Reid…

👍3

786 viewsedited 07:08

Data1984

Nice to see new BI-as-Code tools.

YouTube

The future of BI: Exploring the impact of BI-as-code tools with DuckDB

In this video @mehdio dives into 3 BI-as-code tools (Evidence, Rill, Streamlit) to create beautiful dashboards with DuckDB!

📓 Resources
* Github Repo of the tutorial : https://github.com/mehd-io/duckdb-dataviz-demo
* DuckDB's getting started video : h…

👍2

793 views15:07

Data1984

This use-case puts Apache Doris into perspective. I don't know many alternatives to Clickhouse as open-source data warehouse but it looks like Doris is one of them.

Medium

Apache Doris speeds up data reporting, tagging, and data lake analytics

As much as we say Apache Doris is an all-in-one data platform that is capable of various analytics workloads, it is always compelling to…

👍3🤔1

722 views09:33

Data1984

This use-case puts Apache Doris into perspective. I don't know many alternatives to Clickhouse as open-source data warehouse but it looks like Doris is one of them.

If you want to learn more about this project here is a review.

DZone

Introduction to Apache Doris: A Next-Generation Real-Time Data Warehouse

This is a technical overview of Apache Doris, introducing how it enables fast query performance with its architectural design, features, and mechanisms.

❤1

918 views09:54

Data1984

https://github.com/DataEngineer-io/data-engineer-handbook

GitHub

GitHub - DataExpert-io/data-engineer-handbook: This is a repo with links to everything you'd ever want to learn about data engineering

This is a repo with links to everything you'd ever want to learn about data engineering - DataExpert-io/data-engineer-handbook

👍1

1.04K views19:03

Data1984

https://www.datanami.com/2024/01/23/data-engineering-in-2024-predictions-for-data-lakes-and-the-serving-layer/

Datanami

Data Engineering in 2024: Predictions For Data Lakes and The Serving Layer

The data landscape experienced significant changes in 2023, presenting new opportunities (and potential challenges) for data engineering teams. I believe

862 views15:55

Data1984

https://dataengineeringcentral.substack.com/p/kubernetes-for-data-engineers

Substack

Kubernetes for Data Engineers

The Age of Containers

669 views15:33

Data1984

https://lakefs.io/blog/12-vector-databases-2023/

lakeFS

Best 17 Vector Databases for 2025 [Top Picks]

Explore the best 17 vector databases for 2025. Read an in-depth review outlining each database's key features & problems it tackles.

👍1

772 views15:40

Data1984

https://github.com/Eventual-Inc/Daft

GitHub

GitHub - Eventual-Inc/Daft: High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured…

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale - Eventual-Inc/Daft

👍2

771 views13:59

Data1984

https://blog.bytebytego.com/p/a-deep-dive-into-amazon-dynamodb

Bytebytego

A Deep Dive into Amazon DynamoDB Architecture

State of Observability for Financial Services and Insurance (Sponsored) Financial institutions are experiencing an incredible transformation, stemming from consumers expecting a higher level of digital interaction and access to services and a lower dependency…

721 viewsedited 16:52

Data1984

Arroyo is an open-source stream processing engine, enabling users to transform, filter, aggregate, and join their data streams in real-time with SQL queries. It's designed to be easy enough for any SQL user to build correct, reliable, and scalable streaming pipelines.
https://www.arroyo.dev/blog/why-arrow-and-datafusion

www.arroyo.dev

We built a new SQL Engine on Arrow and DataFusion

Arroyo 0.10 has an entirely new SQL engine built with Apache Arrow and DataFusion. It's much faster, smaller, and easier to run. Read on for why and how we're making this change.

❤1

734 viewsedited 18:10

Data1984

Devin, the first AI software engineer 🤯

X (formerly Twitter)

Cognition (@cognition) on X

Today we're excited to introduce Devin, the first AI software engineer.

Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs…

766 viewsedited 18:28

Data1984

Interesting projects from Microsoft for building LLM applications:
- AICI: Prompts as (Wasm) Programs
- AutoGen: A programming framework for agentic AI
- Semantic Kernel: Integrate cutting-edge LLM technology quickly and easily into your apps

GitHub

GitHub - microsoft/aici: AICI: Prompts as (Wasm) Programs

AICI: Prompts as (Wasm) Programs. Contribute to microsoft/aici development by creating an account on GitHub.

👍1

890 viewsedited 19:01

Data1984

TaskWeaver: A code-first agent framework for seamlessly planning and executing data analytics tasks.

GitHub

GitHub - microsoft/TaskWeaver: A code-first agent framework for seamlessly planning and executing data analytics tasks.

A code-first agent framework for seamlessly planning and executing data analytics tasks. - GitHub - microsoft/TaskWeaver: A code-first agent framework for seamlessly planning and executing data an...

853 views08:22

Data1984