my data engineering study

Practice SQL Interview Questions & Data Science Interview Questions asked by FAANG. Made by Nick Singh, Best-Selling Author of Ace the Data Science Interview.

95 views20:02

Forwarded from Engineer Readings

[article]
https://blog.twitter.com/engineering/en_us/topics/infrastructure/2015/building-distributedlog-twitter-s-high-performance-replicated-log-servic

Building DistributedLog: High-performance replicated log service

98 views15:31

my data engineering study

https://rethink.synadia.com/episodes/7/

Synadia

Rethink Connectivity - Synadia

A regular screencast series all about NATS.io

101 views18:44

my data engineering study

Forwarded from iggisv9t channel

Ещё успел завести и немного потыкать вот эту штуку https://github.com/flekschas/jupyter-scatter
Сразу некоторое разочарование, что нет ховеров и нельзя экспортировать выделение куда-то вне виджета. Пока потенциал этой штуки не раскрыл. Потом посмотрим. Теперь в планах соединить графовые и текстовые признаки, доделать кластеризацию и какую-то интерпретацию кластеров. Потом уже можно будет снова качать данные и обновлять выводы.

GitHub

GitHub - flekschas/jupyter-scatter: Interactive 2D scatter plot widget for Jupyter Lab and Notebook. Scales to millions of points!

Interactive 2D scatter plot widget for Jupyter Lab and Notebook. Scales to millions of points! - flekschas/jupyter-scatter

114 views03:39

my data engineering study

All of NoSQL is because of this… | Max De Marzi
https://maxdemarzi.com/2023/02/27/ragedb-needs-worst-case-optimal-joins/

Max De Marzi

All of NoSQL is because of this…

All of NoSQL is due to the Join Problem. Learn how new join algorithms are finally fixing it.

117 views02:02

my data engineering study

Building a large scale unsupervised model anomaly detection system — Part 1 | by Anindya Saha | Apr, 2023 | Lyft Engineering
https://eng.lyft.com/building-a-large-scale-unsupervised-model-anomaly-detection-system-part-1-aca4766a823c

Medium

Building a large scale unsupervised model anomaly detection system — Part 1

Distributed Profiling of Model Inference Logs

131 views09:50

my data engineering study

Hands-on with Apache Iceberg on Your Laptop: Deep Dive with Apache Spark, Nessie, Minio, Dremio, Polars and Seaborn | by Alex Merced | Data, Analytics & AI with Dremio | Sep, 2024 | Medium
https://medium.com/data-engineering-with-dremio/hands-on-with-apache-iceberg-on-your-laptop-deep-dive-with-apache-spark-nessie-minio-dremio-c5d689b01730

Medium

Hands-on with Apache Iceberg on Your Laptop: Deep Dive with Apache Spark, Nessie, Minio, Dremio…

Free Copy of Apache Iceberg: The Definitive Guide

76 views06:44

my data engineering study

https://github.com/IBM/data-prep-kit

GitHub

GitHub - data-prep-kit/data-prep-kit: Open source project for data preparation for GenAI applications

Open source project for data preparation for GenAI applications - data-prep-kit/data-prep-kit

50 views10:51

my data engineering study

Forwarded from 🔋 Труба данных (Simon Osipov)

https://github.com/sinaptik-ai/pandas-ai

Удивительная вещь, которая прошла мимо меня (а существует аж с апреля 2023 года)

Pandas + LLM + BI в одной опенсорс коробке, главное датасет отдай нормальный!🙂

@ohmydataengineer - канал "🕯Труба Данных" немного меньше недолюбливает Pandas

Please open Telegram to view this post

VIEW IN TELEGRAM

Please open Telegram to view this post

VIEW IN TELEGRAM

49 views17:23

my data engineering study

https://github.com/MaxHastings/Kolo

GitHub

GitHub - MaxHastings/Kolo: The Fastest Way to Fine-Tune LLMs Locally

The Fastest Way to Fine-Tune LLMs Locally. Contribute to MaxHastings/Kolo development by creating an account on GitHub.

49 views06:18

my data engineering study