#data

Never tried dbt but it is definitely popular judging by the amount of people talking about.

I read these discussions on Reddit and I think it is worth sharing.

https://www.reddit.com/r/dataengineering/s/tphxT7p0kI

and

https://www.reddit.com/r/dataengineering/s/YpOXP3y6av

#ai

Scary and exciting at the same time

https://www.figure.ai/

#tool

I liked Fig a lot. It was mostly an install and forget extension. Now Amazon bought the company, and it is part of the infamous codewhisper.

Do you have an alternative for Fig? I don't like Warp because it implements a lot of distractions.

https://fig.io/

#stats

#TIL# I learned about this interesting concept called martingale.

> ... at a particular time, the conditional expectation of the next value in the sequence is equal to the present value, regardless of all prior values.

https://en.wikipedia.org/wiki/Martingale_(probability_theory)

#dl

This repo is really nice.

yuanchenyang/smalldiffusion: Simple and readable code for training and sampling from diffusion models
https://github.com/yuanchenyang/smalldiffusion

#funny

What is wrong with you guys. Neovim is just an editor.

Edit: oh this is probably just chatgpt.

https://www.reddit.com/r/neovim/s/mfq9lZuDsq

#misc

Bayer sold HIV contaminated blood products (while knowing that the products are contaminated) to Asia and LatAm and infected patients....

https://www.tandfonline.com/doi/full/10.1080/08989621.2014.882780

#tools

https://commitizen-tools.github.io/commitizen/

A friend showed me how to use this tool called commitizen to manage commits and releases.

It took me a while to realize that this is a great tool. I haven't exhausted all commands in it but I already feel its power.

I usually don't trust human beings because we all make mistakes. I trust processes because they can miminize all kinds of risks quite fast.
commitizen is a tool that sets up a process. With that, each individual can just follow through. Less manual decisions makes the release process more robust.

Highly recommended! Try it out.

#python

I had the wrong idea for a long time that IDEs treat method/function without return type hint as returning None type.
I was wrong. In PEP484, it says IDE should treat such a method/function as a type that is as general as possible. Ah that just makes sense.

https://peps.python.org/pep-0484/#the-meaning-of-annotations

#data

Interesting read

> we propose DATALORE, a framework that explains data changes between an initial dataset and its augmented version to improves traceability

https://www.amazon.science/publications/datalore-can-a-large-language-model-find-all-lost-scrolls-in-a-data-repository

#data

https://duckdb.org/2024/03/26/42-parquet-a-zip-bomb-for-the-big-data-age.html

#visualization

Some comments in this post are just so funny.

https://www.reddit.com/r/MapPorn/s/HsLvLGzLb6

There's a science fiction book declassified by CIA a while ago. The book is called The Adam and Eve Story by Chan Thomas.

It's a sci-fi story theory about how the world ended several times and how it will end again.

I started reading it and found it fascinating. This doesn't look like any kind of science fiction. It is more like a conspiracy theory by scientists.

The full uncensored book can be found here: https://archive.org/details/ChanThomasTheAdamAndEveStoryTheHistoryOfCataclysms1993FullUNCENSORED/page/n7/mode/2up

I learned about the book on Reddit:
https://www.reddit.com/r/conspiracy/s/MxEZ5n7Xfy

Edit: I finished the book. It's ... never mind. Doesn't worth the time.

#ai

https://www.pinecone.io/blog/hallucination-free-llm/

#misc

https://twitter.com/MikePFrank/status/1773073214551306369?t=92KwYEBHJwfXhCtSSEinaA&s=19

#misc

https://www.theguardian.com/science/2024/apr/09/peter-higgs-physicist-who-discovered-higgs-boson-dies-aged-94