Predicting discrete-time bifurcations with deep learning | Nature Communications
https://www.nature.com/articles/s41467-023-42020-z

Motif: Intrinsic Motivation from Artificial Intelligence Feedback https://arxiv.org/abs/2310.00166

Topological and geometric analysis of cell states in single-cell transcriptomic data

"Here, we aim to explore the usage of TGDA tools, specifically graph curvature and persistent homology, for stablishing structure-function relationships in scRNA-seq to predict cell properties from the underlying structures of the data."

The second law of infodynamics and its implications for the simulated universe hypothesis

Abstract:
The simulation hypothesis is a philosophical theory, in which the entire universe and our objective reality are just simulated constructs. Despite the lack of evidence, this idea is gaining traction in scientific circles as well as in the entertainment industry. Recent scientific developments in the field of information physics, such as the publication of the mass-energy-information equivalence principle, appear to support this possibility. In particular, the 2022 discovery of the second law of information dynamics (infodynamics) facilitates new and interesting research tools at the intersection between physics and information. In this article, we re-examine the second law of infodynamics and its applicability to digital information, genetic information, atomic physics, mathematical symmetries, and cosmology, and we provide scientific evidence that appears to underpin the simulated universe hypothesis.

https://pubs.aip.org/aip/adv/article/13/10/105308/2915332/The-second-law-of-infodynamics-and-its

An interesting frame regarding LLMs:

============
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates:

- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability to write & run programs
- Browser / internet access
- Embeddings database for files and internal memory storage & retrieval

A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from computer security carry over, with attacks, defenses and emerging vulnerabilities.

I also like the nearest neighbor analogy of "Operating System" because the industry is starting to shape up similar:
Windows, OS X, and Linux <-> GPT, PaLM, Claude, and Llama/Mistral(?:)).
An OS comes with default apps but has an app store.
Most apps can be adapted to multiple platforms.

TLDR looking at LLMs as chatbots is the same as looking at early computers as calculators. We're seeing an emergence of a whole new computing paradigm, and it is very early.

https://twitter.com/karpathy/status/1707437820045062561?t=d52fO-NpyyzCOid84cozMg&s=19

4D Gaussian Splatting for Real-Time Dynamic Scene Rendering

Huazhong University of Science and Technology разом з Huawei Inc. опублікували код та статтю до свого методу 4D-GS (Gaussian Splatting), який перетворює звичайне відео у 3D відео (~30 FPS).

☑️ Google Colab.
☑️ Більше про Gaussian Splatting тут.

@eiaioi

https://arxiv.org/pdf/2310.02207v1.pdf

Language models represent space and time