Do better science by watching the computer do it with you:

https://github.com/SakanaAI/AI-Scientist

https://x.com/hamelhusain/status/1824452022890119658?

Programming languages are not the problem, time to check your writing skills.

Cheng Lu and Yang Song have solved diffusion https://arxiv.org/abs/2410.11081

https://youtu.be/ZANbujPTvOY


This graduate level problem benchmark was solved by o1 in less than a year since the benchmark was released — it was supposed unsolvable by language models for a while

How to build AGI, Ukrainian book from 1979. Still relevant

https://scholar.google.com/citations?view_op=view_citation&hl=en&user=QkZlKBMAAAAJ&citation_for_view=QkZlKBMAAAAJ:CHSYGLWDkRkC

English version

https://archive.org/details/modelingofthinki0000amos/mode/2up

Sora Turbo is generally available now in Ukraine, https://x.com/model_mechanic/status/1866183714407141603?s=46&t=qNUYWfgTfF4u1RKfN0ir3A

Mechinterp on chain of thought circuits https://arxiv.org/abs/2406.02128

Pretraining is dead. I love you all.

https://youtu.be/1yvBqasHLZs

o1 excels at generating gpu kernels that are harder than level 1

Debug neural networks by casting them as neural fields https://github.com/neale/neural-canvas

ARC-AGI has been solved. Apply for safety testing of o3: https://openai.com/12-days/

Heatmap of additively smoothed log probabilities of character bigrams log p(target|source) in common voice uk 10.0. Every word is padded by spaces on each side.

що looks like a very popular word. ї is missing entirely! You can see vowels making up distinct columns and rows.

Plotting columns of the DFT basis with matplotlib looks very vibrant out of the box. A small enough ratio of the window size to the sampling rate allows for stripes to reveal underlying higher frequency filters at the back.

def dft(size=512, rate=16000, low=50):
    k = np.linspace(low, rate / 2, size, endpoint=False)
    t = np.arange(size) / rate
    return np.exp(-2j * np.pi * k[:, None] * t)

Marcus Hutter has provided a recipe to build an agent that provably solves any problem. He wrote a new book about it: https://x.com/mhutter42/status/1871426793380688255?s=46&t=qNUYWfgTfF4u1RKfN0ir3A

Why want high precision accumulation while doing low precision computations