Muon is an optimizer for hidden layers in neural networks - KellerJordan/Muon

Voice user interfaces (VUIs) have facilitated the efficient interactions between humans and machines through spoken commands. Since real-word acoustic scenes are complex, speech enhancement plays...

Colab notebook

Overview
The Transformer model has demonstrated success across a wide range of domains, including in Multi-Agent Reinforcement Learning (MARL) where the Multi-Agent Transformer (MAT) has emerged as a leading algorithm in the field. However, a significant…

Mamba is a new neural network architecture that came out this year, and it performs better than transformers at language modelling! This is probably the most exciting development in AI since 2017. In this video I explain how to derive Mamba from the perspective…

Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero. - neondatabase/neon

There are many Rust books, but these are my favourites—and I think you’ll like them too. Here are my reviews of what I think are the truly essential Rust books available today.

We've increased the size of our NVIDIA A100 fleet for paid users by around 2x, and for the last several days we've seen 100% success rate for users requesting A100s.

A guide to using uv with PyTorch, including installing PyTorch, configuring per-platform and per-accelerator builds, and installing GPU-enabled PyTorch extensions.

All-in-one platform for search, recommendations, RAG, and analytics offered via API - devflowinc/trieve

We are thrilled to unveil the preview release of Sail 0.2, which introduces support for distributed processing on Kubernetes. A detailed architectural deep dive and an overview of our increased support for Spark.

Discover more about what's new at AWS with Amazon S3 Express One Zone now supports the ability to append data to an object

What's Changed

Fix upload pypi and github release by @auxten in #278
Update PyPi info by @auxten in #279
Add citation just like ClickHouse, as chDB is mentioned in ClickHouse Paper by @auxten ...

Highlights

Support 3 and 6 bit quantization: benchmarks
Much faster memory efficient attention for headdim 64, 80: benchmarks
Much faster sdpa inference kernel for longer sequences: benchmarks

Co...

Release Notes
Check out the blog post for a migration guide and overview of the changes!
Breaking changes
See also, the "Remapped rules" section which may result in disabled rules.


Defa...