Highlights

Support 3 and 6 bit quantization: benchmarks
Much faster memory efficient attention for headdim 64, 80: benchmarks
Much faster sdpa inference kernel for longer sequences: benchmarks

Co...

Release Notes
Check out the blog post for a migration guide and overview of the changes!
Breaking changes
See also, the "Remapped rules" section which may result in disabled rules.


Defa...

A dead simple Go library for sending notifications to various messaging services. - nikoksr/notify

In Paraformer-v2, an improved version of Paraformer, a CTC module is used to extract the token embeddings, as the alternative to the continuous integrate-and-fire module in Paraformer, for fast, accurate, and noise-robust non-autoregressive speech recognition.…

Alpha 2? But Alpha 1 only just came out! https://www.python.org/downloads/release/python-3140a2/ This is an early developer preview of Pyt...

An Open Source implementation of Notebook LM with more flexibility and features - lfnovo/open-notebook

The Model Context Protocol (MCP) is an open standard for connecting AI assistants to the systems where data lives, including content repositories, business tools, and development environments. Its aim is to help frontier models produce better, more relevant…

Rust library for generating vector embeddings and reranking locally! - Anush008/fastembed-rs

In the two years since I've posted I want off Mr Golang's Wild Ride, it's made the rounds time and time again, on Reddit, on Lobste.rs, on HackerNews, and elsewhere. And every time, it elicits the ...

Rust has taken off with popularity driven largely by big tech companies and the solutions used ...