doing something
@doing_something
713 subscribers
922 photos
36 videos
36 files
1.95K links
@smlkw doing something, just my notes to keep updates
Download Telegram
About
Blog
Apps
Platform
Join
doing something
713 subscribers
doing something
Forwarded from Feed-Master
This Week in Rust 567
58 views
doing something
doing something
https://colab.research.google.com/drive/1o9b2JQ8l9a39uOZZi9DWXQ15BXlCIfEu?usp=sharing 600M model with 4-bits uses about 1GB of VRAM #nlp #ai #hqq
HQQ can be applied to Florence-2 that has an LM at the final layers, as well

https://colab.research.google.com/drive/1G2W0Rxwv-eTe0MJ9aaUuHxLH5lnRc6o_?usp=sharing

In this colab it uses about 1.5 GB to initialize and ~4.5 GB after inference

#ai #cv
Google
Florence-2 + HQQ.ipynb
Colab notebook
219 viewsedited  
doing something
doing something
HQQ can be applied to Florence-2 that has an LM at the final layers, as well https://colab.research.google.com/drive/1G2W0Rxwv-eTe0MJ9aaUuHxLH5lnRc6o_?usp=sharing In this colab it uses about 1.5 GB to initialize and ~4.5 GB after inference #ai #cv
I've tested translation of the generated captions using quantized NLLB with longer max_len:

https://colab.research.google.com/drive/1HUgSfm-Y72-1ehorVwtIlzwzXPgrz6YY?usp=sharing

It uses 2 GB of VRAM

#ai #nlp
Google
Quantized NLLB using HQQ: many sentences.ipynb
Colab notebook
223 viewsedited  
doing something
https://github.com/Gelbpunkt/tokio-websockets

#rust
GitHub
GitHub - Gelbpunkt/tokio-websockets: High performance, strict, tokio-util based websockets implementation
High performance, strict, tokio-util based websockets implementation - Gelbpunkt/tokio-websockets
56 views
doing something
https://github.com/Gelbpunkt/zangy

#rust
GitHub
GitHub - Gelbpunkt/zangy: A fast redis library for python and asyncio written in Rust
A fast redis library for python and asyncio written in Rust - Gelbpunkt/zangy
69 views
doing something
https://github.com/psqlpy-python/psqlpy

#rust
GitHub
GitHub - psqlpy-python/psqlpy: Asynchronous Python PostgreSQL driver written in Rust
Asynchronous Python PostgreSQL driver written in Rust - psqlpy-python/psqlpy
71 views
doing something
#nlp #x
65 views
doing something
COTTENTION: LINEAR TRANSFORMERS WITH COSINE
ATTENTION

https://arxiv.org/pdf/2409.18747

#ai #attention
70 viewsedited  
doing something
Forwarded from Feed-Master
Regalloc III: A new register allocator for Rust's Cranelift back end
59 views
doing something
https://github.com/livekit/agents
GitHub
GitHub - livekit/agents: A framework for building realtime voice AI agents 🤖🎙️📹
A framework for building realtime voice AI agents 🤖🎙️📹 - livekit/agents
60 views
doing something
https://vnotes.pages.dev/fast-multi-arch-docker-for-rust/

In short:

- cargo-chef
- zigbuild
59 views
doing something
Forwarded from Feed-Master
Speeding up the Rust compiler without changing its code
Kobzol’s blog
Speeding up the Rust compiler without changing its code
…Yes, I know that the title looks like a clickbait. But it’s actually not that far from the truth :)
48 views
doing something
https://youtu.be/BzNzgsAE4F0?feature=shared

#audio
YouTube
Shepard Tone
The Shepard Tone is an audio illusion formed by overlaying separate tones separated by octaves that each rise/fall (depending on the nature of the Shepard Tone in question) and repeat independently of one another. As a result, in this case the sound seems…
54 views
doing something
Forwarded from Feed-Master
10x Your Jinja Templates With Mini Jinja
Substack
10x Your Jinja Templates With Mini Jinja
Today’s Issue: Cursed Rust, Safety Goggles for Alchemists, and Improved Turso Ergonomics in Rust
50 views
doing something
https://hpyproject.org/
HPy
HPy - A better C API for Python
What is HPy?
HPy provides a new API for extending Python in C. In other words, you use
#include <hpy.h> instead of #include <Python.h>.


What are the advantages of HPy?

Zero overhead on CPython: ex
49 views
doing something
https://github.com/huggingface/transformers/pull/29746/files

#ai
GitHub
Replace Decord with PyAV by statelesshz · Pull Request #29746 · huggingface/transformers
What does this PR do?
follow up #21572
same as #29747, closed this PR
Before submitting

This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
D...
53 views
doing something
Forwarded from Nazar Antoniuk
https://github.com/sger/RustBooks
54 views
doing something
https://github.com/dtolnay/ryu

#rust
GitHub
GitHub - dtolnay/ryu: Fast floating point to string conversion
Fast floating point to string conversion. Contribute to dtolnay/ryu development by creating an account on GitHub.
49 views
doing something
https://tweedegolf.nl/en/blog/137/rust-is-rolling-off-the-volvo-assembly-line

#rust
tweedegolf.nl
Rust is rolling off the Volvo assembly line - Blog - Tweede golf
In my job I get to speak to lots of people about Rust. Some are just starting out, some have barely ever heard of it, and then some people are running Rust silently in production at a very large c ...
52 viewsedited  
doing something
https://x.com/rohanpaul_ai/status/1842724991189864713?t=nCxAKl0N5tbMEX_P3phmeA&s=19

#ai #quantization
55 views
doing something
Phi 3.5 vision + HQQ (4-bits), weights are in bfloat16

vRAM usage decreased: 8.9 GB -> 3.8 GB

https://colab.research.google.com/drive/176YsmMtdy-o0g19HVUPx7gKZ4OQ2tdxl?usp=sharing

#ai #cv #quantization
Google
OCR images using Phi-3.5 vision + HQQ (default backend).ipynb
Colab notebook
329 viewsedited