doing something
713 subscribers
912 photos
36 videos
36 files
1.94K links
@smlkw doing something, just my notes to keep updates
Download Telegram
doing something
bs=24, whisper large-v3 https://github.com/egorsmkv/optimized-whisper #ai #asr
Tested a new Turbo model with HQQ, below an example how a ~2 hour audio is recognized
doing something
arestovich_ukrainian.txt
turbo_arestovich_ukrainian.txt
159.7 KB
- All Duration: 6465.6441
- All RTF: 0.003
- All elapsed: 19.2815
doing something
turbo_arestovich_ukrainian.txt
v3-arestovich.txt
153.1 KB
This test was on a 3090 card, so this file is also tested on the same hardware and software

RTF:

- V3: 0.0103
- V3 turbo: 0.003
doing something
decord can lag (it does not get the batch of frames) on GPU device if they have high values
This story has ended with a script that uses StreamReader from torchaudio.

I'm using the seek method to skip unrelated frames.

One important thing is that you need compiled ffmpeg with CUDA to do appropriate decoding.
An idea for a weekend project:

Adapt https://github.com/Gadersd/whisper-burn to the recently publish Whisper Turbo model.

Need to make only two things:

- update the repo to latest burn 🔥 version
- get down the number of decoder layers

#ai #asr
Finally we can cut texts from memes to make other ones

https://huggingface.co/spaces/OzzyGT/diffusers-image-fill

#ai #genai