doing something
At least, it works somehow Quantized it using https://pypi.org/project/llmcompressor/ Data used for calibration: https://huggingface.co/datasets/Yehor/cv10-uk-testset-clean-punctuated Quantized model: https://huggingface.co/Yehor/whisper-large-v2-quantized…
But I couldn't run it on L4, it needs about 25 GB of RAM to init
https://javascript-conference.com/progressive-web-apps/optimizing-prime-video-with-webassembly-and-rust/
#rust
#rust
International JavaScript Conference
Optimizing Prime Video with WebAssembly and Rust - International JavaScript Conference
Prime Video delivers content to millions of customers, all over the world, on a variety of devices such as: game consoles, set-top boxes, streaming sticks, and Smart TVs. These devices have a vast range of hardware capabilities and performance characteristics.…
doing something
At least, it works somehow Quantized it using https://pypi.org/project/llmcompressor/ Data used for calibration: https://huggingface.co/datasets/Yehor/cv10-uk-testset-clean-punctuated Quantized model: https://huggingface.co/Yehor/whisper-large-v2-quantized…
Some tweaks helped, now it uses 3.4 GB of GPU, but spikes when vllm starts here - about 26.5 GB
Decrease
Decrease
gpu_memory_utilization parameter to get lower GPU usage
doing something
At least, it works somehow Quantized it using https://pypi.org/project/llmcompressor/ Data used for calibration: https://huggingface.co/datasets/Yehor/cv10-uk-testset-clean-punctuated Quantized model: https://huggingface.co/Yehor/whisper-large-v2-quantized…
How to quantize:
https://colab.research.google.com/drive/1TsCMxwq9kqsWV8jabihFN7J78RKgyvnD?usp=sharing
How to inference:
https://colab.research.google.com/drive/1fd6orSZqisnvjMm3Via6CdU247I5JbKo?usp=sharing
#ai #speech #whisper
https://colab.research.google.com/drive/1TsCMxwq9kqsWV8jabihFN7J78RKgyvnD?usp=sharing
How to inference:
https://colab.research.google.com/drive/1fd6orSZqisnvjMm3Via6CdU247I5JbKo?usp=sharing
#ai #speech #whisper
Google
LLM Compressor for Whisper Large V2: Calibrate the model on Yehor/cv10-uk-testset-clean-punctuated dataset.ipynb
Colab notebook
Forwarded from Hacker News
Terence Eden’s Blog
Why are QR Codes with capital letters smaller than QR codes with lower-case letters?
Take a look at these two QR codes. Scan them if you like, I promise there's nothing dodgy in them. Left is upper-case HTTPS://EDENT.TEL/ and right is lower-case https://edent.tel/ You can clearly see that the one on the left is a "smaller" QR as it has…
doing something
Published Open Source Crimean Tatar Text-to-Speech dataset to Hugging Face: https://huggingface.co/datasets/Yehor/qirimtatar-tts #ai #speech
Now, it's in different datsets to make it more useful (with train/test splits):
- https://huggingface.co/datasets/speech-uk/qirimtatar-abibullah-tts
- https://huggingface.co/datasets/speech-uk/qirimtatar-sevil-tts
- https://huggingface.co/datasets/speech-uk/qirimtatar-arslan-tts
#ai #speech
- https://huggingface.co/datasets/speech-uk/qirimtatar-abibullah-tts
- https://huggingface.co/datasets/speech-uk/qirimtatar-sevil-tts
- https://huggingface.co/datasets/speech-uk/qirimtatar-arslan-tts
#ai #speech
huggingface.co
speech-uk/tts-crh-abibullah · Datasets at Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
👍1
Ukrainian voices for Text-to-Speech now in separated datasets:
https://huggingface.co/collections/speech-uk/ukrainian-text-to-speech-67bd059d61b2598f3a2a7969
#ai #speech
https://huggingface.co/collections/speech-uk/ukrainian-text-to-speech-67bd059d61b2598f3a2a7969
#ai #speech
huggingface.co
Ukrainian Text-to-Speech datasets - a speech-uk Collection
Five voices: Mykyta, Oleksa, Lada, Kateryna or Tetiana
🔥2
Added a section with phonemizers to https://github.com/egorsmkv/speech-recognition-uk
https://github.com/egorsmkv/speech-recognition-uk/issues/57
#ai #speech
https://github.com/egorsmkv/speech-recognition-uk/issues/57
#ai #speech
GitHub
GitHub - egorsmkv/speech-recognition-uk: 🇺🇦 Speech Recognition & Synthesis for Ukrainian
🇺🇦 Speech Recognition & Synthesis for Ukrainian. Contribute to egorsmkv/speech-recognition-uk development by creating an account on GitHub.