doing something
712 subscribers
910 photos
36 videos
36 files
1.94K links
@smlkw doing something, just my notes to keep updates
Download Telegram
Let's cook, guys

#ai #speech
πŸ”₯1
Polars even helps to code

#ai #polars
❀2
πŸ‘1πŸ”₯1
Batch inference using vllm

#ai #vllm #speech
doing something
Batch inference using vllm #ai #vllm #speech
Added batch mode calculation to https://huggingface.co/spaces/Yehor/evaluate-asr-outputs

Btw, batched vllm inference gives better RTF for Whisper

#asr #ai #speech
GitHub Copilot already has new Sonnet models

#ai
vllm + A100 (40 GB in Google Colab) + https://huggingface.co/Yehor/whisper-large-v3-turbo-quantized-uk using batch_size=128

#ai #speech #whisper
πŸ”₯2