doing something
713 subscribers
911 photos
36 videos
36 files
1.94K links
@smlkw doing something, just my notes to keep updates
Download Telegram
Peremoha
👏4🔥2🥴1
Product crafting...

The full day of modernizing the code base

Looked at the number of issues closed, in total more than 1k commits in both repos

#product
ML engineering and pain...
❤3😢2
Useful thing in uv:


UV_TORCH_BACKEND=auto uv pip install torch


#python
Seems like I need to test Robyn again

This feature is support useful when I do APIs with FastAPI

But using Rust-powered Python web framework looks pretty tempting

#python #rust
❤1
doing something
MamayLM-Gemma-2-9B-IT-v0.1: - transformers: https://colab.research.google.com/drive/1XAECWGFyMsgYeidF7XhHW7U-_LsdQSkB?usp=sharing - vllm: https://colab.research.google.com/drive/1QC-qfesfRrOXJlJmkO0bGj9EwHfg8uSQ?usp=sharing - llama-cpp: https://colab.r…
Made a colab to show how we can use MamayLM with GLiNER model to solve the PII detection task for Ukrainian.

In test cases, only one sample GLiNER could not successfully recognize, but after English translation - it does.

So, the algorithm is simple:

- Translate Ukrainian sentence to English
- Load GLiNER model that is zero-shot NER model
- Pass translated sentences and detect PII entities

Instead of MamayLM, we can use MADLAD models or other NMT models.

Colab: https://colab.research.google.com/drive/1P3jBiixz0Mv31NF6cc6K3wG5HtOW_eL9?usp=sharing

#ai #pii #nlp #security
🔥3
Forwarded from Ihor Stepanov
You can reduce the translation step right now thanks to this: https://huggingface.co/knowledgator/gliner-x-large-v0.5