The prices seem very reasonable

TransformerRanker is a library that quickly finds the best-suited language model for a given NLP classification task.

All you need to do is to select a dataset and a list of pre-trained language models (LMs) from the 🤗 HuggingFace Hub. TransformerRanker will quickly estimate which of these LMs will perform best on the given task!

https://github.com/flairNLP/transformer-ranker

Check out our paper that uses proverbs to evaluate LLMs. We saw a few things that could be further studied. Even though we didn't find it first, still order of choice matters a lot of other things.

https://arxiv.org/abs/2411.05049

The Zeno's Paradox of "Low - Resource" Languages.

A cool paper by some friends has won Outstanding Paper Word at EMNLP 2025.

Paper

Tweet

I'm thinking of renaming this channel so that I can write anything but not limited to AI only.

Maybe, I'll add my name to it, what do you guys think?

Henok | Neural Nets

I hate LinkedIn so much, I didn't even apply but this show up in my notifications, what does this mean?

Story of My Recent Days

I was working with a very large csv data, and i want to merge 4 very large csv files based on one col and pandas wasn't able to handle it so i decided to change my approach and process the files separately.

The thing is there is 2 tasks that have to be done on it

1. Process it and add to DB based on all the files [CPU Bound]
2. Download file and upload it to S3 and update the column with the S3 link [IO Bound]

So the first task is really fast since it all depends on the CPU i kinda get a good speed optimization already but the second task is taking more than one day to finish. Here is the bummer the task have to run every day 😂 and it is taking more than a day to complete the task.

But i come up with the solution to use multiple machine and separate out the task to handle the IO bound tasks like downloading and uploading file.

When i say downloading file i am talking about millions of files don't ask me why the bottom line is i have to download it and upload it to S3.

Anyways I just separate out processing of the files to multiple files and i am using asyncio to its peak and not to get blocked by the websites too.

Now it is gonna cut down to half the time to process the files and i am happy with it.

Moral of the story is if you are dealing with IO Bound Task may be try multiple machine to handle it.

I have got couple of more stories to share but too lazy to write it down 😂.

Painful but true

Look at this beast, H100 🔥

AI by Highschool students.


Neurips in like the top AI/ML conference in the world. This year they introduced high school track. Now their projects are released.

I mean I started doing some basic ML stuff in high school but making projects for Neurips is light years ahead. High schoolers are doing these so what's your excuse now.


Read more about the winning projects, most did real applications of some vision tasks etc.

https://blog.neurips.cc/2024/11/18/announcing-the-neurips-high-school-projects-results/

My experience with PrimeIntellect

They offer great GPUs, including H100s (no H200 yet), and providers like Lambda Cloud, RunPod, and Hyperstack, with AWS, Oracle, and Azure coming soon.

Pricing is better than Azure ML or Colab Pro+, and setting up images (my favorite PyTorch+Cuda and Ubuntu) is hassle-free. You get an SSH key to start quickly, though spin time can be ~10 mins🥶.

The best thing is that they got multi-node H100 cluster. You can set up16 H100 GPUs, ~$40/hr and run inference to Llama 405B, though it’s bit expensive . Jupyter Notebooks are supported, but real devs don't use notebooks 😁.

So far, I’ve done 20+ hrs on H100 and A100 single clusters with VS Code, and it’s been great. Adding default VS Code setups and better metrics control would make it even better.

Thanks @DagmawiBabi for the suggestion!

Applications are now open for the Kifiya AI Mastery Training Program!

This fully funded, part-time, 3-month online program is for Ethiopian residents aspiring to excel as AI Engineers in fintech. Gain skills in Machine Learning, Data Engineering, and Generative AI while working on real-world projects led by experts.

Eligibility:

✅ Ethiopian residents (22-34 years)
✅ Bachelor’s degree holders
✅ Skilled in Python, SQL & Statistics
✅ Encouraged: women, People with disabilities, & vulnerable groups

🗓 Deadline: December 3, 2024

This program is delivered by Kifiya Financial Technologies PLC and powered by 10 Academy.

Don’t miss this chance to build your fintech AI future! Apply now: https://apply.10academy.org/

The way I'm handling the በግs these days can make me a good Shepherd.