Machine Learning
39.9K subscribers
3.59K photos
28 videos
47 files
611 links
Real Machine Learning β€” simple, practical, and built on experience.
Learn step by step with clear explanations and working code.

Admin: @HusseinSheikho || @Hussein_Sheikho
Download Telegram
πŸ”– A huge open-source course on AI Engineering from scratch

In the repository, we've collected:
β€” 435 lessons;
β€” 320+ hours of content;
β€” Python, TypeScript, and Rust;
β€” AI agents, MCP servers, prompts, and AI skills.

Moreover, almost every lesson includes practical tasks, so this isn't just theory, but a full-fledged roadmap for AI Engineering. πŸš€

⛓️ Link to the repository
https://github.com/rohitg00/ai-engineering-from-scratch

#AI #MachineLearning #Python #Rust #OpenSource #Tech

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
❀6πŸ‘1
Transformer implementations for vision, audio, and AI agents πŸ€–πŸ‘οΈπŸŽ΅

Repo: https://github.com/Nicolepcx/transformers-the-definitive-guide

#AI #MachineLearning #Vision #Audio #Agents #Tech

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
❀3πŸ‘2
Data leakage is one of the main reasons why ML demos look impressive... and then fail in production. πŸ“‰

The model didn't become smarter.
It just happened to see the correct answers in advance.

In 4 minutes, you'll understand where data leaks hide. πŸ”

Let's break it down below: πŸ‘‡

1. Data Leakage πŸ•³οΈ

Data leakage occurs when information that won't be available at the time of actual prediction is used during the model training process.

Because of this, metrics on the validation stage can look much better than the actual quality of the model on new, previously unseen data.

2. Model Evaluation βš–οΈ

The test set isn't just "additional data".
It's a simulation of the future.

Only train the model on the information that would have been available to you at the time of prediction.
Evaluate it on examples that the model couldn't have influenced during training.

3. Direct Leakage 🚨

This is the most obvious type of leakage.

Examples:
- a field with information from the future;
- an ID that encodes the target variable;
- a variable that appears only after an event has occurred;
- duplicate records in both the training and test sets.

If a feature doesn't exist at the time of inference (prediction), then it's likely a source of data leakage.

4. Indirect Leakage πŸ•΅οΈ

This is the type of leakage that most often traps teams.

You perform normalization, imputation, feature selection, outlier removal, or dimensionality reduction before splitting the data into a training and test set.

The model didn't directly see the data from the test set.
But your preprocessing pipeline already saw it.

5. Train/Test Split βœ‚οΈ

Wrong:
fit the scaler on all data β†’ split the data β†’ evaluate

Right:
split the data β†’ fit the scaler only on the training set β†’ apply it to both the training and test sets

The same idea applies to imputers, encoders, feature selection, PCA, and any preprocessing step that is trained on the data.

6. Cross-Validation πŸ”„

Each fold is a mini-experiment with a training and test set.
Therefore, preprocessing should be performed within each fold.

If you prepared the entire dataset once and then ran cross-validation, each fold would already have had access to its held-out data.

7. Pipelines πŸ› οΈ

A pipeline isn't just a way to make the code cleaner.
It's also a defense against data leakage.

Combine preprocessing, feature selection, and the model into a single pipeline, and then pass this pipeline to cross-validation or hyperparameter search (grid search).

8. AI Engineering Version πŸ€–

Data leaks also occur in RAG systems and when evaluating LLMs.

Leakage occurs when you tune chunks, prompts, re-rankers, thresholds, or examples on the same evaluation dataset that you later present as "held-out".

As a result, your benchmark turns into training data.

9. Leakage Checklist βœ…

Before trusting the obtained metric, ask yourself:

- Could this feature exist at the time of prediction?
- Was any transformation (transform) step trained (fit) on the test data?
- Did cross-validation include the entire pipeline?
- Were we tuning parameters on the final evaluation dataset?

If the answer is "yes", then the metric likely doesn't reflect the actual quality of the model.

#MachineLearning #DataScience #MLOps #DataLeakage #ArtificialIntelligence #TechTips

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
❀4πŸ‘3
FREE MIT books on AI and Machine Learning: πŸ“šπŸ€–

1. Foundations of Machine Learning cs.nyu.edu/~mohri/mlbook/
2. Understanding Deep Learning udlbook.github.io/udlbook/
3. Introduction to Machine Learning Systems ❯ Vol 1: mlsysbook.ai/vol1/assets/do ❯ Vol 2: mlsysbook.ai/vol2/assets/do
4. Algorithms for ML algorithmsbook.com
5. Deep Learning deeplearningbook.org
6. Reinforcement Learning andrew.cmu.edu/course/10-703/
7. Distributional Reinforcement Learning direct.mit.edu/books/oa-monog
8. Multi Agent Reinforcement Learning marl-book.com
9. Agents in the Long Game of AI direct.mit.edu/books/oa-monog
10. Fairness and Machine Learning fairmlbook.org
11. Probabilistic Machine Learning
❯ Part 1 : probml.github.io/pml-book/book1
❯ Part 2 : probml.github.io/pml-book/book2

#MIT #AI #MachineLearning #DeepLearning #ReinforcementLearning #FreeBooks

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
❀6
Introduction to Deep RL and DQN

Link: https://www.dailydoseofds.com/rl-course-part-6/

πŸ€– #DeepRL #DQN #ReinforcementLearning #AI #MachineLearning #DataScience

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

πŸš€ Level up your AI & Data Science skills with HelloEncyclo β€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
βœ… 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
πŸ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
πŸ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
❀6
Optimizing the model's performance through Prompt Tuning with the PEFT library.

✨ Full-fledged fine-tuning of language models requires a huge amount of video memory and completely overwrites the network's weights. We will apply the Prompt Tuning method (retraining virtual token prompts), which freezes the main model and adjusts only a tiny matrix of virtual embeddings. This allows adapting AI to a narrow task using a regular user's graphics card and without the risk of destroying the neural network's basic knowledge.

πŸ“¦ First, we will install the necessary libraries for working with transformers and effective fine-tuning methods (PEFT).

pip install torch transformers peft

βœ… The packages have been successfully installed in the system and are ready for configuring lightweight training. We will create a basic Prompt Tuning configuration for training just twenty virtual tokens instead of billions of model parameters.

from peft import PromptTuningConfig, PromptTuningInit, get_peft_model
from transformers import AutoModelForCausalLM

peft_config = PromptTuningConfig(
task_type="CAUSAL_LM",
prompt_tuning_init=PromptTuningInit.TEXT,
num_virtual_tokens=20,
prompt_tuning_init_text="Classify the sentiment of this text:",
tokenizer_name_or_path="gpt2"
)

πŸ”„ The configuration is initialized and links the text prompt to the trainable virtual embeddings. We will wrap the base model in a PEFT container to freeze the main weights and leave only the new tokens available for gradient descent.

base_model = AutoModelForCausalLM.from_pretrained("gpt2")
peft_model = get_peft_model(base_model, peft_config)
peft_model.print_trainable_parameters()

πŸš€ The model is ready for training, and the percentage of active parameters will be displayed on the screen (usually less than 0.01%).

python3 -c "from peft import PromptTuningConfig; print('PEFT Setup: OK')"

πŸ“ Expected output: PEFT Setup: OK

pip uninstall peft -y

πŸ’‘ Prompt Tuning β€” an ideal choice when you need to train a model for many different customers or tasks simultaneously. Instead of gigabyte-sized copies of neural networks, you store only lightweight configuration files weighing a few kilobytes, dynamically substituting them at inference.

#PromptTuning #PEFT #AI #MachineLearning #DeepLearning #DataScience

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

πŸš€ Level up your AI & Data Science skills with HelloEncyclo β€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
βœ… 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
πŸ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
πŸ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
❀4
If you want to finally understand how neural networks actually learn, I recommend these notes from Stanford CS224N. 🧠

"Computing Neural Network Gradients" explains the calculation of gradients and backpropagation without black-box formulas. πŸ“‰

Inside:
β€’ Chain Rule
β€’ Computational Graphs
β€’ Vectorized derivatives
β€’ Efficient gradient calculation
β€’ Step-by-step examples with formula analysis

Many people use PyTorch or TensorFlow every day, but never understood what happens after calling .backward(). πŸ”₯

These notes just fill this gap. πŸ› οΈ

PDF:
https://web.stanford.edu/class/cs224n/readings/gradient-notes.pdf

#NeuralNetworks #DeepLearning #StanfordCS #Backpropagation #MachineLearning #AIResearch

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

πŸš€ Level up your AI & Data Science skills with HelloEncyclo β€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
βœ… 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
πŸ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
πŸ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
❀2
Data Science Interview Questions.pdf
1.4 MB
Data Science Interview Questions

πŸ’‘ Here is your curated list for Data Science interviews!

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

πŸš€ Level up your AI & Data Science skills with HelloEncyclo β€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
βœ… 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
πŸ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
πŸ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO

#DataScience #AI #MachineLearning #LLM #TechJobs #InterviewPrep
❀4
A new collection of free courses has been added:

πŸ”— https://github.com/dair-ai/ML-Course-Notes

Those studying ML through dozens of random tabs and unclosed playlists may find this repository useful for organizing their learning. πŸ“š

Machine Learning Course Notes is an open collection of notes on machine learning, NLP, and AI, compiled around full-fledged courses, not just individual videos. 🧠

What's inside:

β€’ Courses from the Machine Learning Specialization, MIT 6.S191, CMU Neural Nets for NLP, CS224N, CS25, and others
β€’ A table with lectures, descriptions, videos, notes, and authors
β€’ Links to the original lectures and accompanying notes
β€’ WIP markers for incomplete materials
β€’ Instructions for contributors on adding and improving notes

The idea was appreciated. πŸ‘

Instead of another collection of hundreds of links, a course map has been created where one can systematically go through the material without getting lost after a week of studying. πŸ—ΊοΈ

#MachineLearning #AI #DataScience #TechCommunity #LearningResources #OpenSource

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

πŸš€ Level up your AI & Data Science skills with HelloEncyclo β€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
βœ… 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
πŸ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
πŸ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
❀3
If you already have 200 open tabs with courses, articles, and GitHub repositories on ML, this repository might save the situation a bit. πŸ˜…

Awesome Machine Learning Resources is a huge collection of sub-collections on machine learning, deep learning, and AI. πŸ€–

Instead of endless Google searches, everything is organized into categories:

β€’ fundamentals of machine learning
β€’ neural networks and modern architectures
β€’ tasks and application areas
β€’ datasets
β€’ libraries and tools
β€’ fairness and AI ethics
β€’ production ML and MLOps

Each link has a short description, so you can quickly understand whether it's worth opening it or skipping it. πŸ“

I particularly liked that the authors mark abandoned collections with an icon if they haven't been updated in over a year. ⚠️

https://github.com/ZhiningLiu1998/awesome-machine-learning-resources

#MachineLearning #DeepLearning #AI #MLOps #DataScience #TechResources

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

πŸš€ Level up your AI & Data Science skills with HelloEncyclo β€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
βœ… 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
πŸ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
πŸ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
❀2
This media is not supported in your browser
VIEW IN TELEGRAM
Someone spent several months manually writing a 200-page guide on mathematics and the basics of machine learning. πŸ“˜

No marketing fluff or endless links between articles. Just an attempt to gather all the most important things in one place. 🎯

Inside:

β€’ neural networks: backpropagation, SGD, Adam, BatchNorm; βš™οΈ
β€’ classic ML: SVM, Gradient Boosting, K-Means, PCA; πŸ“Š
β€’ hardware for AI: Tensor Cores, Systolic Arrays, CUDA; πŸ–₯️
β€’ transformers: Multi-Head Attention, KV Cache, LoRA; 🧠
β€’ computer vision: ViT, CNN, MAE, IoU, NMS, VLM; πŸ‘οΈ
β€’ agent systems: ReAct, memory, orchestration, OpenClaw. πŸ€–

The author describes it as the material he would have wanted to receive himself several years ago. πŸ•°οΈ

And yes, the entire guide is distributed free of charge. πŸ†“

https://www.arjunvirk.com/writing/ml-guide

#MachineLearning #AI #DeepLearning #DataScience #NeuralNetworks #Tech

✨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk

⭐️ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

πŸš€ Level up your AI & Data Science skills with HelloEncyclo β€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
βœ… 13 courses live + 40+ coming soon
🎯 One access, lifetime updates
πŸ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
πŸ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
❀3