Forwarded from Data Analytics
Transformers & LLMs Cheatsheet.pdf
1.4 MB
The only LLM cheat sheet you'll ever need π
Covers the main concepts, architectures, and practical applications.
### Basics
- Tokens (tokenization, BPE)
- Embeddings (cosine similarity)
- Attention mechanism (Attention formula, Multi-Head Attention)
### Transformer architecture and its variants
- BERT (models with only an encoder)
- GPT (models with only a decoder)
- T5 (models with an encoder and a decoder)
### Large language models (LLMs)
- Prompting (context length, Chain-of-Thought)
- Pre-training (SFT, PEFT/LoRA)
- Preference tuning (Reward Model, Reinforcement Learning)
- Optimizations (Mixture of Experts, Distillation, Quantization)
### Applications
- LLM-as-a-Judge (LaaJ)
- RAG (Retrieval-Augmented Generation)
- Agents (ReAct)
- Reasoning models (Scaling)
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
#LLM #AI #MachineLearning #DeepLearning #PromptEngineering #Tech
Covers the main concepts, architectures, and practical applications.
### Basics
- Tokens (tokenization, BPE)
- Embeddings (cosine similarity)
- Attention mechanism (Attention formula, Multi-Head Attention)
### Transformer architecture and its variants
- BERT (models with only an encoder)
- GPT (models with only a decoder)
- T5 (models with an encoder and a decoder)
### Large language models (LLMs)
- Prompting (context length, Chain-of-Thought)
- Pre-training (SFT, PEFT/LoRA)
- Preference tuning (Reward Model, Reinforcement Learning)
- Optimizations (Mixture of Experts, Distillation, Quantization)
### Applications
- LLM-as-a-Judge (LaaJ)
- RAG (Retrieval-Augmented Generation)
- Agents (ReAct)
- Reasoning models (Scaling)
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
#LLM #AI #MachineLearning #DeepLearning #PromptEngineering #Tech
β€6π1
5 Fun Papers That Explain LLMs Clearly πβ¨
Want to understand LLMs better? Start with these five foundational papers that explain how they work. π€
Large language models (LLMs) can feel complicated at first. There are transformers, attention layers, scaling laws, pretraining, instruction tuning, human feedback, retrieval, and many other ideas around them. π§ But the best way to understand large language models is not to start with a huge textbook. A better way is to read a few important papers that each explain one major part of the system. π This article is part of a fun series where we learn by exploring core ideas, practical projects, and the research papers behind modern technology. π¬ In this article, we will go through five papers that explain how LLMs work. So, let's get started. π
More: https://www.kdnuggets.com/5-fun-papers-that-explain-llms-clearly
#LLM #AI #MachineLearning #DeepLearning #DataScience #Tech
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
Want to understand LLMs better? Start with these five foundational papers that explain how they work. π€
Large language models (LLMs) can feel complicated at first. There are transformers, attention layers, scaling laws, pretraining, instruction tuning, human feedback, retrieval, and many other ideas around them. π§ But the best way to understand large language models is not to start with a huge textbook. A better way is to read a few important papers that each explain one major part of the system. π This article is part of a fun series where we learn by exploring core ideas, practical projects, and the research papers behind modern technology. π¬ In this article, we will go through five papers that explain how LLMs work. So, let's get started. π
More: https://www.kdnuggets.com/5-fun-papers-that-explain-llms-clearly
#LLM #AI #MachineLearning #DeepLearning #DataScience #Tech
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
β€4
Forwarded from Machine Learning
If you already have 200 open tabs with courses, articles, and GitHub repositories on ML, this repository might save the situation a bit. π
Awesome Machine Learning Resources is a huge collection of sub-collections on machine learning, deep learning, and AI. π€
Instead of endless Google searches, everything is organized into categories:
β’ fundamentals of machine learning
β’ neural networks and modern architectures
β’ tasks and application areas
β’ datasets
β’ libraries and tools
β’ fairness and AI ethics
β’ production ML and MLOps
Each link has a short description, so you can quickly understand whether it's worth opening it or skipping it. π
I particularly liked that the authors mark abandoned collections with an icon if they haven't been updated in over a year. β οΈ
https://github.com/ZhiningLiu1998/awesome-machine-learning-resources
#MachineLearning #DeepLearning #AI #MLOps #DataScience #TechResources
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
Awesome Machine Learning Resources is a huge collection of sub-collections on machine learning, deep learning, and AI. π€
Instead of endless Google searches, everything is organized into categories:
β’ fundamentals of machine learning
β’ neural networks and modern architectures
β’ tasks and application areas
β’ datasets
β’ libraries and tools
β’ fairness and AI ethics
β’ production ML and MLOps
Each link has a short description, so you can quickly understand whether it's worth opening it or skipping it. π
I particularly liked that the authors mark abandoned collections with an icon if they haven't been updated in over a year. β οΈ
https://github.com/ZhiningLiu1998/awesome-machine-learning-resources
#MachineLearning #DeepLearning #AI #MLOps #DataScience #TechResources
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
β€8
π A Free AI Course for Beginners by Microsoft
For those just getting into artificial intelligence, Microsoft offers a free course.
It runs for 12 weeks and includes 24 lessons with theory, hands-on assignments, labs, and quizzes.
The curriculum covers neural networks and deep learning, computer vision, natural language processing, genetic algorithms, and AI ethics. For practice, it uses the two main ML frameworksβTensorFlow and PyTorch.
Each lesson follows the same structure: first, reading material, then a Jupyter notebook with code, and for some topics, a lab. The course is in English but has been translated into dozens of languages.
β‘οΈ All materials and links are on GitHub
https://github.com/microsoft/AI-For-Beginners/blob/main/translations/ru/README.md
What's your AI level right now?
β€οΈ β Advanced user
π₯ β Almost zero
#AICourse #Microsoft #DeepLearning #TensorFlow #PyTorch #MachineLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
For those just getting into artificial intelligence, Microsoft offers a free course.
It runs for 12 weeks and includes 24 lessons with theory, hands-on assignments, labs, and quizzes.
The curriculum covers neural networks and deep learning, computer vision, natural language processing, genetic algorithms, and AI ethics. For practice, it uses the two main ML frameworksβTensorFlow and PyTorch.
Each lesson follows the same structure: first, reading material, then a Jupyter notebook with code, and for some topics, a lab. The course is in English but has been translated into dozens of languages.
β‘οΈ All materials and links are on GitHub
https://github.com/microsoft/AI-For-Beginners/blob/main/translations/ru/README.md
What's your AI level right now?
β€οΈ β Advanced user
π₯ β Almost zero
#AICourse #Microsoft #DeepLearning #TensorFlow #PyTorch #MachineLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
β€5π1
Forwarded from Machine Learning
Classical machine learning equations and diagrams cheat sheet π
https://github.com/soulmachine/machine-learning-cheat-sheet
#MachineLearning #ML #DataScience #CheatSheet #AI #DeepLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
https://github.com/soulmachine/machine-learning-cheat-sheet
#MachineLearning #ML #DataScience #CheatSheet #AI #DeepLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
π Level up your AI & Data Science skills with HelloEncyclo β a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
β 13 courses live + 40+ coming soon
π― One access, lifetime updates
π Use code: PRESALE-BOOK-WAVE-2GFG
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
β€7
Forwarded from Machine Learning
500 AI/ML/Computer Vision/NLP projects with code π
This is a large collection of 500 ready-made projects in the field of machine learning, deep learning, computer vision, and NLP π§
All examples come with code, so you can not just read them, but immediately analyze and run them βοΈ
β‘οΈ Link to GitHub:
https://github.com/ashishpatel26/500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code
#AI #MachineLearning #DeepLearning #ComputerVision #NLP #DataScience
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
This is a large collection of 500 ready-made projects in the field of machine learning, deep learning, computer vision, and NLP π§
All examples come with code, so you can not just read them, but immediately analyze and run them βοΈ
β‘οΈ Link to GitHub:
https://github.com/ashishpatel26/500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code
#AI #MachineLearning #DeepLearning #ComputerVision #NLP #DataScience
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€12
Forwarded from Machine Learning
A Chinese developer has released an open-source replacement for NumPy that performs calculations on GPUs. It's called CuPy π. In many cases, it's enough to replace a single line:
The same code can run on CUDA up to 100 times faster β‘οΈ.
What it can do:
β Compatible with existing NumPy and SciPy code π οΈ.
β No need to rewrite the program or learn new syntax π.
β Supports not only CUDA but also AMD ROCm π».
The project is completely open-source π:
π https://github.com/cupy/cupy
#Python #GPU #NumPy #CuPy #AI #DeepLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
import cupy as cp
The same code can run on CUDA up to 100 times faster β‘οΈ.
What it can do:
β Compatible with existing NumPy and SciPy code π οΈ.
β No need to rewrite the program or learn new syntax π.
β Supports not only CUDA but also AMD ROCm π».
The project is completely open-source π:
π https://github.com/cupy/cupy
#Python #GPU #NumPy #CuPy #AI #DeepLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€5π2
Reinforcement Learning Methods and Tutorials π§ π
In these tutorials for reinforcement learning, it covers from the basic RL algorithms to advanced algorithms developed recent years.
Learning Resources: https://github.com/MorvanZhou/Reinforcement-learning-with-tensorflow π
Here's a collection of simple materials on methods and practical guides, covering both basic reinforcement learning algorithms and modern, recently developed, and updated advanced algorithms. πβ¨
#ReinforcementLearning #MachineLearning #AI #DeepLearning #TechTutorials #DataScience
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
In these tutorials for reinforcement learning, it covers from the basic RL algorithms to advanced algorithms developed recent years.
Learning Resources: https://github.com/MorvanZhou/Reinforcement-learning-with-tensorflow π
Here's a collection of simple materials on methods and practical guides, covering both basic reinforcement learning algorithms and modern, recently developed, and updated advanced algorithms. πβ¨
#ReinforcementLearning #MachineLearning #AI #DeepLearning #TechTutorials #DataScience
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€12
Forwarded from Machine Learning
Diving deep into Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP. π€π§
Lectures: ππ
https://github.com/kmario23/deep-learning-drizzle
#DeepLearning #MachineLearning #AI #ReinforcementLearning #ComputerVision #NLP
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
Lectures: ππ
https://github.com/kmario23/deep-learning-drizzle
#DeepLearning #MachineLearning #AI #ReinforcementLearning #ComputerVision #NLP
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€7π1π―1
π Comprehensive Practical Course on Reinforcement Learning
We've found a repository that will help you learn Reinforcement Learning, from basic concepts to advanced algorithms.
The author supports the theory with practical examples using TensorFlow, making the material ideal for self-study.
βοΈ Link to GitHub
https://github.com/MorvanZhou/Reinforcement-learning-with-tensorflow
#ReinforcementLearning #TensorFlow #MachineLearning #DeepLearning #AI #Tech
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
We've found a repository that will help you learn Reinforcement Learning, from basic concepts to advanced algorithms.
The author supports the theory with practical examples using TensorFlow, making the material ideal for self-study.
βοΈ Link to GitHub
https://github.com/MorvanZhou/Reinforcement-learning-with-tensorflow
#ReinforcementLearning #TensorFlow #MachineLearning #DeepLearning #AI #Tech
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€6
This media is not supported in your browser
VIEW IN TELEGRAM
U-Net by hand βοΈ ~ 17 steps walkthrough below
I consider U-Net as a key milestone in deep learning, the first image-to-image model that really worked!
It came out of medical imaging, an unusual place, not from NeurIPS or CVPR or ACL.
Now it is the backbone of diffusion models, which you see in almost all modern image generation models.
I drew the network as a C so the matrix multiplication flows naturally down.
Tilt your head to the right and it is a U again. π€£
Goal: push a 3 x 16 image down to a 2 x 4 bottleneck and back out again, filling in every cell yourself.
= 1. Given =
An image of three channels, R, G and B, sixteen pixels wide, and every kernel the network will use.
= 2. Convolution 1 =
Let us slide the first kernel over the image. Each output is one multiply-and-add over a 2 x 3 window, and the result is the green feature map.
= 3. Find the maxima =
We circle the largest value in each 1 x 2 window. Circling first is worth the extra step: it is the pooling decision, made before anything is written down.
= 4. Max pool 1 =
Let us copy those maxima down. Sixteen columns become eight, and half the detail is gone for good.
= 5. Convolution 2 =
We convolve again with the second kernel, deeper into the contracting path. The feature map is blue now.
= 6. Find the maxima again =
Same move as step 3, on the blue map.
= 7. Max pool 2 =
Eight columns become four.
= 8. The bottleneck =
Let us convolve once more. This is the bottom of the U, a 2 x 4 block that is everything the network kept.
= 9. Spread it out =
We start back up. The transposed convolution writes each bottleneck value into a wider grid, leaving gaps between them.
= 10. Transposed convolution 1 =
Let us fill those gaps by convolving over the spread-out grid. Four columns become eight.
= 11. The first skip =
We copy the encoder's matching row straight across. This is the skip connection, and it is the whole reason a U-Net can recover detail that pooling threw away.
= 12. Convolution with the skip =
Let us convolve the upsampled features together with the copied ones.
= 13. Spread it out again =
Same as step 9, one level up.
= 14. Transposed convolution 2 =
Eight columns become sixteen, back to the width we started at.
= 15. The second skip =
The encoder's first feature map comes across, the one made before any pooling happened.
= 16. Convolution and ReLU =
We convolve, then cross out every negative and set it to zero.
= 17. Output convolution =
Let us apply the last kernel. Out comes R', G' and B', an image the same size as the one we started with.
The outputs:
Congrats! You just calculated a U-Net by hand.
πΎ Save this post!
#UNet #DeepLearning #AI #NeuralNetworks #ComputerVision #MachineLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
I consider U-Net as a key milestone in deep learning, the first image-to-image model that really worked!
It came out of medical imaging, an unusual place, not from NeurIPS or CVPR or ACL.
Now it is the backbone of diffusion models, which you see in almost all modern image generation models.
I drew the network as a C so the matrix multiplication flows naturally down.
Tilt your head to the right and it is a U again. π€£
Goal: push a 3 x 16 image down to a 2 x 4 bottleneck and back out again, filling in every cell yourself.
= 1. Given =
An image of three channels, R, G and B, sixteen pixels wide, and every kernel the network will use.
= 2. Convolution 1 =
Let us slide the first kernel over the image. Each output is one multiply-and-add over a 2 x 3 window, and the result is the green feature map.
= 3. Find the maxima =
We circle the largest value in each 1 x 2 window. Circling first is worth the extra step: it is the pooling decision, made before anything is written down.
= 4. Max pool 1 =
Let us copy those maxima down. Sixteen columns become eight, and half the detail is gone for good.
= 5. Convolution 2 =
We convolve again with the second kernel, deeper into the contracting path. The feature map is blue now.
= 6. Find the maxima again =
Same move as step 3, on the blue map.
= 7. Max pool 2 =
Eight columns become four.
= 8. The bottleneck =
Let us convolve once more. This is the bottom of the U, a 2 x 4 block that is everything the network kept.
= 9. Spread it out =
We start back up. The transposed convolution writes each bottleneck value into a wider grid, leaving gaps between them.
= 10. Transposed convolution 1 =
Let us fill those gaps by convolving over the spread-out grid. Four columns become eight.
= 11. The first skip =
We copy the encoder's matching row straight across. This is the skip connection, and it is the whole reason a U-Net can recover detail that pooling threw away.
= 12. Convolution with the skip =
Let us convolve the upsampled features together with the copied ones.
= 13. Spread it out again =
Same as step 9, one level up.
= 14. Transposed convolution 2 =
Eight columns become sixteen, back to the width we started at.
= 15. The second skip =
The encoder's first feature map comes across, the one made before any pooling happened.
= 16. Convolution and ReLU =
We convolve, then cross out every negative and set it to zero.
= 17. Output convolution =
Let us apply the last kernel. Out comes R', G' and B', an image the same size as the one we started with.
The outputs:
R' = [3, 0, 7, 0, 7, 0, 17, 0, 3, 0, 9, 0, 2, 0, 6, 0]
G' = [1, 20, 1, 10, 1, 12, 1, 19, 2, 5, 1, 11, 1, 3, 1, 7]
B' = [4, 20, 8, 10, 8, 12, 18, 19, 5, 5, 10, 11, 3, 3, 7, 7]
Congrats! You just calculated a U-Net by hand.
πΎ Save this post!
#UNet #DeepLearning #AI #NeuralNetworks #ComputerVision #MachineLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€4