Autonomous AI research on Apple Silicon
Port of the project Karpathyβs autoresearch for Apple Silicon based on MLX, which implements autonomous research cycles with control via program.md π
Whatβs interesting:
β’ native support for Apple Silicon without PyTorch/CUDA
β’ fixed training budget (~5 minutes)
β’ logging of results in results.tsv
β’ simple structure for autonomous experiments
β’ optimization of models for more efficient operation
https://github.com/trevin-creator/autoresearch-mlx π¬
#AppleSilicon #AIResearch #MLX #AutonomousAI #MachineLearning #OpenSource
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
Port of the project Karpathyβs autoresearch for Apple Silicon based on MLX, which implements autonomous research cycles with control via program.md π
Whatβs interesting:
β’ native support for Apple Silicon without PyTorch/CUDA
β’ fixed training budget (~5 minutes)
β’ logging of results in results.tsv
β’ simple structure for autonomous experiments
β’ optimization of models for more efficient operation
https://github.com/trevin-creator/autoresearch-mlx π¬
#AppleSilicon #AIResearch #MLX #AutonomousAI #MachineLearning #OpenSource
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€7
Transformer implementations for vision, audio, and AI agents π€ποΈπ΅
Repo: https://github.com/Nicolepcx/transformers-the-definitive-guide
#AI #MachineLearning #Vision #Audio #Agents #Tech
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
Repo: https://github.com/Nicolepcx/transformers-the-definitive-guide
#AI #MachineLearning #Vision #Audio #Agents #Tech
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€4π3
π HelloEncyclo Presale is LIVE!
Master the skills that matter β Gen-AI, Data Science, Machine Learning and more β all in one place.
π First 250 members get a flat 40% OFF
Use code: PRESALE-BOOK-WAVE-2GFG
β 13 full courses live right now
β 40+ more dropping in the next 2β3 weeks
β Complete library within 2 months β built and refined by industry experts
β 15-day money-back guarantee β don't love it? Get a full refund.
β οΈ Coupon works only after you log in with Gmail, and it's valid once per member.
π Log in now and start learning:
https://helloencyclo.com
Don't wait β the 40% deal disappears after the first 250 seats. π₯
Master the skills that matter β Gen-AI, Data Science, Machine Learning and more β all in one place.
π First 250 members get a flat 40% OFF
Use code: PRESALE-BOOK-WAVE-2GFG
β 13 full courses live right now
β 40+ more dropping in the next 2β3 weeks
β Complete library within 2 months β built and refined by industry experts
β 15-day money-back guarantee β don't love it? Get a full refund.
β οΈ Coupon works only after you log in with Gmail, and it's valid once per member.
π Log in now and start learning:
https://helloencyclo.com
Don't wait β the 40% deal disappears after the first 250 seats. π₯
β€3π2π―1
Stop discovering ML Python libraries one random tutorial at a time π
Best-of Machine Learning with Python is a curated GitHub index of open-source machine learning Python libraries for builders who need a faster way to compare the ecosystem π.
It helps you shortlist tools by grouping projects into categories and ranking them with a project-quality score based on metrics collected from GitHub and package managers π.
Key features:
β’ 920-project index β a large scan-friendly map of open-source ML Python projects πΊοΈ
β’ 34 categories β browse by area like ML frameworks, NLP, image data, AutoML, deployment, interpretability, and more π§©
β’ Quality-score ranking β projects are ordered using an automated score from repo and package-manager signals βοΈ
β’ Rich project metadata β entries show signals like stars, forks, issues, contributors, activity, downloads, and dependencies π
β’ Weekly updates + contributions β the list is updated regularly and can be improved via issues, PRs, or projects.yaml edits π
Itβs open-source (CC BY-SA 4.0 license) π.
https://github.com/lukasmasuch/best-of-ml-python π
#MachineLearning #Python #ML #OpenSource #DataScience #TechStack
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
Best-of Machine Learning with Python is a curated GitHub index of open-source machine learning Python libraries for builders who need a faster way to compare the ecosystem π.
It helps you shortlist tools by grouping projects into categories and ranking them with a project-quality score based on metrics collected from GitHub and package managers π.
Key features:
β’ 920-project index β a large scan-friendly map of open-source ML Python projects πΊοΈ
β’ 34 categories β browse by area like ML frameworks, NLP, image data, AutoML, deployment, interpretability, and more π§©
β’ Quality-score ranking β projects are ordered using an automated score from repo and package-manager signals βοΈ
β’ Rich project metadata β entries show signals like stars, forks, issues, contributors, activity, downloads, and dependencies π
β’ Weekly updates + contributions β the list is updated regularly and can be improved via issues, PRs, or projects.yaml edits π
Itβs open-source (CC BY-SA 4.0 license) π.
https://github.com/lukasmasuch/best-of-ml-python π
#MachineLearning #Python #ML #OpenSource #DataScience #TechStack
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€7
Forwarded from Machine Learning
Data leakage is one of the main reasons why ML demos look impressive... and then fail in production. π
The model didn't become smarter.
It just happened to see the correct answers in advance.
In 4 minutes, you'll understand where data leaks hide. π
Let's break it down below: π
1. Data Leakage π³οΈ
Data leakage occurs when information that won't be available at the time of actual prediction is used during the model training process.
Because of this, metrics on the validation stage can look much better than the actual quality of the model on new, previously unseen data.
2. Model Evaluation βοΈ
The test set isn't just "additional data".
It's a simulation of the future.
Only train the model on the information that would have been available to you at the time of prediction.
Evaluate it on examples that the model couldn't have influenced during training.
3. Direct Leakage π¨
This is the most obvious type of leakage.
Examples:
- a field with information from the future;
- an ID that encodes the target variable;
- a variable that appears only after an event has occurred;
- duplicate records in both the training and test sets.
If a feature doesn't exist at the time of inference (prediction), then it's likely a source of data leakage.
4. Indirect Leakage π΅οΈ
This is the type of leakage that most often traps teams.
You perform normalization, imputation, feature selection, outlier removal, or dimensionality reduction before splitting the data into a training and test set.
The model didn't directly see the data from the test set.
But your preprocessing pipeline already saw it.
5. Train/Test Split βοΈ
Wrong:
Right:
The same idea applies to imputers, encoders, feature selection, PCA, and any preprocessing step that is trained on the data.
6. Cross-Validation π
Each fold is a mini-experiment with a training and test set.
Therefore, preprocessing should be performed within each fold.
If you prepared the entire dataset once and then ran cross-validation, each fold would already have had access to its held-out data.
7. Pipelines π οΈ
A pipeline isn't just a way to make the code cleaner.
It's also a defense against data leakage.
Combine preprocessing, feature selection, and the model into a single pipeline, and then pass this pipeline to cross-validation or hyperparameter search (grid search).
8. AI Engineering Version π€
Data leaks also occur in RAG systems and when evaluating LLMs.
Leakage occurs when you tune chunks, prompts, re-rankers, thresholds, or examples on the same evaluation dataset that you later present as "held-out".
As a result, your benchmark turns into training data.
9. Leakage Checklist β
Before trusting the obtained metric, ask yourself:
- Could this feature exist at the time of prediction?
- Was any transformation (transform) step trained (fit) on the test data?
- Did cross-validation include the entire pipeline?
- Were we tuning parameters on the final evaluation dataset?
If the answer is "yes", then the metric likely doesn't reflect the actual quality of the model.
#MachineLearning #DataScience #MLOps #DataLeakage #ArtificialIntelligence #TechTips
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
The model didn't become smarter.
It just happened to see the correct answers in advance.
In 4 minutes, you'll understand where data leaks hide. π
Let's break it down below: π
1. Data Leakage π³οΈ
Data leakage occurs when information that won't be available at the time of actual prediction is used during the model training process.
Because of this, metrics on the validation stage can look much better than the actual quality of the model on new, previously unseen data.
2. Model Evaluation βοΈ
The test set isn't just "additional data".
It's a simulation of the future.
Only train the model on the information that would have been available to you at the time of prediction.
Evaluate it on examples that the model couldn't have influenced during training.
3. Direct Leakage π¨
This is the most obvious type of leakage.
Examples:
- a field with information from the future;
- an ID that encodes the target variable;
- a variable that appears only after an event has occurred;
- duplicate records in both the training and test sets.
If a feature doesn't exist at the time of inference (prediction), then it's likely a source of data leakage.
4. Indirect Leakage π΅οΈ
This is the type of leakage that most often traps teams.
You perform normalization, imputation, feature selection, outlier removal, or dimensionality reduction before splitting the data into a training and test set.
The model didn't directly see the data from the test set.
But your preprocessing pipeline already saw it.
5. Train/Test Split βοΈ
Wrong:
fit the scaler on all data β split the data β evaluate
Right:
split the data β fit the scaler only on the training set β apply it to both the training and test sets
The same idea applies to imputers, encoders, feature selection, PCA, and any preprocessing step that is trained on the data.
6. Cross-Validation π
Each fold is a mini-experiment with a training and test set.
Therefore, preprocessing should be performed within each fold.
If you prepared the entire dataset once and then ran cross-validation, each fold would already have had access to its held-out data.
7. Pipelines π οΈ
A pipeline isn't just a way to make the code cleaner.
It's also a defense against data leakage.
Combine preprocessing, feature selection, and the model into a single pipeline, and then pass this pipeline to cross-validation or hyperparameter search (grid search).
8. AI Engineering Version π€
Data leaks also occur in RAG systems and when evaluating LLMs.
Leakage occurs when you tune chunks, prompts, re-rankers, thresholds, or examples on the same evaluation dataset that you later present as "held-out".
As a result, your benchmark turns into training data.
9. Leakage Checklist β
Before trusting the obtained metric, ask yourself:
- Could this feature exist at the time of prediction?
- Was any transformation (transform) step trained (fit) on the test data?
- Did cross-validation include the entire pipeline?
- Were we tuning parameters on the final evaluation dataset?
If the answer is "yes", then the metric likely doesn't reflect the actual quality of the model.
#MachineLearning #DataScience #MLOps #DataLeakage #ArtificialIntelligence #TechTips
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
Telegram
AI PYTHON π
Youβve been invited to add the folder βAI PYTHON πβ, which includes 14 chats.
β€6
Forwarded from Github Top Repositories
π DataTalksClub/data-engineering-zoomcamp caught my eye on GitHub Trending today.
π https://github.com/DataTalksClub/data-engineering-zoomcamp
π Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here ππΌ
ββββββββββββββββββββββββββββββ
The Data Engineering Zoomcamp is a free 9-week course that covers the fundamentals of data engineering. It's designed to help you build an end-to-end data pipeline from scratch, with hands-on experience using industry-standard tools and best practices.
Key features of the course include structured modules, hands-on workshops, and a final project to reinforce your learning. You'll learn about
The course is suitable for anyone with basic coding experience and familiarity with
The course has a strong community and support system, with a dedicated #course-data-engineering channel on Slack for discussions and troubleshooting.
The course is taught by experienced instructors, including Alexey Grigorev and Michael Shoemaker, and is sponsored by companies like Kestra and Bruin.
Overall, the Data Engineering Zoomcamp is a great resource for anyone looking to learn data engineering fundamentals and build a career in the field.
So, what are you waiting for? Join the course and start building your skills today - it's a
ββββββββββββββββββββββββββββββ
π§ Channel: https://t.me/GithubRe
π https://github.com/DataTalksClub/data-engineering-zoomcamp
π Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here ππΌ
ββββββββββββββββββββββββββββββ
The Data Engineering Zoomcamp is a free 9-week course that covers the fundamentals of data engineering. It's designed to help you build an end-to-end data pipeline from scratch, with hands-on experience using industry-standard tools and best practices.
Key features of the course include structured modules, hands-on workshops, and a final project to reinforce your learning. You'll learn about
containerization, infrastructure as code, workflow orchestration, data warehousing, and analytics engineering. The course is suitable for anyone with basic coding experience and familiarity with
SQL. No prior data engineering experience is necessary. You can enroll in the course by registering for the next cohort or following the self-paced learning path.The course has a strong community and support system, with a dedicated #course-data-engineering channel on Slack for discussions and troubleshooting.
The course is taught by experienced instructors, including Alexey Grigorev and Michael Shoemaker, and is sponsored by companies like Kestra and Bruin.
Overall, the Data Engineering Zoomcamp is a great resource for anyone looking to learn data engineering fundamentals and build a career in the field.
So, what are you waiting for? Join the course and start building your skills today - it's a
free 9-week course that can change your career!ββββββββββββββββββββββββββββββ
π§ Channel: https://t.me/GithubRe
β€5
Interactive Explainer π§ β¨
The Anatomy of an LLM π
A visual walk through the machinery inside a large language model: from raw text, to tokens, to vectors, to attention, to the next token. βοΈπ§¬
π Link: https://www.royvanrijn.com/anatomy-of-an-llm/
#LLM #AI #Tech #NeuralNetworks #MachineLearning #DeepLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
The Anatomy of an LLM π
A visual walk through the machinery inside a large language model: from raw text, to tokens, to vectors, to attention, to the next token. βοΈπ§¬
π Link: https://www.royvanrijn.com/anatomy-of-an-llm/
#LLM #AI #Tech #NeuralNetworks #MachineLearning #DeepLearning
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
Roy van Rijn
The Anatomy of an LLM | Interactive Visual Guide to How Language Models Work
An interactive visual explainer for developers showing how LLMs work, from tokenization and embeddings to attention, transformers, training, KV cache, and quantization.
β€8
Forwarded from Machine Learning
FREE MIT books on AI and Machine Learning: ππ€
1. Foundations of Machine Learning cs.nyu.edu/~mohri/mlbook/
2. Understanding Deep Learning udlbook.github.io/udlbook/
3. Introduction to Machine Learning Systems β― Vol 1: mlsysbook.ai/vol1/assets/do β― Vol 2: mlsysbook.ai/vol2/assets/do
4. Algorithms for ML algorithmsbook.com
5. Deep Learning deeplearningbook.org
6. Reinforcement Learning andrew.cmu.edu/course/10-703/
7. Distributional Reinforcement Learning direct.mit.edu/books/oa-monog
8. Multi Agent Reinforcement Learning marl-book.com
9. Agents in the Long Game of AI direct.mit.edu/books/oa-monog
10. Fairness and Machine Learning fairmlbook.org
11. Probabilistic Machine Learning
β― Part 1 : probml.github.io/pml-book/book1
β― Part 2 : probml.github.io/pml-book/book2
#MIT #AI #MachineLearning #DeepLearning #ReinforcementLearning #FreeBooks
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
1. Foundations of Machine Learning cs.nyu.edu/~mohri/mlbook/
2. Understanding Deep Learning udlbook.github.io/udlbook/
3. Introduction to Machine Learning Systems β― Vol 1: mlsysbook.ai/vol1/assets/do β― Vol 2: mlsysbook.ai/vol2/assets/do
4. Algorithms for ML algorithmsbook.com
5. Deep Learning deeplearningbook.org
6. Reinforcement Learning andrew.cmu.edu/course/10-703/
7. Distributional Reinforcement Learning direct.mit.edu/books/oa-monog
8. Multi Agent Reinforcement Learning marl-book.com
9. Agents in the Long Game of AI direct.mit.edu/books/oa-monog
10. Fairness and Machine Learning fairmlbook.org
11. Probabilistic Machine Learning
β― Part 1 : probml.github.io/pml-book/book1
β― Part 2 : probml.github.io/pml-book/book2
#MIT #AI #MachineLearning #DeepLearning #ReinforcementLearning #FreeBooks
β¨ Join Best TG Channels https://t.me/addlist/0f6vfFbEMdAwODBk
βοΈ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
β€6
π£ HelloEncyclo Presale
β Now Open
π 40% OFF Β· first 250 members only
Code: PRESALE-BOOK-WAVE-2GFG
π§ Inside: Gen-AI, LLMs, RAG, Data Science, ML, Deep Learning, SQL, Advanced Java, Math for AI
π 13 live now Β· 40+ in 2β3 weeks Β· full library in ~2 months
π‘ 15-day money-back guarantee
β οΈ Log in with Gmail to apply (valid once).
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
The discount disappears with the last seat. Don't sleep on it.
β Now Open
π 40% OFF Β· first 250 members only
Code: PRESALE-BOOK-WAVE-2GFG
π§ Inside: Gen-AI, LLMs, RAG, Data Science, ML, Deep Learning, SQL, Advanced Java, Math for AI
π 13 live now Β· 40+ in 2β3 weeks Β· full library in ~2 months
π‘ 15-day money-back guarantee
β οΈ Log in with Gmail to apply (valid once).
π https://helloencyclo.com/?ref=HUSSEINSHEIKHO
The discount disappears with the last seat. Don't sleep on it.
β€5π₯1
Machine Learning with Python
Photo
Don't miss this opportunity!
Once you register, you will receive future courses for free.
Once you register, you will receive future courses for free.
β€2π1
Your phone is not the problem.
You scroll.
You watch.
You waste hours.
My students use the same phone to follow Gold alerts and build a main income routine.
No complicated charts.
No experience needed.
Just follow the alerts.
π Join Taniaβs Free Academy
#adπ’ InsideAd
You scroll.
You watch.
You waste hours.
My students use the same phone to follow Gold alerts and build a main income routine.
No complicated charts.
No experience needed.
Just follow the alerts.
π Join Taniaβs Free Academy
#ad
Please open Telegram to view this post
VIEW IN TELEGRAM