THE WORLD’S LARGEST SELF-DRIVING DATASET : https://doc.bdd100k.com/download.html

UC Berkeley open-sourced the largest ever self-driving dataset to the AI community in 2018. The dataset called Berkeley DeepDrive 100K (BDD100K) contains over 100,000 video sequences. Each video is 40 seconds long, shot at 30 FPS and 720p. GPS information is also provided, indicating the navigation route taken during driving.

The dataset covers a multitude of different weather and time conditions: sunny, rainy and hazy data captured both during day and at night also gives a well-balanced distribution that helps prevent overfitting.

Over 85,000 pedestrians are also present in the dataset. Therefore, the dataset also offers a reliable dataset for detecting pedestrians on the road/sidewalks. This scale of content available is quite massive too. This is 800 times bigger than Baidu’s ApolloScape dataset. https://www.bdd100k.com/challenges/eccv2022/

Analysis of various Machine Learning algorithms (Supervised and Unsupervised learning)

Lightly: A python library for self-supervised learning on images

Cool computer vision library for self-supervision and active learning.

Github: https://github.com/lightly-ai/lightly
Docs: https://docs.lightly.ai/

New version of django-upgrade released - for Django 3.2+ https://pypi.org/project/django-upgrade/

Thursday, 8 September 2022
AI Curated Latest Track
✍️✍️ Amazon Announces the Improvement of ML Models to Better Identify Sensitive Data on Amazon Macie
✍️✍️ Gartner has recognized Microsoft as a Leader in the 2022 Gartner®️ Magic Quadrant™️ for Cloud AI Developer Services,
✍️✍️ Google begins rolling out its AI Test Kitchen machine learning app
✍️✍️ Banned U.S. AI chips in high demand at Chinese state institutes
✍️✍️ PolyAI secures $40M for its AI-powered voice assistant platform
✍️✍️ The researchers using AI to analyse peer review
✍️✍️ Intel Loses Bid to Nix Rival’s Medical Machine-Learning Patent
✍️✍️ Canadian company uses machine learning to promote DEI (diversity, equity and inclusion) in the hiring process
✍️✍️ Django bugfix release: 4.1.1
✍️✍️ MIT’s new AI model can successfully detect Parkinson’s disease
✍️✍️ Stanford engineers present new chip that ramps up AI computing efficiency
✍️✍️ AI App Could Accurately Detect Covid-19 in Your Voice, Say Scientists
✍️✍️ India To create AI/ML Enabled Portal for Pensioners

Inscribed by
Raja

TEN mind-blowing AI websites that you’ve probably never heard of:

🔅 Magic Eraser. Remove unwanted things from images in seconds. Upload an image and mark the bit you want removed. Download your improved image.

magiceraser.io

🔅 Autoenhance. AI photo editor that enhances your workflow. Instantly get brighter, colourful and evenly lit images. Sky replacement and perspective correction to transform photos.

autoenhance.ai

🔅 Writesonic. AI writer that helps you write long-form blog posts & articles. Break free from writers block and scale your content production. Take content creation to the next level.

writesonic.com

🔅 Your own writing assistant and personal collaborator. Powered by AI to write better & faster. Create viral hooks and headlines in seconds.

tribescaler.com

🔅 Rytr - An AI writing assistant to help you write 10x faster.Enter your post topic, select the variants and creativity level. Choose the variants that are best suited to your style.

rytr.me

🔅 Namelix. Generate a short, catchy business name using AI. Decide using key words or domain extensions. Short names are unique, memorable and affordable.

namelix.com

🔅 Replika. Your AI companion who cares. There to listen and talk, always on your side.Ready to chat when you need an empathetic friend.

replika.com

🔅 Your AI assistant for meetings. Instantly record meetings across any web-conferencing platform.Transcribe, and search across your voice conversations.

fireflies.ai
🔅 Excel Formula Bot. Stop wasting hours creating Excel formulas. Turn your spreadsheet problem into a formula in seconds. Experience the full power of Excel & Google Sheets AI.

excelformulabot.com

🔅 Talk To Books. Get quotes from books that respond to your question. A creativity tool by Google to explore new ideas. Explore an index of > 100,000 books.

books.google.com/talktobooks/

—————🤷🤷Tensor Parallelism

There are >= 3 1/2 paradigms for training deep neural nets on multiple GPUs:

1) Data parallelism
2) Model parallelism
3) Pipeline parallelism
( 4) Tensor parallelism)

Which one(s) are you usually using; and anything missing?

1) Data parallelism: splits batches & distributes those across several GPUs. Here, in each iteration, the gradient estimate (for the model update) is computed from as a weighted avg over sub-batches.
Eg via DataParallel or DistributedDataParallel (recommended) in PyTorch

2) Model parallelism: divide model onto separate GPUs; usually to deal with limited VRAM. Note it doesn't imply that the training happens in parallel!

How? L1. to('cuda:0'), L2. to('cuda:1') etc.

Tutorial: pytorch.org/tutorials/inte…

3) Pipeline parallelism: related to model parallelism where you put different blocks of the model onto different GPUs(, and data parallelism where you split batches). But here you make those blocks run (somewhat) in parallel.

4) Tensor parallelism. It's basically a flavor of model parallelism, but instead of dividing the neural network by layer (horizontally), you divide the tensors themselves (vertically). E.g., put half of a weight layer on one GPU, and the other onto another GPU


—🪡excellent info ℹ️————

The AI innovations on the Hype Cycle reflect complementary and sometimes conflicting priorities across four main categories:
🔅Data-centric AI
🔅Model-centric AI
🔅Applications-centric AI
🔅Human-centric AI

DevOps - Tools 🪡🪡

The difference between coding interviews and a tech job is you’d be fired if you actually checked in leetcode-style solutions instead of stuff like this. Think!!

BoonDock Tip : { Section - Python}

Do not initialise the empty String with quotes. Try to use 'None' in your projects. It is the best practices though.

sqlConnection=“” ——- Not good practice
sqlConnection=None —- Best practice

15 Websites To Follow As A Developer

1. Stackoverflow
2. Google
3. YouTube
4. DevDocs. io
5. Github
6. Freecodecamp
7. LeetCode
8. IndieHackers
9. Udemy
10. Hashnode
11. Medium
12. Dev. to
13. W3Schools
14. Codecademy
15. Hacker News

May be you have another list 😇😃

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

• High-performance Deep Learning models for Text2Speech tasks.
◦ Text2Spec models (Tacotron, Tacotron2, Glow-TTS, SpeedySpeech).
◦ Speaker Encoder to compute speaker embeddings efficiently.
◦ Vocoder models (MelGAN, Multiband-MelGAN, GAN-TTS, ParallelWaveGAN, WaveGrad, WaveRNN)
• Fast and efficient model training.
• Detailed training logs on the terminal and Tensorboard.
• Support for Multi-speaker TTS.

https://github.com/TheAlgorithms/Python/blob/master/DIRECTORY.md


One place where you can find hundreds of algorithms.
Even you can find them in another languages as well.

https://github.com/TheAlgorithms

Meet LAVIS - a one-stop library for language-and-vision research and applications!

🔥Github: https://github.com/salesforce/LAVIS

📜Tech Report: arxiv.org/abs/2209.09019

LAVIS features
- Unified and modular interface to access 10+ tasks, 20+ datasets, 30+ pre-trained models!

🦋🦋All tools Data Engineers need! Categorized into cloud native (only available on that platform) and cloud agnostic (use anywhere) platforms & tools on the top. On the left you find categories and subcategories for the tools.

🍀🍀The goal for every engineer is to at least have knowledge of one tool in every category (row).

🐚🐚As example:

- If you are on Azure then learn when and how to use for at least one of the tools in every row of Azure
- Or go fully cloud agnostic and open source. It's your choice.
- You can also combine cloud agnostic with cloud platforms together by replacing the cloud native tools of one row with a cloud agnostic one.

🤷‍♂️ that’s it man 👨!!

🔅🔅🌚Machine Learning types and algorithms which you must know based on their classification in supervised, unsupervised and reinforcement learning.

🦋🦋✍️✍️

OpenAI trained and are open-sourcing a neural net called Whisper that approaches human level robustness and accuracy on English speech recognition.

Whisper is an automatic speech recognition (ASR) system trained on 680,000 hours of multilingual and multitask supervised data collected from the web.

https://openai.com/blog/whisper/

Check out above link for paper, code and more details

👽👽

✍️✍️What is 𝐂𝐚𝐥𝐢𝐛𝐫𝐚𝐭𝐢𝐨𝐧 𝐢𝐧 𝐌𝐚𝐜𝐡𝐢𝐧𝐞 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠?

🍀Calibration is the property that tells us how well the estimated probabilities of a model match the actual probabilities, a.k.a the observed frequency of occurrences.

🍀Calibration can be represented using the Brier score. The Brier score is nothing more than the MSE between the actual and the estimated probabilities.

🍀The two most common methods to address poor calibration is:
🔑platt scaling and
🔑isotonic regression