PACO: Parts and Attributes of Common Objects

Sometimes object detection is not enough and you need more detail about object. Especially, when parts of objects is matters in your task. Then this dataset is for you from Facebook research team.

PACO is a detection dataset that goes beyond traditional object boxes and masks and provides richer annotations such as part masks and attributes. It spans 75 object categories, 456 object-part categories and 55 attributes across image (LVIS) and video (Ego4D) datasets.

Paper:
https://arxiv.org/pdf/2301.01795.pdf

Github:
https://github.com/facebookresearch/paco

Visualization:
https://github.com/facebookresearch/paco/tree/main/notebooks

@computer_science_and_programming

MIT Introduction to Deep Learning - 2023 Starting soon! MIT Intro to DL is one of the most concise AI courses on the web that cover basic deep learning techniques, architectures, and applications.

2023 lectures are starting in just one day, Jan 9th!

Link to register:
http://introtodeeplearning.com

MIT Introduction to Deep Learning The 2022 lectures can be found here:

https://m.youtube.com/playlist?list=PLtBw6njQRU-rwp5__7C0oIVt26ZgjG9NI

👉 @computer_science_and_programming

YOLOv8 is the newest state-of-the-art YOLO model that can be used for object detection, image classification, and instance segmentation tasks. YOLOv8 includes numerous architectural and developer experience changes and improvements over YOLOv5.

Code:
https://github.com/ultralytics/ultralytics

What's New in YOLOv8 ?
https://blog.roboflow.com/whats-new-in-yolov8/

Yolov8 Instance Segmentation (ONNX):
https://github.com/ibaiGorordo/ONNX-YOLOv8-Instance-Segmentation

👉 @computer_science_and_programming

Box2Mask: Box-supervised Instance Segmentation via Level-set Evolution

BoxInstSeg is a toolbox that aims to provide state-of-the-art box-supervised instance segmentation algorithms. It supports instance segmentation with only box annotations.


Github:
https://github.com/LiWentomng/BoxInstSeg

Paper:
https://arxiv.org/pdf/2212.01579.pdf

👉@computer_science_and_programming

GLIGEN: Open-Set Grounded Text-to-Image Generation.

GLIGEN (Grounded-Language-to-Image Generation) a novel approach that builds upon and extends the functionality of existing pre-trained text-to-image diffusion models by enabling them to also be conditioned on grounding inputs.

Project page:
https://gligen.github.io/

Paper:
https://arxiv.org/abs/2301.07093

Github (coming soon):
https://github.com/gligen/GLIGEN

Demo:
https://huggingface.co/spaces/gligen/demo


👉@computer_science_and_programming

Cut and Learn for Unsupervised Object Detection and Instance Segmentation

Cut-and-LEaRn (CutLER) is a simple approach for training object detection and instance segmentation models without human annotations. It outperforms previous SOTA by 2.7 times for AP50 and 2.6 times for AR on 11 benchmarks.

Paper:
https://arxiv.org/pdf/2301.11320.pdf

Github:
https://github.com/facebookresearch/CutLER

Demo:
https://colab.research.google.com/drive/1NgEyFHvOfuA2MZZnfNPWg1w5gSr3HOBb?usp=sharing

👉@computer_science_and_programming

Audio AI Timeline

Here we will keep track of the latest AI models for audio generation, starting in 2023!


▪️SingSong: Generating musical accompaniments from singing
- Paper

▪️AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
- Paper
- Code

▪️Moûsai: Text-to-Music Generation with Long-Context Latent Diffusion
- Paper
- Code

▪️Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models
- Paper

▪️Noise2Music

▪️RAVE2
- Paper
- Code

▪️MusicLM: Generating Music From Text
- Paper

▪️Msanii: High Fidelity Music Synthesis on a Shoestring Budget
- Paper
- Code
- HuggingFace

▪️ArchiSound: Audio Generation with Diffusion
- Paper
- Code

▪️VALL-E: Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
- Paper

👉@computer_science_and_programming

Gen-1: The Next Step Forward for Generative AI

Use words and images to generate new videos out of existing

Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones.

https://research.runwayml.com/gen1

⭐️ Project:
https://research.runwayml.com/gen1

✅ Paper:
https://arxiv.org/abs/2302.03011

📌Request form:
https://docs.google.com/forms/d/e/1FAIpQLSfU0O_i1dym30hEI33teAvCRQ1i8UrGgXd4BPrvBWaOnDgs9g/viewform

👉@computer_science_and_programming

YOWOv2: A Stronger yet Efficient Multi-level Detection Framework for Real-time Spatio-temporal Action Detection

SPATIO-temporal action detection (STAD) aims to detect action instances in the current frame, which it has been widely applied, such as video surveillance and somatosensory game.

Paper:
https://arxiv.org/pdf/2302.06848.pdf

Github:
https://github.com/yjh0410/YOWOv2

Dataset:
https://drive.google.com/file/d/1Dwh90pRi7uGkH5qLRjQIFiEmMJrAog5J/view?usp=sharing

👉@computer_science_and_programming

3D-aware Conditional Image Synthesis (pix2pix3D)

Pix2pix3D synthesizes 3D objects (neural fields) given a 2D label map, such as a segmentation or edge map

Github:
https://github.com/dunbar12138/pix2pix3D

Paper:
https://arxiv.org/abs/2302.08509

Project:
https://www.cs.cmu.edu/~pix2pix3D/

Datasets:
CelebAMask , AFHQ-Cat-Seg , Shapenet-Car-Edge


👉@computer_science_and_programming

ViperGPT: Visual Inference via Python Execution for Reasoning

ViperGPT, a framework that leverages code-generation models to compose vision-and-language models into subroutines to produce a result for any query.


Github:
https://github.com/cvlab-columbia/viper

Paper:
https://arxiv.org/pdf/2303.08128.pdf

Project:
https://paperswithcode.com/dataset/beat

👉@computer_science_and_programming

Test of Time: Instilling Video-Language Models with a Sense of Time

GPT-5 will likely have video abilities, but will it have a sense of time? Here is answer to this question in #CVPR2023 paper by student of University of Amsterdam to learn how to instil time into video-language foundation models.

Paper:
https://arxiv.org/abs/2301.02074

Code:
https://github.com/bpiyush/TestOfTime

Project Page:
https://bpiyush.github.io/testoftime-website/

👉 @computer_science_and_programming

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

Paper:
https://arxiv.org/abs/2305.10973

Github:
https://github.com/XingangPan/DragGAN

Project page:
https://vcai.mpi-inf.mpg.de/projects/DragGAN/

👉 @computer_science_and_programming

🔭 GRES: Generalized Referring Expression Segmentation

New benchmark (GRES), which extends the classic RES to allow expressions to refer to an arbitrary number of target objects.

🖥 Github: https://github.com/henghuiding/ReLA

⏩ Paper: https://arxiv.org/abs/2306.00968

🔎 Project: https://henghuiding.github.io/GRES/

📌 New dataset: https://github.com/henghuiding/gRefCOCO

👉 @computer_science_and_programming

80+ Jupyter Notebook tutorials on image classification, object detection and image segmentation in various domains
📌 Agriculture and Food
📌 Medical and Healthcare
📌 Satellite
📌 Security and Surveillance
📌 ADAS and Self Driving Cars
📌 Retail and E-Commerce
📌 Wildlife

Classification library
https://github.com/Tessellate-Imaging/monk_v1

Notebooks - https://github.com/Tessellate-Imaging/monk_v1/tree/master/study_roadmaps/4_image_classification_zoo

Detection and Segmentation Library
https://github.com/Tessellate-Imaging/

Monk_Object_Detection
Notebooks: https://github.com/Tessellate-Imaging/Monk_Object_Detection/tree/master/application_model_zoo

👉 @computer_science_and_programming