📁 A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challenges

🗓 Publish year: 2024

🧑‍💻 Authors: Wei Ju, Siyu Yi, Yifan Wang, Zhiping Xiao, Zhengyang Mao, Hourun Li, Yiyang Gu, Yifang Qin, Nan Yin, Senzhang Wang, Xinwang Liu, Xiao Luo, Philip S. Yu, Ming Zhang

📎 Study the paper

Taming Stable Diffusion for Text to 360° Panorama Image Generation

🖥 Github: https://github.com/chengzhag/panfusion

📕 Paper: https://arxiv.org/abs/2404.07949v1

🔥 Dataset: https://chengzhag.github.io/publication/panfusion/

✅ https://t.me/DataScienceT

✨ HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach

A new model for transferring a hairstyle from a reference image to a source photo for a virtual fitting room.

▪ Paper : https://arxiv.org/abs/2404.01094

▪ Code : https://github.com/AIRI-Institute/HairFastGAN

▪ Colab : https://colab.research.google.com/#fileId=https%3A//huggingface.co/AIRI-Institute/HairFastGAN/blob/main/notebooks/HairFast_inference.ipynb

✅ https://t.me/DataScienceT

Are you fluent in Python and want to evaluate your skills? 🤔

Do you want to learn Python? 🤗

Are you interested in learning through questions and answers? 😵

Do you want to receive the explanation of the question?💡

🟢 https://t.me/DataScienceQ 👍

🌟 Not allowed to use ChatGPT - LLM deployments locally

There are situations when life circumstances do not allow using ChatGPT and you have to deploy LLM locally.
What can be used in this case?

1. Proprietary models :
🟡 Anthropic - Currently comparable to or superior to ChatGPT 4.0 on some tasks and has a large context window, making it possible to solve many problems without resorting to RAG and other hybrid methods

🟡 Yandex GPT - functions well in Russian, so if your grandmother is also a major, she will definitely appreciate this option

🟡 GigaChat is a model from Sberbank, it also works well in Russian and see the point above

2. Open models :
🟡 LLama 2 is an original open model from a well-known terrorist organization, on the basis of which over 100,500 different models have already been piled up, for which many thanks to this organization (still no one understands what prompted Mark to make this decision). The quality is not up to ChatGPT 4.

🟡 ruGPT is a pretrain from GigaChat under the MIT license. Sber had a hand here too, thanks to them. Can be used

🟡 Mistral is a model developed by people from Google in France. The quality is not up to ChatGPT 4, but on average it is better than Llama 2.

🟡 Falcon is a model developed with Arab money by Europeans. Overall, Llama 2 is weaker, and the point of using it eludes me.

🟡 Grok from X is supposedly a “based” model from Elon himself. It works so-so so far, give or take at the level of ChatGPT 3.5, but Elon promises to tear everyone to rags and there are reasons to believe him.

Model estimates currently look something like this (pictured)

✅ https://t.me/DataScienceT

👑 Llama 3 is here, with a brand new tokenizer! 🦙

Llama 3 released

Meta has released the new SOTA Llama 3 in two versions for 8B and 70B parameters.

Context length 8K, support 30 languages.

• HF : https://huggingface.co/spaces/ysharma/Chat_with_Meta_llama3_8b
• Blog : https://ai.meta.com/blog/meta-llama-3/

You can test 🦙 MetaLlama 3 70B and 🦙 Meta Llama 3 8B using the 🔥 free interface: https://llama3.replicate.dev/

✅ https://t.me/DataScienceT

📁 Explainability in Graph Neural Networks: A Taxonomic Survey

📕 Journal: IEEE Transactions on Pattern Analysis and Machine Intelligence
🗓 Publish year: 2022

🧑‍💻 Authors: Hao Yuan, Haiyang Yu, Shurui Gui, and Shuiwang Ji
🏢University: Department of Computer Science and Engineering, Texas A&M University, College Station, TX, USA

📎 Study the paper

✅ https://t.me/DataScienceT

⚡️ Graph Machine Learning

Free advanced course: Machine learning on graphs .

The course is regularly supplemented with practical problems and slides. The author Xavier Bresson is a professor at the National University of Singapore.

▪ Introduction

▪ Dive into graphs
- Lab1: Generate LFR social networks
https://github.com/xbresson/GML2023/blob/main/codes/02_Graph_Science/code01.ipynb

- Lab2: Visualize spectrum of point cloud & grid
https://github.com/xbresson/GML2023/blob/main/codes/02_Graph_Science/code02.ipynb

- Lab3/4: Graph construction for two-moon & text documents
https://github.com/xbresson/GML2023/blob/main/codes/02_Graph_Science/code03.ipynb

https://github.com/xbresson/GML2023/blob/main/codes/02_Graph_Science/code04.ipynb

▪ Graph clustering
- Lab1: k-means
https://github.com/xbresson/GML2023/blob/main/codes/03_Graph_Clustering/code01.ipynb

https://github.com/xbresson/GML2023/blob/main/codes/03_Graph_Clustering/code02.ipynb

- Lab2: Metis
https://github.com/xbresson/GML2023/blob/main/codes/03_Graph_Clustering/code03.ipynb

- Lab3/4: NCut/PCut
https://github.com/xbresson/GML2023/blob/main/codes/03_Graph_Clustering/code04.ipynb

https://github.com/xbresson/GML2023/blob/main/codes/03_Graph_Clustering/code05.ipynb

- Lab5: Louvain
https://github.com/xbresson/GML2023/blob/main/codes/03_Graph_Clustering/code06.ipynb
https://pic.twitter.com/vSXCx364pe

▪ Lectures 4 Graph SVM
- Lab1 : Standard/Linear SVM
https://github.com/xbresson/GML2023/blob/main/codes/04_Graph_SVM/code01.ipynb

- Lab2 : Soft-Margin SVM
https://github.com/xbresson/GML2023/blob/main/codes/04_Graph_SVM/code02.ipynb

- Lab3 : Kernel/Non-Linear SVM
https://github.com/xbresson/GML2023/blob/main/codes/04_Graph_SVM/code03.ipynb

- Lab4 : Graph SVM
https://github.com/xbresson/GML2023/blob/main/codes/04_Graph_SVM/code04.ipynb

Running instructions: https://storage.googleapis.com/xavierbresson/lectures/CS6208/running_notebooks.pdf

💡 Github

✅ https://t.me/DataScienceT

🦙 Fintuning Llama 3 using ORPO.

A quick guide on how to set up your new Llama 3 8B with ORPO .

I hope you will enjoy!

🤗 Model : https://huggingface.co/mlabonne/OrpoLlama-3-8B

💻 Colab : https://colab.research.google.com/drive/1eHNWg9gnaXErdAa8_mcvjMupbSS6rDvi?usp=sharing

📝 Article : https://huggingface.co/blog/mlabonne/orpo-llama-3

✅ https://t.me/DataScienceT

🦾 🦏 Power of matplotlib

This beauty can be made using matplotlib . This is a visualization of an engraving by the German artist Albrecht Dürer, depicting an Indian rhinoceros, as the artist imagined it from the descriptions and drawings available to him in 1515.

Want to learn the same thing: here's a cool free book: " Scientific Visualization: Python + Matplotlib "

The sources of the book with code examples are here .

▪ Poster
▪ Book
▪ Code from the book

✅ https://t.me/DataScienceT

🛞 6Img-to-3D driving scenarios 🛞

👮‍♀️ EPFL (+ Continental) unveils 6Img-to-3D, novel transformer-based encoder-renderer method to create 3D onbounded outdoor driving scenarios with only six pics

🥺 Review: https://shorturl.at/dZ018

🤨 Paper: arxiv.org/pdf/2404.12378.pdf

👉 Project: 6img-to-3d.github.io/

👉 Code: github.com/continental/6Img-to-3D

✅ https://t.me/DataScienceT