Data Science Engineering
13 subscribers
69 photos
12 videos
23 files
639 links
Machine Learning, Data Science, Engineering, Programming.
Download Telegram
Forwarded from Machinelearning
DeText: A Deep Neural Text Understanding Framework

DeText can be applied to many tasks, including search & recommendation ranking, multi-class classification and query understanding tasks.

Github: https://github.com/linkedin/detext

Paper: https://arxiv.org/abs/2008.02460v1

@ai_machinelearning_big_data
Forwarded from Graph Machine Learning
DeepMind's Traffic Prediction with Advanced Graph Neural Networks

A new blog post by DeepMind has been released recently that describes how you can apply GNN for travel time predictions. There are not many details about the model itself (which makes me wonder if deep net trained across all supersegments would suffice), but there are curious details about training.

1. As the road network is huge I suppose, they use sampling sampling of subgraphs in proportion to traffic density. This should be similar to GraphSAGE-like approaches.

2. Sampled subgraphs can vary a lot in a single batch. So they use RL to select subgraph properly. I guess it's some form of imitation learning that selects graphs in a batch based on some objective value.

3. They use MetaGradients algorithm to select a learning rate, which was previously used to parametrize returns in RL. I guess it parametrizes learning rate instead in this blog post.
https://dafriedman97.github.io/mlbook/content/table_of_contents.html

And The list of Most Updated and Free Artificial Intelligence, Machine Learning, Data Science, Deep Learning, Mathematics, Python Programming Resources. (Last Update: Sept 9, 2020):

https://www.marktechpost.com/free-resources/?fbclid=IwAR0hc2qkxPMXhQGzsg07ffgFecRr01tSCRqlhb_XMR6PjPt1KNdy68cLy9w
Forwarded from Gadget and device News 🗞️
This media is not supported in your browser
VIEW IN TELEGRAM
St Petersburg, Russia, 75 year after Victory in WWII celebration. Drone show
​​pytorch lightning bolts
from linear, logistic regression on tpu-s to pre-trained gan-s

plb – is a collection of pytorch lightning implementations of popular models that are well tested and optimized for speed on multiple gpu-s and tpu-s

it is a new community built dl research and production toolbox, featuring a collection of well established and sota models and components, pre-trained weights, callbacks, loss functions, data sets, and data modules

everything is implemented in lightning and tested benchmarked, documented, and works on cpu-s, tpu-s, gpu-s, and 16-bit precision

more u can read at the blog post


github: https://github.com/PyTorchLightning/pytorch-lightning-bolts

#pytorchlightning #bolts #multiple
Forwarded from Binary Tree
This media is not supported in your browser
VIEW IN TELEGRAM
TensorBoard is a tool for providing the measurements and visualizations needed during the machine learning workflow. It enables tracking experiment metrics like loss and accuracy, visualizing the model graph, projecting embeddings to a lower dimensional space, and much more.

#ts, #python, #tensorflow, #machine, #learning, #visualization
Forwarded from Machinelearning
Understanding the Role of Individual Units in a Deep Neural Network

Examine two types of networks that contain interpretable units: networks trained to classify images of scenes, and networks trained to synthesize images of scenes.

https://dissect.csail.mit.edu/

Github: https://github.com/davidbau/dissect

Website: https://www.pnas.org/content/early/2020/08/31/1907375117

Paper: https://arxiv.org/pdf/2009.05041.pdf