DeepLearning ru:
Clockwork Convnets for Video Semantic Segmentation.

Adaptive video processing by incorporating data-driven clocks.

We define a novel family of "clockwork" convnets driven by fixed or adaptive clock signals that schedule the processing of different layers at different update rates according to their semantic stability. We design a pipeline schedule to reduce latency for real-time recognition and a fixed-rate schedule to reduce overall computation. Finally, we extend clockwork scheduling to adaptive video processing by incorporating data-driven clocks that can be tuned on unlabeled video.

https://arxiv.org/pdf/1608.03609v1.pdf
https://github.com/shelhamer/clockwork-fcn

http://www.gitxiv.com/posts/89zR7ATtd729JEJAg/clockwork-convnets-for-video-semantic-segmentation

#dl #CV #Caffe #video #Segmentation

Deep Bilateral Learning for Real-Time Image Enhancement

Video about image auto-enhancing with neural networks.

https://www.youtube.com/watch?v=GAe0qKKQY_I

#cv #dl #autoenhance #mit #youtube #video

STMVis - Visual Analysis for Recurrent Neural Networks

LSTMVis a visual analysis tool for recurrent neural networks with a focus on understanding these hidden state dynamics. The tool allows a user to select a hypothesis input range to focus on local state changes, to match these states changes to similar patterns in a large data set, and to align these results with structural annotations from their domain. We provide data for the tool to analyze specific hidden state properties on dataset containing nesting, phrase structure, and chord progressions, and demonstrate how the tool can be used to isolate patterns for further statistical analysis.

http://lstm.seas.harvard.edu/

#harvard #video #dl #rnn

Architecture for real-time scene annotation (BlitzNet)


http://thoth.inrialpes.fr/research/blitznet/

ArxiV: https://arxiv.org/abs/1708.02813
GitHub: https://github.com/dvornikita/blitznet

#ICCV #github #dl #video

A cool paper from Facebook AI (not from FAIR!) about detecting and reading text in images, at scale. 

This is very useful for detecting inappropriate content on Facebook.

The system uses R-CNN/Detectron for detecting lines of text.

The OCR uses a ConvNet applied at the level of a whole line trained with CTC.

This concept of applying a ConvNet on a whole line of text, without prior segmentation, has roots in the early days of ConvNets, for example with this NIPS 1992 paper:
"Multi-Digit Recognition Using a Space Displacement Neural Network"
by Ofer Matan, Chris Burges, Yann LeCun and John Denker.

Link: https://papers.nips.cc/paper/557-multi-digit-recognition-using-a-space-displacement-neural-network
Youtuve video with short explanation: https://youtu.be/yl3P2tYewVg

#ocr #cv #dl #rnn #facebook #yannlecun #video

#MIT recent release for video labeling

Youtube: https://www.youtube.com/watch?v=JBwSk6nJOyM&feature=youtu.be
Github: https://github.com/metalbubble/TRN-pytorch

#dl #video

🎓 Free «Advanced Deep Learning and Reinforcement Learning» course.

#DeepMind researchers have released video recordings of lectures from «Advanced Deep Learning and Reinforcement Learning» a course on deep RL taught at #UCL earlier this year.

YouTube Playlist: https://www.youtube.com/playlist?list=PLqYmG7hTraZDNJre23vqCGIVpfZ_K2RZs

#course #video #RL #DL

​​Large-Scale Object Mining for Object Discovery from Unlabeled Video

Paper about process of object discovery.

Link: https://arxiv.org/abs/1903.00362

#Video #DL #CV

​​Google announced the updated YouTube-8M dataset

Updated set now includes a subset with verified 5-s segment level labels, along with the 3rd Large-Scale Video Understanding Challenge and Workshop at #ICCV19.

Link: https://ai.googleblog.com/2019/06/announcing-youtube-8m-segments-dataset.html

#Google #YouTube #CV #DL #Video #dataset

​​A #GauGAN timelapse video as a demo for landscape generation

Link: https://www.nvidia.com/en-us/research/ai-playground/

#GAN #Video #Nvidia

Videos from ICML 2019 conference

Link: https://icml.cc/Conferences/2019/Videos

#ICML2019 #video

​​Simultaneous food and facial recognition at a Foxconn factory canteen, Shenzhen China

#video #foodlearning #facerecogniction #dl #cv #foxconn

Facebook open sourced video alignment algorithms that detect identical and near identical videos to build more robust defenses against harmful visual content.

Project page: https://newsroom.fb.com/news/2019/08/open-source-photo-video-matching/
Code: https://github.com/facebookresearch/videoalignment

#Facebook #video #cv #dl

Deep Fake Challenge by Facebook team

#Facebook launches a competition to fight deep fakes. Unfortunately, results of this competition will be obviously used to create better fakes, to the cheers of the people, wishing to watch the Matrix with Bruce Lee or more questionable deep fake applications.

Link: https://ai.facebook.com/blog/deepfake-detection-challenge/

#deepfake #video #cv #dl

​​FSGAN: Subject Agnostic Face Swapping and Reenactment

New paper on #DeepFakes creation

YouTube demo: https://www.youtube.com/watch?v=duo-tHbSdMk
Link: https://nirkin.com/fsgan/
ArXiV: https://arxiv.org/pdf/1908.05932.pdf

#FaceSwap #DL #Video #CV

​​📹How Tesla self-driving AI sees the world

#Tesla #selfdriving #cv #dl #video #Autonomous #video