Review : Representation learning for VAD

MDPI 2018 pdf : An overview of representation learning methods for unsupervised and semi-supervised anomaly detection in videos, B Ravi Kiran, Dilip Mathew Thomas, and Ranjith Parakkal, UncannyVision.

Representation learning for reconstruction

Family of methods : Principal component analysis (PCA), Auto-Encoders (AEs, CAEs, Contractive AEs, Stacked AEs, Denoising AEs), Restricted Boltzman Machines (RBMs).

  • Learning Temporal Regularity in Video CVPR 2016 pdf

  • Energy-based Models for Video Anomaly Detection PAKDD 2017 pdf

  • Abnormal Event Detection in Videos using Spatiotemporal Autoencoder pdf

  • Anomaly Detection with Robust Deep Auto-encoders KDD 2017 pdf

  • Robust, Deep and Inductive Anomaly Detection, Robust Convolutional AE (RCVAE) 2017 pdf

  • Outlier Detection Using Replicator Neural Networks 2002 pdf


Related Work :

  • Contractive Auto-Encoders pdf, talk,

  • C3D pdf, ’

  • NADE pdf,

  • MADE pdf,

  • Deep AutoRegressive Networks 2014 pdf

Predictive modeling : Video as temporal patterns

Family of methods : Linear Models, Convolutional LSTMs, CNN-LSTMs :

  • Anomaly Detection in Video Using Predictive Convolutional LSTM Networks Dec 2016 pdf

  • DeepAnomaly: Combining BG Sub. & Deep Learning for Anomalies 2016 pdf

  • Video anomaly detection using deep incremental slow feature analysis network link


Related Work :

  • Adversarial LSTM Networks CVPR 2017,

  • Video Representations using LSTMs : pdf Slides,

  • Deep multi-scale video prediction pdf,

  • ST-video autoencoder with differentiable memory pdf, Slides,

  • CortexNet: Robust Visual Temporal Representations pdf

  • PredNet: Deep Predictive Coding Networks pdf, project,

  • Video prediction papers : pdf, pdf, pdf, IncSFA pdf.

Generative Models

Family of methods : Variational Autoencoders(VAEs), Generative Adversarial Networks(GANs), Adversarial Auto-Encoders(AAEs)

  • Variational Autoencoder based Anomaly Detection using Reconstruction Probability TR2015 pdf

  • Training Adversarial Discriminators for Cross-channel Abnormal Events Jun 2017 pdf

  • Adversarial Autoencoders for Anomalous Event Detection in Images Thesis

  • Unsupervised Anomaly Detection with GANs to Guide Marker Discovery pdf


Related Work

  • VAE: Auto-Encoding Variational Bayes pdf,Tut,

  • Split-Brain Autoencoders CVPR2017,

  • GANs pdfNIPS Workshop,

  • BiGAN pdf, Adversarial Autoencoders (AAEs) pdf,

  • InfoGAN pdf, McGan pdf

  • Recursive estimation of generative video models pdf

Other models

  • Spatio-Temporal Multiresolution Model for VAD pdf, Thesis,

  • Temporal Multi-Scale Models for Flow and Acceleration pdf

Established Arch. for unsupervised video tasks

  • Early, Late, Slow Fusion pdf,

  • Two-Stream CNNs pdf,

  • Disentangled Representations from Video DRnet,

  • Video and unsupervised Learning CS231, Slides,

  • Activity Recognition and Unsupervised Learning slides

Video anomaly detection evaluation : ROC Curves and EER pdf, link

Other Applications: Detecting Events by Density Ratio Estimation pdf, Video Behavior Profiling for AD pdf

Video Anomlay Detection Datasets:

  • UCSD Ped : link,

  • CUHK-Avenue Dataset link

  • Subway Entry & exit link

  • Idiap Traffic Junction dataset link

  • UMN Dataset link

Other datasets (action recognition, surveillance):

  • PETS 2016 link,

  • MIT Traffic dataset link (for ped detection),

  • Human activity recongnition link ,

  • Extracting Temporal Motifs link ,

  • HMDB:link,

  • UCF101 link,

  • VIRAT link, paper,

  • A collection of datasets available at V.Nagarajans site link,<br />

VAD with Hand engineered features

  • Anomaly Detection in Crowded Scenes (mixture of dynamic textures) pdf, PAMI 2014 video

  • Optical Acceleration for Motion Description in Videos pdf

  • On the Essence of Unsupervised Detection of Anomalous Motion 2017 pdf

  • Discriminative FWK for AD in Videos pdf, Abnormal Event Detection at 150 FPS 2013 pdf

  • Real-Time Anomaly Detection and Localization in Crowded Scenes 2015 pdf

  • Video Anomaly Detection Hierarchical Feature Representation 2015 pdf

  • Localized Anomaly Detection via Hierarchical Integrated Activity Discovery 2013 pdf

  • Histograms of OF Orientation and Magnitude to Detect Anomalous Events in Videos pdf

  • VAD Based on Local Statistical Aggregates pdf, AD Using Dense Trajectories pdf

  • Online Detection of Unusual Events in Videos via Dynamic Sparse Coding CVPR 2011 pdf

  • Textures of Optical Flow for Real-Time AD pdf, AD with Bayesian Nonparametrics 2016 pdf

  • Topic Models for Scene Analysis and Abnormality Detection 2009 ICCV-VS WKSHpPpdf, Talk 2015

  • Learning Object Motion Patterns for Anomaly & Improved Object Detection 2008 CVPR pdf

  • Analysis of Persistent Motion Patterns Using the 3D Structure Tensor 200