Skip to content

Predict whether a video is running forwards or backwards using triplet siamese CNNs in Torch

Notifications You must be signed in to change notification settings

pierrestock/time-arrow

Repository files navigation

How to see time's arrow in video sequences ?

This repo was adapted from fb.resnet.torch to the particular problem of this project. The aim is to predict whether a video is running forwards or backwards using a triplet siamese CNN.

  1. Setup

  2. References

Setup

The dataset is available here and contains 180 videos of ~200 frames each. It was split into 144 training videos and 36 test videos.

Here is a brief description of the files:

  • opts.lua All the options you can set (all have preset values and descriptions)
  • checkpoints.lua Handles checkpoints saving and retrieving
  • dataloader.lua Multi-threader dataloader
  • train.lua Handles training, test, score computation
  • main.lua Puts everything together

To start a training, simply run the following command in your favourite shell

th main.lua 

To evaluate the latest model you have trained, simply run

th main.lua -testOnly true -resume true

References

  • L. Pickup et al., Seeing the arrow of time, CVPR 2014
  • I. Misra, et al., Shuffle and Learn: Unsupervised Learning using Temporal Order Verification, ECCV 2016

About

Predict whether a video is running forwards or backwards using triplet siamese CNNs in Torch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published