Skip to content

Latest commit

 

History

History
51 lines (37 loc) · 2.1 KB

README.md

File metadata and controls

51 lines (37 loc) · 2.1 KB
Raw

Gazing at Social Interactions Between Foraging and Decision Theory

Alessandro D'Amelio¹, Giuseppe Boccignone¹
¹ PHuSe Lab - Dipartimento di Informatica, Università degli Studi di Milano

Paper D'Amelio, A., & Boccignone, G. (2021). Gazing at social interactions between foraging and decision theory. Frontiers in Neurorobotics, 15, 31.

simulation

Requirements

pip install -r requirements.txt

Executing the demo

To simulate from the model:

  1. Do speaker identification and build face maps:
#sh build_face_maps.sh path/to/video vidName path/to/output
sh build_face_maps.sh data/videos/012.mp4 012 speaker_detect/output/
  1. Run the follwing command (it is assumed that low-level saliency maps (see Credits) are already computed, if you want to compute it on your own, you may want to use something like this)
python3 start_simulation.py

Credits

  • Data: FindWhoToLookAt --->Repo, Paper

  • Speaker Detection Pipeline: SyncNet ---> Repo, Paper

  • Space-time Visual Saliency Detection: Code, Paper

Reference

If you use this code, please cite the paper:

@article{d2021gazing,
  title={Gazing at social interactions between foraging and decision theory},
  author={D'Amelio, Alessandro and Boccignone, Giuseppe},
  journal={Frontiers in Neurorobotics},
  volume={15},
  pages={31},
  year={2021},
  publisher={Frontiers}
}