- DM-GY 4913-B Special Topics: Interactive Installation
Digital applications warp our notion of time, fracturing it with the ability to re-enter previous moments. How does this access shift our understanding of a particular moment, especially as we re-enter it and overwrite it? Does this create a fold or wrinkle that we can continually re-enter? How does this capability affect our memories and shape our identity? Drawing up alternate notions of time, capture/recording and playback, this workshop will be an investigation of time and space as we create interactive installations.
This project explores the creation of interactive systems using computer vision and Max/MSP/Jitter. Use Max/MSP/Jitter as the architecture to take input from the physical world and to control output through video and sound. Explore different timing, trigger and looping mechanisms that create folds in time, which we can continually access.
When we send a video recording, we are sending a former moment of our own. As the receipent watches it, they are brought into that moment, bring it into their present. As we relive these moments, they may grow larger and be filled with different meanings and understanding as time shapes us, especially as we share, augment, and manipulate these moments, pushing them farther into the future.
Input and output need to be explored, along with feedback loops, interactivity, space and control.
Techniques to consider: edge detection, frame difference, blob tracking, depth tracking, skeletal tracking
Themes covered: multi-temporality: the time that comes about through the simultaneous assemblage or re-presentation of temporally disparate information. Multi-temporality is within our interactive encounters with digital technologies, as we can recompose nonlinear information, re-experience information, and experience multiple scales of time simultaneously.
Task:
Using Max/MSP/Jitter and openCV, create an interactive experience which explores multi-temporality and memory. Develop an interactive system which explores these notions of time, creating an experience with the past and the present simultaneously.
Resource:
Temporal Experiences: Re-ordering Time and Memory Through Space - Readings Found in Slack under "resources."
-
Complete the readings and questions before the class discussion
-
Complete Max Challenges to get familar with Max
-
Gather media
-
Program a working Prototype in Max
-
Add in increasing sophistication, complexity and variation
-
Bug Squash
-
Add in increasing sophistication, complexity and variation
-
Bug Squash
-
Add in increasing sophistication, complexity and variation
-
Bug Squash
-
Test full scale version
-
Get Feedback
-
Iterate
-
Document for Portfolio
-
Post on your Process Site about the process of developing this project as well as the outcome, and code. Everything needs to be on your Process site. Put a link to your github repo, which has a repo for the project, with all of the code.