Audio Performance Concept

I and Jun meet with each other and make a rough plan of what we are going to build for the audio performance. Our idea is to use the OpenCV as the input. I remembered we used it in one of the classes and I am sure that we could use it to track something. In this way, we have a continuously changing value as we move along in front of the camera serving as one of the inputs. Another one might be the velocity. By velocity, my current idea is that since Max constructs the video by frames, it’s possible for us to calculate the distance between the current position of the objects that we are tracking and the position of it from the last frame. In this way, it’s a parameter describing how intense the movement and the change are.

Since the dominating input will be the position, so the most likely case for us is to split the video into different parts and set borders between them. When the object crosses a border, what we expect to see is a transition in audio triggering. In other words, the position determines what kinds of audio we’ll be playing and manipulating. While the velocity mentioned above could serve as the parameter controlling the time stretch and other real-time manipulating audio parameters.

I think we are going to build a narrative around it. The current idea is that we hold something fighting against each other, triggering different kinds of weapon sounds and the ambient background audio effect. For me, my personal inspiration for this topic is that several days ago, a man is shot near Union Square. (I live right across the street from Union Square) So it symbolizes the anti-violence action and the desire of people to get along well with each other. 

Our plan is to build the OpenCV part this weekend and see how we can fit different audio files and real-time recordings into the position. And next week, we will try our best to figure out how to calculate the velocity. It seems programming and mathematically heavy for that one, so it might take a lot of time working on it. Next weekend, we are going to build a framework for the narrative and finalize the audio manipulation.