Semi-Conductor
Partner: Jessica Chon
What the project is:
Semi-Conductor is a virtual conducting app where arm movements yield a reaction from your virtual orchestra. It is quite fun, but there are definitely bugs, like sometimes you have to amp up for energy because some subtle movements work and get registered with the system while others yield no reaction with the virtual orchestra (Which is sad and the slightest bit annoying).
Beneficial Qualities
It goes beyond say Leap motion plus because it has more range in motion, that is even slight changes to position and angle allow for a completely different reading and hence reaction from the software.
It makes the user fully interact with the technology, which makes it “Zero-UI”. So yeah, if you get your whole body in the movement then it can yield a very clear, long response from the system which is really cool. I guess in that way it is kind of like Kinect, but just off of your webcam which makes it far more accessible than Kinect based programs.
How we would implement the tech:
Gauge the effectiveness of young conductors (conductors in training). You could train the virtual orchestra based on say a real orchestra to improve the receptiveness of the program to the movements and make it as realistic as possible.
Helpful for deaf students because you can still see the metronome and instruments moving and having a sense of control keeping tempo because of visual cues. Music is a requirement in a lot of schools, maybe this is a way to engage a population that previously just couldn’t participate because music was so reliant on one of their senses that they just didn’t have or severely lacked in.
Other simulators such as sports games/training, presentations. It would be cool to use this technology to train goal keepers in soccer, or like even batters in baseball. There is only so many situations that they can train for, but like the computer could test extreme cases to even prep them for unlikely, but match-winning potential goals/ pitches.
And then… my code for the P5 practice using transformation and display functions can be found at this link.
Hopefully this works!!! “(Maybe not, high key not sure about the whole zip-folder thing).