Project B: CODE + [ ] Proposal

I have always wanted to do something connecting what people see and what people hear, because in real life senses are fluid, they always link in some way whether the process is conscious or unconscious. To be exact, even though the information takes different forms, there’s always something in common: the pitch of a piece of sound is high/low, and the position of a dot can be high/low on the canvas.

The project will be about translating the visual into the audio as well as translating the audio into the visual. By interacting with the interface, users will get a chance to either draw something in order to generate a piece of music, or record a piece of audio recording to form a generative art. The rules are pre-designed to ensure that the audio information could be coded into something measurable which the computer can refer to in order to generate the visual presentation; in the same way, the visual drawing on the web page will be coded according to three aspects so that a melody will be generated based on the parameters of the drawing.

After the process is done, the users will be able to click and download the art work – no matter it is an audio piece or visual piece onto the computer. 

From the audio to the visual:

 

From the visual to the audio:

 

The link to the slides: here