• Skip to main content
  • Skip to primary sidebar

Celia's Documentation Blog

NYU Shanghai IMA

Recitation 10: Media & Controls by Celia Forster

May 3, 2021 by Celia Forster Leave a Comment

In this recitation, I built off of previous abilities to connect Arduino and Processing by implementing visual and audio functions. The first exercise was to use the Arduino to Processing reference code to use a physical controller to manipulate the display of some media on Processing. I chose to use a potentiometer to control how clear an image would appear. At first, I tried using some reference code from the previous in-class work, but it was not working properly. The potentiometer seemed to not be sending the values to Processing, so I decided to re-write the code and try again. Using the blur filter, it began working, where the photo would become more or less blurry depending on the position of the potentiometer. A video is shown below:

https://wp.nyu.edu/nyushanghai-celiaforster/wp-content/uploads/sites/19366/2021/05/WeChat_20210502170011.mp4

The second exercise was to use the Processing to Arduino reference code and make a servo motor move according to input from the microphone. I struggled for a while, trying to get the microphone input to send from Processing to Arduino. I found that I could use the map function and the sample code for audio analysis. A video is shown below. I was running out of time, so it was hard to tell how accurate it was. But as people were speaking around me, the servo motor was moving according to the volume.

https://wp.nyu.edu/nyushanghai-celiaforster/wp-content/uploads/sites/19366/2021/05/WeChat_20210502170046.mp4

In “Computer Vision for Artists and Designers”, the author discusses various ways in which human-computer interaction can be created in the world of art. Some interactive technological art installations are introduced, with many requiring the movement of the human body, which is tracked by a digital program. One of these that is particularly interesting is Rafael Lozano­ Hemmer’s Standards and Double Standards (2004). It features belts hanging from the ceiling which turn with servo motors towards the user walking through the room. Although pieces like these are on a much larger scale than those made in class, I see the connection between the two. Similar to those mentioned in this article, the recitation features human-computer interaction when physical devices act according to movements or sounds made by the user, and conversely the movement of a physical device manipulating an image or sound.  

Filed Under: Interaction Lab

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Archive

Course

  • After Us: Posthuman Media (6)
  • Communications Lab (14)
  • Interaction Lab (22)
  • Working with Electrons (9)

Recent Posts

  • Final Project PART FOUR: Documentation May 16, 2021
  • Final Project: Individual Reflection May 16, 2021
  • 05.04.2021 In-Class Exercise: Pixels! May 5, 2021
  • Interaction Lab Final Project: Progress Entry #1 May 5, 2021
  • Final Project: Progress Entry #2 May 5, 2021

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Copyright © 2025 · News Pro on Genesis Framework · WordPress · Log in