“I am sensitive of sounds” | Mid-term Project |Eric

Bella

(Project Picture Link: )

INTRODUCTION

-What Is Interaction？

I believe interaction is the transmission and extension of information between individuals and their creations. I prefer works that engage the senses, allowing me to tangibly perceive the presence of interaction.

In my previous research assignment, I introduced a projector that transforms hand shadows into narratives.

Here is the link of the projector: 

Narratron – Shadow play with a storytelling AI


This device captures patterns of hand shadows, inspiring a form of sensory input in an interactive manner. Thus, for the midterm assignment, I aim to convert audio-input information into visual patterns.

This device is capable of capturing patterns of hand shadows, providing a sensory input that inspired me in a way of sensory communication. Therefore, for the midterm assignment, I aim to convert audio-input information into visual patterns.

-My project

This device is applied to the volume alert system next to study seats in the library. Its uniqueness lies in its anthropomorphic setting, where I liken the device to a “person” sensitive to volume. As the surrounding volume increases, its heartbeat accelerates, and the heartbeat color changes from yellow to red, and then to purple. When the volume exceeds a certain threshold, the nearby red LED will illuminate, signaling the user to lower the volume.

Picture Link: https://drive.google.com/file/d/1kdG0M4mt8vCrbsscZ1YpfwOrriTE6kvx/view?usp=sharing

This project targets students studying in the library or those interested in interaction design. It promises to be an interesting and practical device.

Picture Link: 
https://drive.google.com/file/d/1fTowWsQB_aO-OQeJ-fTGzHIrKuYfO0pq/view?usp=drive_link
https://drive.google.com/file/d/10dYE9tn9BYbQmwIxTBFkbyPMDAEPXc56/view?usp=drive_link

 

CONCEPTION AND DESIGN

I believe interaction is the transmission and extension of information between individuals and their creations. I prefer works that engage the senses, allowing me to tangibly perceive the presence of interaction.

With this initial direction in mind, I began to contemplate how to apply it to practical scenarios. My initial concept was to visualize the rhythm of a button, converting it into a combination of LED bulbs that could alter rhythm and bounce up and down, thereby achieving a transformation from tactile to visual sensation.

However, due to the high level of complexity in coding and circuitry, I decided to change my approach. I kept the LED as the material but replaced several individual LED bulbs with an LED strip. The bouncing motion was transformed into variations in LED illumination speed and color.

Picture Link: https://drive.google.com/file/d/1WChOsFlpl0hStPzFQfuBBZfaXMyBLZ8-/view?usp=drive_link

I replaced the button with a more interactive sound sensor to enhance the fun element.

Picture Link: https://drive.google.com/file/d/19sH343grpwtzxZPdBbRhACpRcxaHSSTO/view?usp=drive_link

The LED strip’s illumination speed is ideal for displaying an electrocardiogram, and the LED strip is the most suitable material.

Picture Link: https://drive.google.com/file/d/19Es-IuA3qttsmI2wPh9ZcWIneJMhHteX/view?usp=drive_link

With this, I formed the concept for the final piece.

FABRICATION AND PRODUCTION

Video Link: https://drive.google.com/file/d/1LgPy5cNcEUZAK4zKvbobhcI5GZDeqHnf/view?usp=drive_link

-Key Steps:

1. We initially spent an entire afternoon soldering the connections between the LED bulbs and the long wires to match the original presentation of the 16 LEDs. Later, we abandoned the individual LED bulbs in favor of an LED strip. 
   1. 1. Picture Link: https://drive.google.com/file/d/1YO1pNGZ19d3aoFSvzS3Gle5xej6_3Si8/view?usp=drive_link
2.  The design of the electrocardiogram (ECG) appearance was also a challenge. The ECG lines needed to be fine enough to achieve a perfect effect, so carving the cardboard took a long time. Additionally, the LED strip needed to be concealed to create an effect where only the light changes were visible without revealing the specific material. Therefore, multiple layers of frosted plastic film had to be applied to the back of the cardboard. Finally, the ECG trajectory was constructed with stiff cardboard on the plastic film to facilitate sharp turns for the flexible LED strip to fix in place.
   1. 1. Picture Link: https://drive.google.com/file/d/1mXUcOMqwrJMJrxG7-pAS5BzCCbrgEXck/view?usp=drive_link
3.  The most complex part of the entire circuit was the programming.
   1. Our idea was to have a sound sensor control the speed at which each individual bulb in the LED strip lights up. However, both the LED strip and the sound sensor were unfamiliar devices, requiring a significant amount of time to consult websites. Additionally, both the sound sensor’s loop and the LED strip’s loop included “delay()” functions, resulting in a severe delay between the input values and the output of the LED strip.
   2. The values from the sound sensor were highly unstable. When the ambient volume was high, there would be a noticeable peak in the values, but immediately after, they would drop to lower numbers. They did not stay consistently high, which severely affected the final effect.
   3. During the modification after user testing, due to the introduction of color changes and the fact that the bulbs had different lighting speeds in each cycle, all the code needed to be rearranged, which took a considerable amount of time.

-My Roles:

1. Conceiving the overall idea and adjusting it based on feedback.
2. Designing the device image and making adjustments.
3. Selecting materials.
4. Connecting the circuit.
5. Designing the appearance of the device.
6.  Programming.
7. Assigning tasks and organizing the team.

-Adjustments after user testing:

1. Changed the LED strip’s cycle lighting speed variation to variation in lighting speed among adjacent LEDs within the strip.
2. Changed the single red color of the LED strip to color changes based on speed.
   Planned to change the volume reduction prompt from flashing LEDs to a raised sign (not completed due to time constraints).

CONCLUSIONS

This project is very interesting, as it vividly illustrates my understanding of interaction while also being practical. However, judging from the audience’s feedback, the interaction method is too simplistic and lacks excitement. This is an area I need to improve upon. Additionally, due to certain bugs in the device itself, the presentation effect did not meet expectations. If there were more time, I would refine the programming, enhance the device’s visual design, and complete the program for the raised sign. Throughout the entire process, I felt the pressure of repeatedly overturning ideas in the creation of the piece, but this is also where the joy of creating lies. Witnessing one’s own ideas gradually come to life is a source of great happiness.