Turn Down For What-Game box of altering elements-Ning Zhou-Rudi

CONTEXT AND SIGNIFICANCE

For our previous group project, we simply came up with the issue that almost everyone would face in their everyday life. But it turned out to be harder than we expected to actually create a practical project that can be applied in our life nowadays. It’s typical of me to fantasize things and later realize how difficult it could be to achieve that. Therefore, instead of making something useful, we chose to create something interesting and entertaining. For the projects and interactions that I’ve researched, such as the waves, and the pavement, they detect and receive alternative input, and conduct output which can be observed by various sense organs. I am into the part of how the devices detect the tiny change in the air and something that easily ignored by us, which also in some way triggered my understanding of interaction. So my definition of interaction is a series of movements that two or more actors respond to the changes or movements made by others. It would be really great if we could apply this point of various inputs in our project but I found it hard, because at that time, the most complicated sensors we’ve encountered were distant sensor and moisture sensor. Since it is a bit out of our ability to make the input “alternative”, we tried to make a difference in our project’s outputs. About the unique about the project, it should be the contrast between the Chinese traditional music GaoShanLiuShui and the urban modern night life atmosphere. Since the user can freely combine different components simultaneously, there’re lots of possible combos that can bring various surprising experience. Our project is not intended for specific group of people, but for anyone who wants to have fun with new things and is full of curiosity. Our project provides fresh experience and unknown possibilities for audiences so that these groups of people with certain characteristics may be more interested.

CONCEPTION AND DESIGN:

In order to sharpen the contrast and make the users more impressive about the outputs, we adopted one of the most famous traditional Chinese instrumental music, which is smooth and peaceful. Also, we can see the cultural strike from the mix of different components. Another decision we made was that we changed the place where the buttons are set. At the user test, we were told that if the buttons are set at the front, it would be uncomfortable for users to push them. So, in order to make it more comfortable and natural for users to interact with he device, we put the buttons at the both left and right sides of the box. When considering about the DJ, we felt like that it would be more active and give users a stronger sense of interaction if they can control the move of the DJ according to the music they play. So we use the servo potentiometer control circuit to make it possible. We used wooden material for the box as the base, paper as small figures appeared on the stage, LEDs in our kits as lights, stereo enclosed speakers as sound boxes, and Arduinos and a lot of other components for the circuits. The wooden material for laser cut looks good especially with some signs we drawn on the surface. It can also helped to hide the cables and the mess of circuits inside of the box, while the transparent one is not good at that. Other colors of materials are too bright and are not fit to the actual general atmosphere we wanted to created. We chose paper to make the figures first because we have easy access to that. We can draw on that for as much time as we want until our ideas are all satisfied. The contrast between the wooden box, LEDs and the paper figures surprisingly created a fresh experience. We could have used 3D printing or laser cutting to make the figures. But in those ways could make them a bit stiff. One thing that out of our expectation is the stereo enclosed speakers. We first chose it because it have larger memories and can create louder sounds. Later we found that they looked really nice on the stage, just like two big sound boxes, which made our stage more real. We didn’t really have any other choice for speaker because the resources were limited and we have high requirements about this component.

user testing video:

FABRICATION AND PRODUCTION:

We encountered so many problems, difficulties, weird errors during the production process. I felt like we have got to known every faculty in IMA through turning to them for help. One major problem is how to apply our music into the project. We searched online and asked for many suggestions. At last, we found one possible solution on Youtube in which the guy teaches how to transform the audio into code to play MP3 audio with Arduino.

But new problems occurs when this one was solved. It turned out that the speaker and the servo cannot be connected and work together because there’re certain fixed codes set up in their libraries which cannot be changed. Also, two speakers are not able to be connected in one Arduino because of the pin issue and the Arduino’s limited memory. Hence, if we wanted to make the DJ move by servo, we needed the third Arduino. At that time, we didn’t think about the function that Arduino can remember and run the code that is latest uploaded so we first gave up the idea of getting three Aduinos. But at last we realized the neglect and used three Arduinos in the project. Motors became the nightmare after the production process of our project. What we first thought was to make figures moving with motors and gears. Later we changed our idea into making series devices with motors as I saw the examples on Marcela’s slides because the gears were a bit out of our ability. However, after several trails and the same times of failures, the devices didn’t work as the way I wanted. Probably because of the material, the joints or the motor’s power. So, at last, we just adapted the basic movement of motor to let it rotate. We did met some problems about coding, especially when it came to the function of button to control different components. But we successfully overcame all these with the help of fellows and the samples listed by Arduino app and the former Youtube video about MP3 audio I mentioned before. During the User Testing Session, as I mentioned before, Leon gave us suggestion on the button. Many users seemed to be interested in the concept of dancing DJ and people so we later spent more time on these parts. Also, our box was not very stable at that time and the cables were hard to reach from the Arduino to the power source through the small holes. We did laser cut another time after that to make a bigger box with bigger holes. In addition, we added some signs and the name of our project on the front side of the box to make it more interesting and attractive for users.

project1
project2
project3
circuits
box
code1 for LEDs and speaker1
code2 for LEDs and speaker1

CONCLUSIONS:

Our project’s goal is simply to bring fun to users and a fresh experience by simulating daily scenes and creating contrasts. Our project results align with my definition of interaction because it can react to a series of movements and changes made by the users. In addition, it provides various outcomes from different aspects of human sensors.  However, the project results not align with my definition in some ways as well. The major problem is that it can not detect the tiny difference or changes made by the users(which could be made unconsciously) during the communication process. Beyond my expectation, my audiences were more excited and interested to have fun with our project. Because we only used the buttons for them to control the elements so basically the audience just pushed different buttons or rotated the potentiometer. Some may surprised by the combo of the music, light and movement and danced to the music. I really appreciated this kind of interaction because the emotional reactions are the realest. If I had more time, I would definitely make the light above the ground of the stage as we were suggested on the user testing session to make the scene more real. Also, I’ll spend more time on figure production and probably change the DJ into an EeHu player. If there will be more time, I’ll still try to build the series movements of the motors though I’ve failed many times on that. From our setbacks and failures, I learnt that it was really not a shameful thing or embarrassment to ask for help. Some small details such as the connection of power and ground should be paid enough to as well. But we also met some problems that could hardly be solved, such as the library conflict. Therefore, it is important to know when o give up the idea and try to think in another way to find the solution. From our accomplishments, I recognized the importance of “peer review” and being patient. For many times, the circuits just stopped working when they still worked well on the same day sometime before. It was frustrating to check the circuits and the codes over multiple times. Luckily, we could always find out the problems through checking in turns with patience. After the project, I felt like there are really a lot things ignored by us whether unconsciously or not. It comes from my definition of interaction and the production process of the project. These small changes can actually be the reflection of certain things, such as one’s emotional changes. If we can pay more attention to these and adjust ourselves accordingly, we can build more harmonious relationships and more interesting efficient communications with others. Also, by doing that, it is likely that we can receive new unexpected outcomes. For instance, the combination of traditional music and urban modern style. So it could be more than seeking fresh experience and exploring new things, but also about breaking old mindset. There’re tons of possibilities out there in our lives, and why shouldn’t we care about that to make our lives a happier one?

Recitation 4: Drawing Machines by Ning Zhou

components:

For step1 and 2:

1 * 42STH33-0404AC stepper motor
1 * SN754410NE ic chip
1 * power jack
1 * 12 VDC power supply
1 * Arduino kit and its contents

For step3 :

2 * Laser-cut short arms
2 * Laser-cut long arms
1* Laser-cut motor holder
2 * 3D printed motor coupling
5 * Paper Fasteners
1 * Pen that fits the laser-cut mechanisms
Paper

Step 1: Build the circuit

schematic1

Process: This circuit could be one of the most complicated ones I’ve faced with. And I was actually quite stressful when building  it, especially after hearing that we would work with higher voltages this time, which means I will put my Arduino and my laptop in danger in some ways. I built my circuit according to the schematic given and plugged it to my laptop. Then the screen of my laptop turned all black. I was completely shocked and so scared that if I burnt my laptop. Luckily, I restarted the laptop and it still worked. I referred to my partner’s circuit and found out that I connected the voltage and ground incorrectly. Then I checked the connection of the circuit and tried to run the code again. But the port could not be found anymore. I met this problem before so I reopened Arduino. Unfortunately, it didn’t work this time. I turned to Young and he pointed out that maybe I burn the Arduino. OK I really didn’t want to admit this but the circuit worked with another Arduino I borrowed from EC. 

Step 2: Control rotation with a potentiometer

Process: Because we only need to add a potentiometer to the circuit, so this step is not hard. I referred to the guidance of the connection of potentiometer and ran the code after modifying the number and using the function “map()”. In order to make the output more obvious, I got some tape from Marcela.

Step 3: Build a Drawing Machine!

Process: I paired up with Amily and successfully built a drawing machine on our own. One small problem id that the machine was not stable enough and sometimes couldn’t exactly draw on the paper because of the height between the pen and paper was changing. We tried to add something under the paper to make it more balanced. The machine was quite energetic and didn’t listen to us. Both of us had no idea what was drawn but it looked artistic.

Question 1:

What kind of machines would you be interested in building?Add a reflection about the use of actuators, the digital manipulation of art, and the creative process to your blog post.

I think I would be interested in building a machine which can monitor how individual spend their time in daily life and help to make better plans for their lives accordingly. I feel like these days, more and more people tend to be restricted by their work and study. They seldom have time to explore and  develop their hobbies and specialty. I think this is a big problem. So the machines I want to build can follow the user’s daily routine, have the user to complete some surveys and help to discover the user’s potential ability and interests. I’m not sure about the exact meaning of the use of actuators here. But I assume that the machine is based on the data it collects and does the analysis by artificial technology. Every action taken by the user is the raw data for the machine and it could also be the motive. The digital manipulation pf art is really amazing. Though I’m not good at it. It can basically turn anything in your head into something real. So I feel like that the idea is important, but also the skills in the digital manipulation of art. In any project, one of the key steps is to come up with the creative idea. I believe that a good useful machine’s birth corresponds to a real problem exists in our life. So being creative and trying to figure out a new way to solve it is important.

Question 2:

Choose an art installation mentioned in the reading ART + Science NOW, Stephen Wilson (Kinetics chapter). Post your thoughts about it and make a comparison with the work you did during this recitation. How do you think that the artist selected those specific actuators for his project?

About the art installation Waves, I find that there’s something similar to the drawing machine we did in the recitation. They are both devices that can respond to people’s action. Although we can use the potentiometer or change the state of stillness or chaotic, their reactions and movements are not controlled by us. This is one of the most interesting parts that they attract me. The unknown implies countless possibilities. People’s states of stillness or chaotic are the actuators for the projects. this is the small thing that we seldom care about in our daily life. The artist catches this detail and enlarges it. This can bring people a fresh experience.

Group Project by Ning Zhou

Recitation 4: Group Project by Ning Zhou

My definition of interaction:

Interaction is the action that at least two actors respond to each other after receiving and thinking over the messages conveyed by others and build efficient mutual communications.

Project examples:

1.

Volume – Interactive cube of responsive mirrors that redirects light and sound

It is said that “the installation was inspired by the ability of light and sound to form space through reflection and their dependence on atmosphere. Although we often consider this space empty, the air around us is a material made of many particles. Small changes in this volume of transparent material allows light and sound to move through space. ” The mirror can catch the tiny changes that take place in the air and react to it. This is the part that I am amazed with. It is challenging what we see and the way we think about the things that surround us. So, here for this design, I think the most important part is the process of “listening”. According to Crawford’s work The Art of Interactive Design, interaction has three subtasks: listening, thinking and speaking. These three concepts are the fundamental of my definition of interaction. After knowing more about this project, I felt like the listening part plays an essential role in an efficient interactive communication because only through carefully observation and “listening” can the messages from the other actor can be clearly heard and understood. 

2. 

https://www.creativeapplications.net/maxmsp/playin-the-pavement-daily-tous-les-jours-mesa-musical-shadows/

This project senses the shadow and plays music according to the different periods of time in the day. Compared to the project of volume which senses the tiny changes in the air, the pavement’s actions seem to be more obvious and straightforward for us. Here I think that the pavement’s approach aligns better to the definition than the volume. Because the changes in the air are caused by the changes of people’s excitement which is usually unconscious and by nature. So under the circumstance, people normally do not intend to have the interaction with the device if they are not told before. So not until the device responds to people’s actions and people notice the reaction is the interaction structure complete. People, as the other side of the actor, should also be part of the process and are aware of the other actor’s listening, thinking and speaking process. As for the pavement, people are mostly conscious about what they are doing with it and intend to step on to see what will happen. Hence, the two or more actors should be emphasized simultaneously in interaction. An efficient mutual communication requires actors to be clear of the interaction relationship between them and express themselves.

About our own project, Serene first came up with the idea of designing a bed which can help waking people up in the morning. Because it is the problem that she is suffering from, also us and a lot of other people. So we agreed on this and started to think about what kind of interactions can be made between a bed and the user. After reading about the two projects and some articles, I felt like it is important to let the user reach out to the bed and make he/she heard and understood by the bed so that the interaction between the user and bed could be complete and efficient. There’re several examples I’ve seen before which are beds with various functions, such as bumping the user up, spraying water, or making noises to wake up the user. But all these are basically done by the bed itself. The user, as the other actor in the interaction is does not show the process of “listening”,”thinking” and “thinking”. Hence, I suggested adding some new functions to our bed to make it more interactive. The first thing we thought about is an AI assistant like Siri. So “Moss”(we used the name of the AI system from the Chinese science fiction film The Wandering Earth) was born. I think that this can be one of the most efficient ways to built interaction between the bed and the user. The user’s needs can be clearly illustrated and passed to the bed. Another thing is that Moss would try to persuade the user and argue with the user if the user makes some decision which could cause negative effects, such as canceling jogging and showering from the agenda. We spent a lot of time setting two skateboards into the boxes. Luckily, it worked well in the end. Plus, they made our bed looks cooler.

Recitation 3: Sensors by Ning Zhou

Circuit: Distance Detector

process: We copied the code from this website. The first time I uploaded the code, some datas were shown in the monitor but are obviously not true because they said some crazy numbers like 745 cm, etc.  Then something went wrong and we smelt something burnt from the Ultrasonic Sensor. We met a problem when uploading the code the next time we tried. It is said that the port was not found. Young and Tristan helped us checked our connection, the code and the Arduino app but nothing seemed to be wrong. At last, Nick came to rescue and pointed out that we connected the ground and 5v jump cables wrong. We all ignored this small detail at the very beginning. This was embarrassing but it is good that we didn’t burn the Ultrasonic Sensor or anything. We referred to the website and tried to do the map stuff and narrow the range from about 0-600 to 0-255.

*We didn’t add the LED in our circuit during the recitation but I think it can be added to the circuit and emit light when the distance is less than 50cm also by using the “if” statement in Arduino :

diagram
code

Question 1:

What did you intend to assemble in the recitation exercise? If your sensor/actuator combination were to be used for pragmatic purposes, who would use it, why would they use it, and how could it be used?

I intended to assemble a circuit which can sensor the distance and emit the light when the distance is close enough. If they were to be used for pragmatic purpose, car drivers and electronic bicycle riders can use it. Because this can be very helpful for driving learners to give them more confidence and a sense or security. For drivers, when thy are reversing or parking the car, it will make it safer. Also for electronic bicycle riders, the light can be a sign of warning both for themselves and the other in front of them. The led should be set on the front of the cars or bicycles. While the sensor should be set at both the back and the front of the cars and at the front for bicycles.

Question 2:

Code is often compared to following a recipe or tutorial.  Why do you think that is?

Just like the video we watched on class once which is about learning computer by making dumplings. Here I feel that code is similar to the recipe because.  The whole combination is under the control of the code and run as it says exactly. Any little mistake or any detail that is not according to the right code will lead to failure or the result that different from expectation. Code id of great importance in the process of assembling circuits. It is still a bit hard and confusing for me right now but I believe that there’re basic rules and frameworks that I can follow. After being familiar with that, I think I can try to do my own coding.

Question 3:

In Language of New Media, Manovich describes the influence of computers on new media. In what ways do you believe the computer influences our human behaviors?

With the widespread of the computer, it became more and more convenient to interact with others. So, it can be implied that the computer provides a new way for people to live. It is more than changing the old way, but offering a new way. For example, it makes it possible for humans to do almost every daily task online or on their cellphone and laptop with the help of technology. This makes humans’ lives easy but also reduces the possibilities for humans to build direct  efficient interactions with others. There’s no doubt that the computer is more advanced,  accurate and efficient than humans so that it has already replaced humans in various ways. But the positions the computer has taken are more like dull, mechanic or heavy, dangerous work. So I think that humans are tend to focus more on thinking tasks which need understanding and humanity and are hard for the computer to reach.

Recitation 2: Arduino Basics by Ning Zhou

Circuit 1: Fade

Process: 

We encountered some problems when we built the first circuit. The LED didn’t light up at first. We asked Nick for help and found that it was connection of the components on the breadboard. The middle  two parts of the breadboard is connected horizontally so the components can not be connected in the same way. We adjusted the circuit and ran tested it again. The LED worked but the light was dim. So the problem should be the resistor.  With the help of Nick, we used the multimeter to measure the ohm of the resistor we connected in the circuit which turned out to be 10k ohm. Thus, we changed the resistor and the circuit worked well.

Circuit 2: toneMelody

Process:

This circuit is easy and we didn’t encounter any problem.

Circuit 3:Speed Game

Process:

This circuit is more complicated than the first two. We first just connected every component according to the given diagram. We uploaded the code that we copied online but the circuit didn’t work well, the buzzer and LED didn’t work. Nick suggested that there could be some connection problems. Then we built and checked the circuit again but it still didn’t work as well. This time the problem was that we didn’t know where was the problem. At the end of the recitation, we asked Rudi for help. He helped us check the circuit again. And then, the important steps that we have missed were using Arduino App to check each component-two LEDs, two buttons and the buzzer one by one.  We used the blink,  toneMelody and DigitalReadSerial samples to check them as we did on class. After making every component was working well in the circuit, we uploaded the code again and succeeded.

Question 1: Reflect how you use technology in your daily life and on the circuits you just built. Use the text Physical Computing and your own observations to define interaction.

The first thing I do every morning after I wake up is to grab my phone to turn off the alarm and check the unread notification. Then I’ll usually log in to my account of Netease Music and shuffle play the music from my favorite fold. Only after all these steps will I get up from my bed to start a new day. All I do during these process is to use my fingers to tap on the screens. But my phone responds to my tap differently. One exception is that my phone can be unlocked with face-recognize technology. But it turned out that this doesn’t work very well in the morning when I’m on the bed with messy hair and sleepy eyes without my glasses. Sometimes it cannot even recognize my face when I’m smiling. So I feel like that my phone, also as a form of technology, a computer is still not familiar and have blunted sense with our “physical computing”. Another kind of technology I use most in daily life is my laptop. But what I do with it is no more than clicking and typing. I don’t really feel the interactive process with it. It is more like a tool for me to study or entertain rather than an actor in the communication.

About the circuits we built in the recitation session, I think that the circuits with analog outputs give people a stronger sense of interactive. Especially for the third circuit of speed game, the computer can respond to our multiple actions in a short period of time with several different outputs-the buzz, the light and the result on the monitor. But in all of these circuits, we just use our fingers to tap the buttons to connect ourselves to the circuits. The way of our interaction with the computer is limited. But we do are interacting with them.

So, as I see, interaction is the process of expressing and “transduction” . As it is implied in the text that “transduction” is “one of the main principles behind physical computing”. For computers, it is transduction. But for humans, it is the way that people expressing themselves to make them connected to the computers and let them understand their expression.  Since there’s too much unpredictable possibilities and potential in human bodies, computers still need time to learn physical computing to build more “high-level” interaction.

Question 2: If you have 100,000 LEDs of any brightness and color at your disposal, what would you make and where would you put it?

Since the 100,000 LEDs are of any brightness and color so they can used to imitate any view we see in real life. This can become another form of virtual reality. For example, part of the LEDs can be set under the glass floor to imitate grass field or mountainous area while the LEDs on the top of the ceiling and around can imitate other views accordingly. I would like to put it in children’s room, wards or any other places where paralyzed people or someone who is not convenient going out to see the outside world live. Or it will be great to put in museums and some public places for entertainment or education.