Reflection on Natural History Museum Project–Kenneth

In general, I think that we do a great job. Even though we spent a week at the Jingan temple, we still finished our project on time. For production, our main work is to photoshop the human-related surroundings–audience, gates, signs, light, the roof of museum, fence and to use the clone stamp to make a fake sky. We basically erased all the human things and make a fake safari but our classmates still can tell it is a photoshop product. But fortunately, the audience in the IMA show asked us how we make it, so it is not bad actually. We failed to get into the museum after it is closed so we cannot get shooting without an audience. Next time, we will try to negotiate with the natural history museum.

We tried to make spatial audio for our project. I was responsible for that. But unfortunately, it does not work. I made the spatial audio on the studio computer and it worked well on the computer. But the volume settings on computer and VR devices are different. I made the audio file at the end of our project, so we don’t have enough time for testing and remaking. Eventually, the sound is not ambisonic on the VR device. Next time, I will leave enough time for testing, not only for sound but also for shooting and production.

Through this VR project experience, I learned a lot beyond VR knowledge. Besides VR fundamentals and production skills (Spatial sounds making, VR video stichin&editing), I learn how to negotiate with the public department, how to get permission for shooting, how to work with the local officials (for example, Jingan Temple offices and natural history museum officers). Those things are not technical skills, but also important in future work. As Michael said in class, we need to deal with these things in the future. So I think it is really beneficial for me to get in touch with the people outside school. 

Eventually, special thanks to Professor Michael Naimark and Dave Lee. They gave our group a lot of help in finding potential shooting places, getting shooting permissions, postproduction and giving us feedback. Also, special thanks to our group leader, Vera Zhong, who taught me a lot about doing photoshop and premiere pro. Vera and I always work together to make our project better. I am so proud of my partner and glad to be her partner.

Lamb Project Final Report by Kenneth

Lamb Group: Assistive Umbrella Holder

Partner Description

Our group’s partner Lamb is a seventeen-year-old girl. She lives with her mon and they live in the Putuo district in Shanghai. It is quite far and it will take a long time for them to get to our campus. She graduated from the special school in Putuo last year. Because of hypoxia caused by the lack of oxygen at her birth, she has difficulties in controlling her body and she can only use her right hand. What is worse is that the ability of her right hand is also limited. Fortunately, her intelligence is at a normal level. She was a participant in the Hackability event of our school this summer and she showed great enthusiasm and willingness to participate. She is an optimistic and outgoing girl. Even if she cannot speak fluently and clearly because of hypoxia, she loves talking to others. When we tried to communicate with her mother about her needs and difficulties, she was patient and she shared her feelings with us. Besides these descriptions about disability, I found out that she loves drawing and she was really kind. She worries about other people who have disabilities. She wants to help others even though she also suffers from disabilities. She is very warmhearted and participates in lots of public service activities.

Her Needs/Challenges/Difficulties

Lamb wants to go outside by herself. Now she can use her right hand to control an electronic wheelchair. But one thing is that she has no hands for opening and holding an umbrella in a raining case. So she cannot control a wheelchair and use an umbrella at the same time.

Another big issue is that Lamb and her mother cannot use almost all public transportation except the metro. They live far away from the metro station. Lamb’s mother needs to push the wheelchair 3-4km, using 1 hour and a half to bring Lamb to the metro station. However, if they can take buses, it won’t take them too much time.  However, they cannot take buses because it is hard for them to get on and off the buses because there are always a huge gap and depth between buses and buses station and between buses and the ground. It is very dangerous for them to get on and off the buses because the traffic condition is always condition and wheelchair and Lamb are too heavy for Lamb’s mom. So it is impossible for Lamb to go outside alone. Besides, because of the rainy weather and the extremely high temperature in summer, Lamb’s mom needs to hold two umbrellas when they are outside.

Project Description and Photos

Our project is an umbrella holder, which can be strongly attached to a wheelchair handler. Lamb’s family can help lamb setup the device if the weather report says that it might be raining when Lamb needs to go out with her electronic wheelchair alone. According to our research on Lamb’s daily route, She will not go out if it’s raining so that this project is designed special cases: it is raining and she is outside alone. After she goes out, if it suddenly rains, she can rotate the holder to a specific angle and make the joint tighter by spinning a turn-knob. Because Lamb’s mother says that she can open some light umbrella with her right hand. So after adjusting the angle and get prepared, she can open the umbrella. Also, she can ask for help on the street. 

It will be something like this: 

Development Process

First week:

In the first week, we wanted to design everything in automatic function. Lamb can click one button and the device can be automatically opened. Here are the first design:

 

and here is the video of our cardboard prototype:

Second Week

In the second week, we got the material we bought from Taobao. Unfortunately, Lamb took a trip to Hangzhou, so that we could not have a real user test on her. We wanted to use an automatic umbrella attached to the umbrella holder so that she can use the umbrella by simply press the button. When not in usage, the umbrella will be clinging to the handle of the wheelchair. When Lamb needs to use it, she just needs to pull it up and press the button. We planned to use an umbrella-like this in case she will get wet when closing the umbrella. Our challenge was how to fix the umbrella in that position after she pulled it up tightly and to make sure its safety. 

Third Week:

In the third week, we still could not have Lamb for the user test because she got a bad cold. Bad news. We got the automatic umbrella and the umbrella holder that we bought on Taobao last week. When we tested the automatic umbrella, we found out that the umbrella exerts a large force during the opening and closing process, which may be too dangerous for Lamb. 

Also, once the umbrella is opened and closed once, the user has to pull it back to the original position to activate the automatic mechanism again. But it needs much more strength to pull, which is impossible for Lamb to do that. It’s even difficult for us to pull it back. What is more, we realized that the joint of the holder for rotation is a little complicated, which may be too difficult for Lamb to rotate. Young suggested that we can try to use a guerilla pod as the joint, which may be easier to operate but also strong.

We tried to take the joints of stretchable sticks out and separate the legs of guerilla pods from their main body. Then we tried to install the joints to one side of guerilla pods’ leg so as to make the whole stretchable stick rotatable. We used a small pod for the first try. We successfully connected the joint with one side of the pod leg. But the leg is not strong enough to hold an umbrella. When we straightened up the umbrella, the leg bend, and the umbrella fell down. So the first try failed. For the second try, we used a stronger pod leg for rotating the part. However, we realized that the stronger leg was too big for the joint, we could not connect them together.  It seems that our prototype has been stuck. Also, because of the lack of communication and touch with users, we cannot measure the size of the wheelchair and test the capability of our partner, we cannot promote the progress by ourselves.

Reflection

So the conclusion is that we fail in making a real product for Lamb. But we have tried our best to communicate with Lamb and her mom. For me, it is an unforgettable experience. I realize that in the designing process, the user test is a really important section.  Because in the whole process, we don’t have our users with our designing and making the process, we cannot get feedback from them and we cannot event test our prototypes. So our designing process was stuck for sure. We cannot promote progress by ourselves. Without communicating with the user and observing the user, we are not able to know their real needs and empathize, which is the first step in design thinking. 

Reflection on field trip

Reflection on the field trip

The special school behind Meng Cafe

This school is another special school and it is a little bit different from the last one we visited. The first thing is the playground. When we entered the campus, the first thing came into my eyes is a small playground. There are many playing devices on the playground, and it is outdoor. We observe two clubs’ events in the academic building: ukulele decorating and paper rolling decorating. We observed a ukulele decorating event firstly. There were around 8 students in this class. The faculty told us that they invite people from outside to provide these courses to students, and this course is an elective course. Students will choose elective courses according to their interests. I mainly observed one girl and one boy. The boy is emotional. He really wanted to attract our attention and showed his work to us. Every time he failed in connecting strings to ukulele, he became angry and shouted out loud, then he looked to us. I think he really wanted to show himself to us. Another girl was shy. I noticed that when we went into the classroom, she headed down and had a few conversations with students and teachers. I tried to talk with her but she conveyed her dislike towards me to me. So I just left but I still kept an eye on her. There is a girl from our group who got the girl’s love. They had a good conversation and that girl smiled a lot. So I think for these children with intellectual disabilities, they are in a different situation and they have different personalities. But they still want to have a connection with us.

The second class is also an elective course. Many students sat around a big desk. They were rolling colorful paper to decorate a painting tougher with teachers. Those kids enjoyed a lot. I can tell that some of the students are very open-minded and energetic, they won’t sit quietly and doing things in their spare time. But rolling paper seems to have a great attraction. Young told us that those kids can release themselves by doing repetitive works. That inspires me a lot. Maybe we can use some technologies to help them calm down and keep track of their attentions. For example, we can use some meditation-relevant things to help them keep moods. Besides, I also realize that those kids have great talents in art. I saw many artworks in that classroom and they are all made by kids of the school. Maybe we can design something for their interests. Also, when I left I saw one child going downstairs, he took a long time and his body suffered. I think a physical computing device will be a big help for them.

Overall, I think those kids are really happy. Their worlds are simple. They welcome us and embraced us. It makes me feel warm-headed.

Meng cafe:

There are 7 employees in Meng Cafe. The cashier looks like a normal person. She could use a computer really good and she is good at communicating. But she suffers from cerebral palsy and she cannot move quite well. We order a cafe and nothing special about our interaction with her. My second interaction with one of the employees is that I ask one girl to clean the water on the ground.I noticed that that employee hadn’t talked to me even though I said “pleas” and “thanks” to her. She just did what I told her and we have no interaction in oral. I think some of them might have trouble communicating with customers. Generally, I think those kids are very cute. They have their thoughts and they are very talented in their own area.

 

Week6 assignment by Kenneth

Describe my partner

Our partner is Lamb. She is easy-going and she loves drawing. She is kind (she worries about other people with disabilities and hopes to help them) and very smart.

Desires and difficulties

Our partner wants to go outside on her own but she cannot achieve this dream because of her physical disabilities. When going out, there are many difficulties she will face such as she cannot open, hold an umbrella and control the electric wheelchair with her right hand at the same time on rainy days.

Project Description & Process

Description

Our project is an umbrella holder that can be attached stably to a wheelchair. It consists of a stretchable stick and a light umbrella, which is easy to be opened with one hand. One side of the stick should be attached to the wheelchair. The connection should be strong enough so that it will not fall down during the movement. Another side of the stick should be the holder of an umbrella.

Process

This week we tried to use the material we have so far to make a prototype in function. We have a light umbrella, stretchable stick we got from Taobao, two types of guerilla pods. 

We tried to take the joints of stretchable sticks out and separate the legs of guerilla pods from their main body. Then we tried to install the joints to one side of guerilla pods’ leg so as to make the whole stretchable stick rotatable. We used a small pod for the first try. We successfully connected the joint with one side of the pod leg. But the leg is not strong enough to hold an umbrella. When we straightened up the umbrella, the leg bend, and the umbrella fell down. So the first try failed. For the second try, we used a stronger pod leg for rotating the part. However, we realized that the stronger leg was too big for the joint, we could not connect them together.  It seems that our prototype has been stuck. Also, because of the lack of communication and touch with users, we cannot measure the size of the wheelchair and test the capability of our partner, we cannot promote the progress by ourselves.

December 5: Top4 Selection by Kenneth

Top4 for accurate, prophetic, powerful:

  1. Hand Tracking on the Oculus Quest Feels Pretty Magical

I think hand tracking will be the mainstreaming interactive way for VR/AR because I think that it makes sense from the perspective of historical trends. Decades ago we used our fingers to control mouse, keyboard, and controllers to interact with machines. Then we shifted to the era of touch screen, which allows us to use our own fingers to interact, more straightforward and easy. The same idea for VR/AR, as a new media, VR/AR is experiencing the same developing process that the previous media like phones and pads have gone through. Hand tracking tech can bring users a more immersive experience rather than controllers. Go into a new world, you need to use your “hand”. 

2. New Microsoft Patents May Hint at Project Scarlett Features

I am really glad to see something like Microsoft Mat become reality because I think going into family life is an important sign showing that one kind of device becomes mainstream and there is a massive group of people who are using it. In the future, I believe that VR/AR will be a role in our daily life. At that time, people will need more relevant VR/AR devices at home for a better VR/AR experience. That is why I think this news is accurate and powerful.

3. Sifting Reality From Hype: What 5G Does (and Doesn’t) Mean for VR & AR

5g means a greater bandwidth and lower latency. The advantage of 5G could promote the development of VR/AR video streaming and VR/AR cloud games, which are really important for the whole VR/AR industry’s development. Also, 5G tech can solve many current obstacles in the VR/AR industry, such as data transmission. 

4. Apple Is Apparently Working on AR Headphones

I agree that AR headphones will take place the current role of smartphones someday. Because in my opinion, people are trying to break the boundaries between the real world and the digital world. AR is the best tool for connecting. 

Off-track, clueless, and ridiculous

  1. Russian dairy farmers gave cows VR goggles with hopes they would be happier and make better milk

It is ridiculous, no reason. I don’t think VR/AR could be used for improving agricultural production lol.

2. Will virtual reality and AI help us to find love or make us lonelier?

I think even though with the development of AI and VR/AR techs, the love relationship in the real world won’t be affected by human-like virtual avatars. AI and virtual reality, in my view, will not make us both feel lonelier or finding love. Because for the users who will use AI and VR to find love, they release their loneliness by this means. So they won’t feel lonelier; for the users whose love relation needs will not be affected AI and VR, they will not expect love and happiness brought by relationships in the virtual world, so they will not feel lonelier. In conclusion, VR and AI for love is a specific market for a group of people. 

3.Why The Music Industry Is Banking On The Growth Of VR Concerts

In my imagination, the VR music industry will take a position in the whole music industry in the future, but it cannot change the whole industry. Even though there are many artists holding concerts through VR platforms, I do not think that this way of giving concerts will be a long-last fashion. Because I think there is one thing which cannot be created in the VR world–vibe. In a live concert, You can feel the energy of performers; you can feel the passions of the audiences; you can feel the temperature of stages… These things cannot be provided if you wear a VR headset in your home with AC.

4. Microsoft’s DreamWalker lets you see VR cities during real-world walks

I remembered that many classmates expressed in class that they like the idea. I agree that this DreamWalker can bring a new walking experience to the users. But personally I do not think that it will be a company of everyone’s walking. Because firstly, I think it is still dangerous even if DreamWalker can one hundred percent shows the real street look. Besides, I think not everyone will wear headsets going out. So personally I think it is stupid to wear a VR headset walking along the street. Also, I think it is interesting for the first use of DreamWalker. I prefer real world beauty.