RAPS Final Project Documentation —— Thea(Sang)

Title
The Station of the Metro

Project description
The Station of the Metro is an attempt to demonstrate the daily experience by real-time audiovisual. It based on the different video clips shot in the real station in Shanghai and integrated by the new digital way of demonstration. Traditional photography shows new meanings and aesthetic value in this way.

Our inspiration comes from the poem of Ezra Pound, In the Station of the Metro and the name of our project is borrowed from his poem. The origin poem is as follows. The apparition of these faces in the crowd. Petals on a wet, black bough. As a quintessential Imagist text, the treatment of the subject’s appearance by way of the poem’s visuality. Thus, it is quite suitable to reveal the artistic conception of this poem by audio-visual performance. Basically, we want to emphasis the loneliness of a person in the noisy crowds and demonstrate the low temperature behind boisterous society. The overall atmosphere of our project is dark, cold, and depressive.

Perspective and Context

Our project The Station of the Metro belongs to the category of live cinema. According to Chris Allen, a member of The Light Surgeons, live cinema is a “deconstructed, exploded kind of filmmaking that involves narrative and storytelling” (91). Different from VJing, which highly emphasis the interaction between presenters and audiences, live cinema demonstrates a more personal view and artistic concept during the performance. The Raindrops #7 and Strata #2 we saw in the class were my favorites. I was surprised and excited to see how normal scenes in our daily life can achieve such a great aesthetic value. The traditional videos combined with digital and technical form demonstrate strong vitality

Quayola, “Strata #2,” 2009

What’s more, we were also inspired by Glitch Art. The sudden distortion occurs in video or sudden white noise in audio not only achieves harmony but also demonstrates some features of Glitch Art. Glitch Art comes from digital art and also serve digital art currently.

Development & Technical Implementation
The development of our project can be developed into two parts, materials collection stage, and technical stage.
We started the first stage early as we did not know what kinds of video we needed in our project. On the one hand, we wanted to present the atmosphere demonstrated in In The Station of the Metro written by Ezra Pound. On the other hand, we hope we can integrate our daily experience in the real station. Luckily, when we first shot in Century Avenue station, we found a girl squatted in the corner while the crowded rushed to pass by her without a glance. The quiet girl stands in sharp relief against noisy crowded and delivered a strong sense of longlines. We were deeply impressed by this scene and found it not the only one. Thus, we decided to emphasis this kind of contrast between loneliness and noise through our project.

We found a lonely girl and  a still boy in the station

I did most of the job in the collection stage including video collections and audio collections. According to my previous experience in photography, I used time-lapse photography and made thousands of photos into a video. In this time-lapse video, the crowds are like water flowed around the still person. I selected different locations to shot videos, including the subway entrance, subway platform, and ticket entrance. Also, I particularly chose morning peak and evening peak to shot the video to achieve the best effects. Additionally, I shot rainy car windows which reflected stunningly beautiful lights. We planned to fuse it with station video to create an obscure, romantic and idiosyncratic atmosphere.

I took time-laspe photos in the entrance of station

I made a time-lapse video

In the early technical stage, Katie editing, splicing, cutting and simply post-processing raw video materials with Pr and I made a piece of background music by GarageBand. I firstly used the piano to write a theme and then changed its volume, pitch, timbre, and rhythm. Based on the looped theme, I added different notes, including the bass with a long extension and volume change as well as silvery high pitch. Overall, the basic background music does not have a strong beat and shows great rhythm and delivers a sense of dark and repression.

i made a background music for our project

In the post technical stage, we put our background video and music into MAX. For video, Katie and I almost explore every possible effect and we found something quite suitable for our videos. Besides, we spent a lot of time creating and adjusting the 3D model in our project as well as finding suitable effects. We created three wonderful 3D models that perfectly fitted our project. However, as it was hard for us to precisely one change 3D model to another, we regretfully chose one and gave up two. What’ more, to develop a harmony consistent between the 3D model and background video, we adapt the size, light, and texture of the 3D model. We were satisfied with the final results. For audio effect, I want it to show a tight and dynamic relationship with videos. On the one hand, I changed the SIZE of audio and added white noise when the videos constantly shift or when certain video effects occur. On the other hand, I add the sound like jewelry collision when the 3D model occurs. We want to give our audience a sense of synesthesia These through the harmony between audios and videos.

3D model 1

 

3D model 2

3D model 3

audio patch

After these two stages, we worked on how to run everything in perfect order. I wrote a basic script including three timelines. Firstly, I analyzed the important time point in the background video such as video shift or video superstation. Then, according to this timeline, we jointly decided the time points of different effects including DELAY, ROTATE, COLOR as well as the time when the 3D model occurs. Finally, I planned the audio effects based on the former two lines. Followed the basic script, Katie and I rehearsed many times and constantly add new things and adjusted the old things.

Performance
Video clips:

The overall performance went well and was better than any of our rehearsals. I appreciate that we could perform in an underground club, where the room is completely dark and the sound equipment is advanced. Besides, because our project was the first to present and the overall atmosphere was relatively quiet, the performance effect was better than our expectations. We want to demonstrate the dark, heavy and depressed in the fast-paced and crowded station through our project, which is perfectly consistent with the dark and quite underground club. In our presentation, I mainly controlled the audio effects while Katie controlled the video effects. I think I did much better than before. I cautious followed the video and the video effects to adjust the audio effects. The overall audio effects and video effects are in harmony and follow our script because of our previous multiple rehearsals. Katie and I showed great tacit understanding during the performance. Although some effects did not perfectly follow the rhythm, our quick adaption balanced the tiny mistakes. More excitedly, just before 30 minutes we left for the club, we found a new video effect that was quite suitable for our project and this effect went very well during the presentation.

However, there was still something unexpected. Although we have rehearsed a lot of times, we still did not achieve all the effects we planned. Firstly, the audios patch crashed three times before performance, I rushed to develop the patch so some detailed settings deviated from the original one. Secondly, the output device on my computer did not work steadily and I was always worried about it during the presentation. Thirdly, as we were the first presenters, both Katie and I were a little bit nervous and made some mistakes.
I enjoyed being a presenter of this real-time audiovisual performance. Although we were not so confident about all the effects and we experienced a lot of tension, we gained happiness and satisfaction when we successfully finished our personation and gained positive feedback among the audiences. It was quite an exciting experience.

Conclusion:
It is a valuable experience for me to develop an audio-visual project and present it in public. I was also proud that when I finished the performance, some people came to give us great praise. Although it took me a lot of time, the satisfaction and happiness I gained from the project exceeded struggling. Different from other projects that mainly made by MAX itself, we shot video from the most common senses in our daily life as a background video and post-processed with MAX as well as combined 3D models. Personally, I appreciate such an idea that art comes from life and life can become an art. Through our project and presentation, the normal station showed aesthetic value and demonstrated unusual aspects. That is exactly the most meaningful thing to me.
Besides, we had successful cooperation. We not only shared the work equally but also play our strengths. More importantly, both of us had great passion and curiosity for MAX. We explore different possible effects until the last time. We gained infinite excitement when achieving new things.
Of course, as things can never be perfect, we still have many areas to improve. On the one hand, we could be more confident during the presentation. Honestly speaking, due to our nerves, we made a lot of tiny mistakes. On the other hand, the structure of our project can be much better. After watching the video of our presentation, I found that we did not emphasis the contrast between a still person and noisy crowds. Although we did some emphasis, for audiences, they may not receive this simply through our presentation. It is an important experience and I need to pay attention to deliver information coherently and clearly for my audiences to follow and understand.

References:

Menotti, Gabriel, “Live Cinema,” in The Audiovisual Breakthrough (Fluctuating Images, 2015), 85.

Raindrops #7

Quayola, “Strata #2,” 2009

Reading Response VJ, Live Cinema, Live Audiovisual Performance —— Thea (Sang)

Compared with VJ and Live Cinema, Live Audiovisual Performance is a more generic and broader concept. It can be applied to a group of artistic performances that has common features. Not only VJ, Live Cinema, other performances such as expanded cinema, but visual music can also be regarded as the practice of the term Live audiovisual Performance (135). Basically, Live Audiovisual Performance is an artistic expression of live manipulated sound and image, defined as time-based, media-based and performative (131). It largely depends on technological and multiple installations to achieve “liveness”, “Realtime” and “interaction”.

As for VJ and Live Cinema, personally, both of them are the branches of the broader concept. But according to the article, Live Cinema seems to achieve a higher level than VJ. VJing always performs in the nightclub and more like a supplement to the overall atmosphere. VJing needs to achieve harmony and unity with other performers like DJs and lighting controllers and create a great atmosphere to entertain and lighten the audience. VJing presentation is treated more as wallpaper and people seldom emphasize the artistic value of VJing. Makela, who wrote “The Practice of Live Cinema” also implies that the threshold of DJ is relatively low and its artistic value is as high as Live Cinema.

Different from VJ which emphasizes the correspondence between hearing and vision, Live Cinema involves narrative and storytelling and “invite the audience to construct narrative and cultural critique” (89). At the same time, the Live Cinema is also deconstructed, exploded kind of filmmaking, which separated it from the traditional cinema. Whether from the aspects of the selection and organization of sources or the aspects of performing form, Live Cinema explores a deeper and wider territory of VJing and much bolder areas of cinema. I feel that Live Cinema is more like a complete and dependent performance with high aesthetic autonomy and vitality to touch audiences and interact with audiences. I appreciate its integrity. Not only the installation are the parts of Live Cinema, but the performer cannot be changed in order to maintain the aesthetic autonomy and impendence of the performance.

 
However, I still do not think there exists a natural hierarchy of value between VJ and Live Cinema. Both of them show the attitudes of artists and can deliver unique aesthetic values. Although Live Cinema is relatively complex and easy to show deeper thoughts, I believe the simple VJing presentation on the on hand, can also abundant, changeable and full of possibilities, even if it is only out of entertainment purpose; on the other hand, can also deliver great concepts or ideas by excellent artists.

RAPS Assignment 5 – Multi 3D Objects Thea (Sang)

Link: https://gist.github.com/TheaSang/0629eab19a01613a982d6595e8b8d9a3

Video:

I built my 3D project based on the patch provided by the professor. At first, I was quite confused about Jit and cannot understand its logic. But after learning the sample patch and reading the comments, I basically understood its operational logic, especially how to create different elements and show them in the same window. For my own 3D project, I chose to create my own design by jit.gl.gridshape and jit.gl.mesh rather than downloading from the internet. I adjusted the input of dim and selected the shape to create the 3D design I want and change its color and darkness by color-mode and Lighting Enable. Then I changed the speed to move the 3D model.


After building the 3D model, I wanted to add some effects though Vizziz. I add the Delay effect for the moving 3D model. Thus, the overall video seems to be more blurred and fantastic. Besides, I combined another video made by OSCIL8R, SOLARIZR, and 3PATTERNMAPPR with a 3D model trough CHROMKEYR. Through this combination, the overall 3D project looks colorful and shining. Besides, I also changed the background color of the video to make it more harmonious.

The overall patch:


I was still not so familiar with Jit and there are a lot of things I did not explore. I think Jit can create more wonderful things and the 3D model is a starting point. I am interested in exploring more and practicing more in the future and applying it to my final project.

RAPS Assignment 4 —— Thea(Sang)

Link to gist

https://gist.github.com/TheaSang/a6cfa7aabc8f6e08c84760885b90168c

For this assignment, I explored more audios fitters and tried to find suitable filters for different audio resources. For extra layers of synthesized audio, I combine two Sequencers by Stereo Mixer. I used the first Sequencers to make a piece of rhythm and added LPF tried to make it granular. I added more filters on the second Sequencers and produced a piece of continuous music. The overall atmosphere is low, which can match the black and white video. Besides, I add some filters to make it “playable” and change its volume. Thus, it can not only be pointed out from the background music but also is not so abrupt.

This is an extra layer of synthesized audio.

 These are playable audio filters


For the video, I slightly changed the proportion of three videos and their darkness.

The overall patch:

Reading Response VJing —— Thea (Sang)

The term VJ is the acronym for “video jockey”, describing “video performance” artists who create live visuals. (106) I think the term “video jockey” is quite vivid, it demonstrates the ability of VJ to select, edit, performance and control videos. But VJing is not merely based on videos, essentially, it is an interactive art form. On the one hand, VJing tightly connects with fine arts such as performance arts (106) and cannot be separated from the music as it has developed in deep entwinement with DJing (111). On the other hand, VJing emphasizes a lot of interaction with audiences. According to Erika Fischer-Lichte’s definition, “liveness is the bodily co-presence of actors and spectators” (107). VJIng is such a live performance based on improvisation. There cannot exist two VJIing are completely the same, or in other words, VJing can never repeat as different viewer response will lead to different performance results. The “liveness” differentiates VJing from other visual performances such as playing complete video clips or performing with the fixed script (108). VJing just means dynamic, free, unique and impromptu.

Personally, VJing is an impressive and passionate art form. However, the appearance of “Visual Wallpaper” demonstrates the current situation of VJ. It points out one serious problem that VJing always dominates the attention of audiences, and other light or music are marginalized. Thus, the host and other musicians, as well as the audience, become dissatisfied with VJ. I think Bernard is correct, visuals should be inserted into the experience as a whole clubs and concerts, instead of overshadowing the music (113). VJing should co-exist harmoniously with other musicians. The roles of VJs are never telling a complex story but creating a great atmosphere for other artists and audiences.

  

Recently, VJs not only work in clubs or live houses but also appeared at many traditional vocal concerts. I attended the vocal concert of Mayday a few days ago. As an audience, I was not only influenced by the songs but was also touched and moved by the visual performance. In the huge LED screen, the video changed the view continuously from singers to audiences and causes to high emotion of audiences over and over again. Besides, with the change of the emotion of songs, the overall video demonstrated different colors and filters. It can be said that the VJing in music content further helps to create a great atmosphere and aroused audiences’ emotions as well as stressed the dominant position of music.