Assignment 5 – Multi 3D Objects


For this project, I loaded a tree model made by myself into the patch. I modified the speed, scale, and frequency and set them into motion. To add texture, I generate the video content using the generated module and capture the output as texture. Therefore, the different shapes and lines became textures on the trees. For the background, I uploaded a prerecorded video and added effects to it. I added KALEIDR and the background visual became colorful. I also used the ZOOMR to control the motion of the trees.

Link to my video and patch: https://drive.google.com/drive/folders/1Z-4uUhhSK5gtEWoTZRyofGF9B3xo5sjQ?usp=drive_link

Reflection 8 – Live Cinema

Prompt

Read the chapters on Live Cinema by Gabriel Menotti and Live Audiovisual Performance by Ana Carvalho from The Audiovisual Breakthrough (Fluctuating Images, 2015).

Armed with the knowledge you gained last week by reading the chapter on VJ-ing and by watching the documentary Video Out (Finkelstein & Vlachos, 2005), write a two to three paragraph reflection on the difference between VJ-ing, Live Cinema, and Live Audiovisual Performance. Reference one contemporary artist / group / collective from each category as an example to indicate the differences in context, methodology, and technology (if any!).

VJ-ing, Live Cinema, and Live Audiovisual Performance represent distinct facets of the audiovisual arts, each with its unique characteristics.

VJ-ing typically involves real-time visual manipulation during music performances or events, often using software to mix and manipulate visuals. It often takes place in the clubs and the audience will be lost in the projections. One example is the AntiVJ artists. They create immersive installations and live performances that challenge the audience’s senses. One of their most famous shows, in which current member Simon Geilfus performed with Murcof, featured stars, lines, and chemical particles that were projected on multiple screens to create a 3D-sensory experience that had no boundaries, taking the audience through a mind-blowing journey where the light sources could barely be perceived.

Live Cinema tends to be more narrative-focused, integrating cinematic elements into live performances. Live cinema is exempt from chief constraints, namely narrative continuity and fixed spatial arrangement. Even setting up the projections is incorporated “as part of the creative process,” intensifying the practice’s kinship with the fields of expanded cinema and interactive installation. Live cinema can be characterized by storytelling. Examples can be found on the website of the live cinema festival. The artist Paraadiso, for instance, creates captivating audiovisual experiences by merging scientific data visualization with electronic sound, showcasing a more interdisciplinary approach.

Live Audiovisual Performance encompasses a broader spectrum, including both VJ-ing and Live Cinema but often places a stronger emphasis on the integration of sound and visuals as equal components. Live audiovisual performance is a term applied to contemporary artistic expressions of live manipulated sound and image, defined as time-based, media-based, and performative. Live audiovisual performance is complex because it does not comprise a specific style, technique, or medium, but instead gathers a series of common elements that simultaneously identify a group of artistic expressions as well as specific works, which don’t necessarily fit within either of the particular expressions that constitute the group. One example is the EKO by Kurt Hentschläger. It is an audiovisual performance with LED wall display and surround sound. EKO is performed live in the splendid void of pitch-darkness. Erasing the audience’s perceptual boundaries, the absence of light is interrupted for only fractions of seconds with bursts of micro-animated abstract forms. 

Assignment 4 – Granular Synthesis Audio

Due to the shuttering nature of the video, I added the sequencer following the frequency of the video using the vizzieconverter. To create more audio, I used a drum sequencer and linked it to 3 cell MIDIs. One is a kick sound, one is a shush sound. I added the shush sound because in one video the woman is demonstrating a similar movement. The shushing sound occurs once in a cycle, and the kick sound occurs regularly by a certain frequency. I modified the shushing sound with the gigaverb and reverb module to give it more reverb effect. I also added another audio sample that I found suitable for the video because it has a fast tempo and its frequency fits the video. I modified it with a flanger effect and adjusted the center, width, and rate so that the original audio does not sound that obvious. 

The audio I created has a very intense vibe and corresponds with the effect I added to the video. 

The link to the recorded video and the patch:

https://drive.google.com/drive/folders/13eOFslG3ewisbSDVn7S3BQ_OkYDjGiRM?usp=drive_link

Reflection 7 – VJ Culture

Prompt 

Watch the documentary Video Out (Finklestein & Vlachos, 2005) and read the chapter on VJing by Eva Fischer from the collection The Audiovisual Breakthrough (Fluctuating Images, 2015).

Write a two to three-paragraph reflection on the practice of VJing, as described by the author, and how it relates to the notions of “liveness”,  “the performative”, and the concept of “visual wallpaper”. Relate it to your own experience with work you’ve seen by VJs in a concert/club/theater setting.

“VJing stands for liveness, transience, and uniqueness.” Different from the music video screening, VJing requires the performing and improvising VJ. “The performative character of a VJ performance is closely connected to the structural and formal influences of the music: composition, rhythm, the desire to create immersive 12 [ spaces, and the use of samples, 13 [ loops, 14 [ or patterns, 15 [ all of which can be compared to the development of electronic music and DJing.” From how I understand it, VJing requires control and movement of the performers or even the audience. Time and space are important for VJing because the same performance will never occur twice. It’s important to note that VJing can’t be separated from music because it is largely related to DJing. 
“VJing as a visual component, therefore, always refers to a responsive action, a cooperation with someone else.” The visual wallpaper refers to the dissatisfaction that VJs have because they are treated more unfavorably compared to DJs. In the documentary, some artists also change from VJs to video artists. From my perspective, it’s large because VJs always need to be a part of joint performances with others particularly DJs or audio performers. I totally agree with the author’s opinion that the environment of the club causes this as well. The audience in the club won’t focus on the screen as much as in the movie theater, which makes perfect sense. It’s indeed a pity that VJing isn’t paid enough attention in the performing places, especially the clubs. 
The latest experience I have with audiovisual performance is the field trip to the live house. I feel that most people went there to watch the performance so many people did pay attention to the VJing. The visual effects, the light, and the audio were very cool. It was like everyone was standing to watch a performance, which felt different from the club. 

Project 2 – Documentation Post

Title

Atlantis

Project Description

The theme of our project is the lost kingdom of Atlantis. The Lumia we create demonstrates the beginning and demise of Atlantis. We aim to use light and different materials to create the visual of the ocean and aurora. Our group noticed that many of the Lumia shows create the aurora visual, which gave us the feeling of the ocean, so we decided to make visuals of the deep ocean. The addition of material and color demonstrates the change in the kingdom of Atlantis.

Perspective and Context

Lumia is the art of light. In the reading A Radiant Manifestation in Space: Wilfred, Lumia and Light by Keely Orgeman (Yale University Press, 2017), Wilfred paid attention to the “tempo of movement, the intensity of color, and levels of brightness and darkness,” which is important for Lumia. Our project tried to establish the relationship between light and music. We used light to explore complex concepts like the born and decay of nature. The documentary Lumia mentioned that some audience heard the music while watching the Lumia, but the Lumia was in fact silent. This shows that it’s only a visual performance, but it can interact with other senses. Our project also aims to create an immersive experience.

The reading “Cosmic Consciousness” from Visual Music: Synaesthesia in Art and Music Since 1900 (Thames & Husdon, 2005) emphasizes the feature of visual music, which is “creating a kind of ideal world, a universe of linked senses in which all elements–sound, shape, color, and motion–are absorbed into one another”. Our project tries to use light to create visuals that correspond with the music and arouse all senses.

Development & Technical Implementation

Our group started by finding materials to create visuals. We decided to use the basic materials in the lab since they already have amazing reflections and could create amazing visuals. As we put the materials and different fabrics together, there were already visuals that we thought were suitable for the project. We explored many different materials and also used plastic bottles and glass to generate some visuals. The visual gives us the feeling of the deep ocean and the Atlantis. We could start with one color as the beginning stage of Atlantis, then add more colors demonstrating its development. In around 3 minutes begins the prosperous stage of Atlantis, with most colors and visual effects in Max. Around 4 minutes, we gradually take away the materials and the colors fade showing the fall of the kingdom. The audio corresponds with the visual. It starts with bubble sound, then more audio pieces gradually add up, and finally die down. 

The first problem we encountered was the setup. Since we constantly need to add and reduce material, we first wanted to make a spinning installation so that the material could show by itself. We also thought of making a cupboard-like installation using bouncy thread so that we could take off the fabrics by moving the thread. In the end, we decided to keep it simple. We made a screen using a semitransparent and matte fabric. To avoid the wooden frame affecting the visual, we stuck silver fabric onto the frame.

 The foundation of the setup is the reflective silver material and the red, blue, and green transparent paper. The light directly shines on the silver paper and the visual will be projected on the screen.

Performance

The performance was kind of unexpected. We rehearsed several times before the final review, but the first time had the best effect.

Since the pixel of the webcam is too low, we decided to use our phone, but it disconnected twice during the two performances. However, even when we were using our phones, the visual was still not as clear as expected. Also, the light was a bit low and the effect was not that good.

I was in charge of the audio, the overall effect was great, but some transitions were too sudden. When I turned on one module, the sound suddenly turned super big and affected the whole piece. The Max effect added was cool but we could make it correspond with audio more. Our group feels that real-time performance is really full of the unexpected. 

Team Work

During the creation process, we came up with the theme and visuals together. When the visual was set, Chanel was in charge of adding Max effect to the visuals. Sophia and I searched for audio, made a 5-minute piece, and added the Max effect together. In the performance,  I controlled the audio, Chanel controlled the visual, and Joy and Sophia managed the setup. The team communicated well. 

One drawback of the collaboration for a performance like this is that the visual and audio were made separately, so it was hard to make them perfectly fit with one another. The benefit is that the use of the materials can be more complicated and create more beautiful visuals. 

Conclusion

Previous research on Lumia and abstract film gave us inspiration for this project. The group’s cooperation and communication were effective. Through this project, I learned that we can create beautiful visuals with a simple setup and material. However, in real-time performance, there are full of the unexpected. The execution of the performance didn’t quite live up to our expectations, but we did our best. Most of the time, the final performance will not be satisfying and it can be hard to reproduce the visuals we thought were great in the creation process. I’d say our project is a beautiful Lumia, but lacks some creativity, especially when watching other groups’ performances. The other groups’ usage of different kinds of material other than fabric and the use of fireworks, paint, smoke, and face was very creative and inspiring. In the future, I’d like to try more like this.