VR/AR Final Project/Demo Documentation: “I Do.” (BLT277)

Title: “I Do.”
Location: Shanghai Marriage Market (People Square)
Subtitle: â€śI Do” is an immersive documentary that takes place in Shanghai’s Marriage Market located in People’s Square.

Project Description: “I Do.”, is an immersive VR experience created by NYU Shanghai senior Ben Tablada(IMB & Fashion Studies) and sophomores Molly He(ICS & IMA) and Kat Valachova(IMA). The experience is an authentic representation of Shanghai’s famed Marriage Market in which interactions were recorded with a 360-degree camera. The VR team researched the most ideal beauty and dating standards for Chinese citizens (appearance, personality, salary, etc.) and created posters that were displayed in the marriage market. The set-up was exhibited on umbrellas, similar to how marriage market posters are traditionally presented in the space. The reactions and responses of the viewers were genuine and authentic – later stitched together to form a consistent experience that is both enlightening and invasive.

Goal: The goal of the project is to create a mini-documentary type video that allows the user to feel enthralled by the space. The experience we wanted to provide should have elements that we felt during our time [the creators] within the environment. We wanted to capture moments of humor, the invasive nature of the sellers/buyers, and a moment of clarity.

Job Functions: My role for the project focused primarily on laying out the foundations of the video experience focusing heavily on organization and trouble-shooting during the pre-production, production, and post-production phases. Scheduling the shoot and adjusting accordingly based on time and weather constraints were all key parts to my duties. During the shoot, keeping the workflow, assisting during location changes, and diffusing situations were significant elements to my job functions. Lastly, I spent the post-production phase reviewing the footage with the team and cutting/blocking out footage from the production phase into (1) consistent timeline/sequence. I also took initiative by editing the written content on the VR experience and trouble-shooting editing mishaps rooted in spatial audio.

Experience: My experience with the marriage market was definitely an interesting one. The space itself was a feat in so many varying factors. There was a sense of community that can be felt in the air but also a feeling of deceit as most of the candidates on the marriage market posters are the children or grandchildren of the sellers themselves who have no knowledge that they are being “sold”/”auctioned”. My time at the marriage market was met with much contempt and aggression by most, usually as a result of the shame that parents feel when their children find out that they are there in the first place. I also met several individuals who were curious about our project and over-time we felt ourselves becoming more and more transparent with the work we were doing. Overall, the result of the shoot was a successful one – regardless of the verbal and almost physical fiascos that my team and I went through.

Demo Reel: 
Video was taken during user-testing & the IMA show! The reel is a sequence of reactions, feedback, and critiques from those who were able to try the experience. 

Demo Reel/Feedback
https://youtu.be/KO–lxTUOvo

Feedback: The feedback we received during our demonstration at NYU Shanghai’s IMA Showcase was overwhelmingly positive! The experience was praised for its accuracy and the elements/emotions that we wanted people to feel (humor, invasiveness, and clarity). We had members of the community from students, faculty, and even the Chancellor of NYU Shanghai (Chancellor Yu) praise the experience as an enjoyable one. Some of the more negative critiques the video garnered were a lack of a potential warning as some scenes were a bit surprising to the audience. We also had a professor comment on a potential parallax issue with the 3D text (later fixed after a demo) but it was a minor miscalculation.

Video:
*Used a MetaData Injector to give the video 360/VR functionalities on YouTube*

Marriage Market VR Mini-Documentary
https://youtu.be/NxazNNrrNXI

VR/AR News of the Week – Top/Worst News

Best 

  • VR Fitness
    • What I found most interesting in this article is the new Fitness VR/AR experience called Mirror. I actually had the opportunity to see the product in person (whilst visiting a very boujie friend of mine) and let me tell you the experience was UNREAL. Personally, I like working out with others whether it be in a class, with a trainer, or just friends but having someone with you at the gym isn’t always a possibility. Mirror is a prime example of how AR/VR can be implemented in the world of fitness – a multi-billion dollar industry! I especially like this feature because it transforms a product so ingrained in our lives (a mirror) and gives it a fresh new take. My experience was quite enjoyable and I can see this product being used in the homes of high-end consumers, fitness addicts, and luxury gyms. The mirror experience was refreshing and it is exciting to see an iteration of AR/VR without the use of headsets or apps through mobile devices. Looking forward to what comes next! Maybe a VR dumbbell that looks like a slice of Pizza would be nice (lol). 

          

  • VR Meals/Experiences 
    • My favorite AR/VR experiences are ones that incorporate both the digital and physical worlds. The article by Bloomberg showcases a top-tier restaurant that utilizes the functionality of AR/VR headsets giving fine dining a new meaning. Users would put on these headsets and enjoy a multi-course meal all while having a digital VR experience. I can see this methodology being implemented in other physical experiences (or at least I hope I see more). We’re already seen this done in amusement parks with rollercoasters that incorporate AR/VR headsets but seeing done with meals is SPECTACULAR!! I can see AR/VR implemented in other common human lifestyle experiences and I’d love to see companies utilize new tech to revolutionize the consumer lifestyle market or one that helps others. This article is reminiscent of an example I’ve seen where burn victims wear VR headsets to help alleviate the pain – this type of implementation is one that I’d love to see more of! 

  • VR Tours 
    • C’mon NOW!!! This was incredible. I probably spent the most time on this experience because the accuracy was none other. This is probably the most exciting part of this VR experience – how accurate the photogrammetry was. This feature revolutionizes the travel and leisure industry, but where I see it going is the ability for historians to use this as a platform for documenting areas that are constantly changing or endangered. Endangered in the sense that natural disasters or global warming have made a tremendous negative impact on the landscape. Some areas that come to mind are sinking countries or cities like Tuvalu and Venice. It can also be a tool that can document regions that are vastly unexplored and give insight into locations that are often misrepresented by media outlets. The tour factor is great, I’d love to see it done in museums like the Uffizi in Florence, but the underlying capabilities of documentation to shine a light on issues greater than itself is a huge “selling’ point for me. 

  • Virtual Graffiti 
    • This article was really interesting to me in the sense that it questions the use of public space. Graffiti is often prohibited in a majority of the world, while others see it as a form of art. However, the real question is, “How do we monitor or identify who gets to graffiti what and where?” This brings to the forefront issues regarding space and accessibility. If AR/VR graffiti is open to all, how do we identify the legality of it? How do we decide who gets to graffiti what? Will it be monetized? I’m an artist at heart and I’m all for a new form of creative outlet and freedom but this is a tricky situation. I’d love to see how online graffiti or locations stamps evolve and how individual consumers/artists will utilize this tool and if big businesses will see this as a form of marketing and take over (hopefully not). This spans beyond graffiti and really puts into question the accessibility of the VR/AR worls and who owns it. 
  • VR Camera by Adobe 
    • AR/VR camera use is an area that is not foreign to me. We’ve seen it utilize by large corporations like Snapchat, Instagram, and Facebook but we have yet to see a digital agency that caters to artists like Adobe. I don’t think this the app’s final form just yet. I think it will evolve over time and I’m hoping it becomes a platform or tool that artists can use to create VR/AR experiences on a more accessible and professional level. Photoshop, Illustrator, and many of their applications have become industry staples and I’m looking forward to the day that a high-level application will be developed for students and professionals alike. Maybe this time, the learning curve wouldn’t be so steep – oh and free for students :). 

      Worst 

    • Better Milk via VR (Cows in VR)
    • https://edition.cnn.com/2019/11/27/us/virtual-reality-russian-dairy-farm-cows-trnd/index.html

We’ve talked about this so much and it never gets old! I totally agree that this is most likely fake~ The article doesn’t say much about the process of how the process is actually conducted. If anything, it looks like an article from The Onion (lol) and leaves a lot of people with questions to the implementation and humane/inhumane aspects of this experience. 
For example:
“How do they supply enough VR headsets, batteries, wires, and etc. to all the cows?”
“Is it humane to give cows a VR experience when they could just be roaming free in a pasture instead of simulating one?”
“How do we know the milk is actually better?” 

  • Sandbox VR – “The Future of sports,  Entertainment, and Storytelling”
  • https://variety.com/2019/digital/news/sandbox-vr-funding-orlando-bloom-katy-perry-justin-timberlake-1203377770/

This VR experience is one that I have a difficult time grasping. I’m a firm believer that although VR/AR experiences can help in documenting real-world experiences – there are a few things that are sometimes best experienced in person. Sandbox VR is claiming that with backers in the music and entertainment industries they are able to recreate the feeling of concerts and other events. For me, at least, I like going to concerts and events because there is a feeling of community within that space. I’m able to meet new people who share the same passions and make memories with friends either new or old. I think it would be extremely difficult to recreate this sense of camaraderie within a VR space and I think this is where Sandbox VR would fall short unless they can somehow create thee experiences with a community in mind. 

  • Love in VR & AI 
  • https://www.ft.com/content/4fab7952-b796-11e9-8a88-aa6628ac896c

This is tinder or bumble on a whole new level. This article was interesting in the sense that it takes AI data to encourage new couples to proliferate. I think this a tricky subject/area. An online persona is sometimes very different from the “real-life” counterpart. I can see this implementation for suggestive purposes but definitely not in a ‘scientific’ or proven sense. Maybe I’m just an old soul, but I definitely prefer meeting people in person and dating in a face-to-face setting rather than an online one. I’m all for meeting someone in whichever platform is best – in fact, I’m a consumer of these apps now and I hope I can meet someone online and it better be the SAME interaction/appearance in person (lol). 

  • Fitness in VR (Entire Home Gym) 
  • https://vrroom.buzz/vr-news/health-fitness/create-entire-home-gym-oculus-quest

This is an iteration of VR fitness that I don’t see taking off anytime soon. Mirror was a great example of how VR/AR can be implemented in the fitness market, but I think workout applications within the Oculus Quest is a bit more cumbersome. I definitely can’t imagine working out comfortably if I were wearing a headset and using two handheld controllers. What makes Mirror so much more successful in my eyes is the headset free interface and interaction. You are free and fully capable of using equipment you are used to and it almost feels like a personal trainer rather than an app or a game. 

Week 11: VR & VR Effects (Repost&Update)

I’ve recently been using 3D modeling software for class (Rhino) and my primary goal or interest was to find methods of integrating it into these applications and my final project. I wanted to find other applications that can be used in conjunction with the MochaVR, MantraVR, and CaraVR. 

Key Takeaways: 

BorisFX – MochaVR  – SI – MochaVR has a sister software called Silhouette that focuses primarily on non invasive/abrasive paint that allows users to take a more graphics driven approach to VR effects. This however, is an extra software that is just as expensive but the features are STUNNING and something I’d be willing to invest in. Best Feature: Layout – the layout of programs by BorisFX is very similar to other art programs like Photoshop or Lllustrator. If I were the user/consumer this is what I’d prefer as the controls seem the most familiar and with the least learning curve.

Mettle -Mantra VR- Shapeshifter: Mantra VR has a extra software that acts as a plug-in called ShapeShifter AE. However, it is mainly limited by a lack of features (in comparison to the other 2) and  not as advanced with the features it offers. It is mainly used for AfterEffects while the others have better optimization for other applications. Best Feature: THE PRICE! The price point is good enough to be a good enough supplemental software to support MantraVR.

Foundry – CaraVR – Modo – Modo is another application that is focused more on amazing texturing and rendering tools. The program is quite intuitive and has a mid-price range. Best Feature: Modo’s workflows are very artist friendly, it’s very similar to what I’m used to in the past. This can make it easier to learn (ideally). It is also a powerhouse for lighting and shading effects as well as a power translator aka great for CAD formats and etc. 

If I were to invest in a particular software, I would invest monetrily and learning wise on MochaFX. The layout is a lot easier to understand compared to the other two and the sister application SI is also one that I find the most interesting. Both applications would be incredible outlets to produce VR videos with 3D modeled/rendered add ons. 

Week 6: Locations in Shanghai

These are some of the locations I found to be the most interesting! These locations have either been in Shanghai for a long period of time or have changed within the last few years – great for documenting the evolution of space. 

1.) 1933 – Old Slaughterhouse Shanghai 

The old slaughterhouse has incredible architecture and many different angles to take various photos or videos in!

2.) M50 Art District/Graffiti Park 

The M50 district is full of galleries that change seasonally, similar to the walls that are covered in graffiti art. 

3.) Shanghai Fake Market (Line 2 – Science  and Technology Museum)

The fake market also has considerable changes with new shops opening, moving, or closing based on season and the government/policing. 

Week 6: Rephotography

These are the works I found to be the most interesting! I particularly liked images that show drastic changes over time or moments that space is now utilized for a different purpose.

1.) Michael MartenSea Change 

Martin’s work showcases changes in environmental impacts over time with a focus on beaches and seashores.
https://lenscratch.com/2011/11/critical-mass-michael-marten/

2.) Mark Klett and Byron Wolfe The Grand Canyon 

Utilizes a mixture of photographs, postcards, and art to recreate spaces. 
https://slate.com/culture/2012/11/mark-klett-and-byron-wolfe-grand-canyon-images-then-and-now-photos.html

3.) Robert Cohen –  Holy Family Catholic Church 

Documents the change between the church from a place of worship to the new location of a marketing/ad agency. 
https://www.stltoday.com/news/multimedia/pictures/rephotography-a-new-word-for-an-old-photographer/article_83a36db4-4431-11e0-acf6-00127992bc8b.html