Week 11: Top 4 VR/AR news of the week – Alex Wang

Task:

VR/AR News of the Week has closed for the season with 92 entries, all of which we’ve seen at least briefly in class. Some of the stories will be looked back in 5 years and be considered accurate, prophetic, powerful. Others will be looked back in 5 years and be considered off-track, clueless, and ridiculousPLEASE SELECT YOUR TOP 4 OF EACH. Post with a detailed description of why you’ve selected them in Documentation and be prepared to present.

 Accurate, prophetic, powerful:

1.FACEBOOK Brain Interface

I believe that the FACEBOOK acquisition of CTRL Labs is a big step towards the development of brain controlled VR. Though it still seems like that a truly functional brain interface is still many years away from what technology we have right now, I do believe that this will be one of the most powerful and game-changing technology related to Virtual Reality.

2. Massage Chair VR

I am a big fan of massages, so I really do see potentials in this combination. A major advantage of VR is to have freedom in the environment you are surrounded with, making it very easy for VR games to create certain moods as opposed to more traditional mediums. That includes the mood of a very relaxed and zen feeling. Having a comfortable lake environment around you, or even some kind of space environment can definitely elevate the whole massage experience.

3. Dream Walk

Dream walk seems like a silly idea at first but I think it has great potential if used properly.  Having VR on  when you are walking is just too dangerous, if it could blend AR techniques into this product, this could be a great tool to provide utility. Imagine having maps, and text messages in your eyes when you are walking down the street. Maybe even arrows on the ground to guide you to your destination or warnings when there are cars near by. The potentials are limitless. 

4. VR Skin

Aside from VR brain interfaces, the next big thing to make the virtual more realistic is to feel haptics. VR skins, gloves, vest, or whatever it takes to fool your senses is the next thing to achieve after getting the visuals right. Through examples we explored in class, I am aware that even the slightest changes in senses can greatly contribute to the immersing experience and make VR more real. This is why I believe VR skin and other haptic products will be a great deal in the next 5 years.

Off-track, clueless, and ridiculous.

  1. also FACEBOOK Brain Interface

as much as I like the idea of a brain controlled VR technology, I also think CTRL Lab is one of the most off-track companies. As most science fiction and mainstream culture predicts, the only way to achieve brain powered VR is by plugging a chord into your body. Movies like The Matrix or ExistZ that we watched in class both suggests this kind of technology. I do not deny the potentials of other alternatives to approach brain-computer interaction but I just don’t buy CTRL Lab’s wristband idea. I do not believe that pulse is enough information to execute brain commands accurately.

2. Virtual Graffiti

 I do not see virtual graffiti as something that will be popular, nor do i see it as a good application of the AR technology.  Though Pokemon Go was very successful during its launch, I would like to argue that most of its success came from the brand of Pokemon as opposed to the innovative technology. Virtual graffiti not only lack a big brand to back it up, it also lacks a rich interactive experience like the Pokemon Go game. Which is why I do not believe that virtual graffiti will be successful.

3. Phone based VR is over

I agree with many points made in the article on how computer based VR will take over phone based VR but I also believe that 5 years later phone based VR will become the trend. This is because that the phone VR we have today does not have the proper set up we need for a smooth experience, there is both a lack of controllers and also a lack of processing power to match the needs of a VR program. There are already many attempts right now on making phone gaming more professional, multiple gaming gear companies are shifting their focus onto making phones specifically for gaming. There are so many advantages to having phone VR over computer VR, there will no longer be wires attached, and that it is much more convenient and small in size. The controller problem can also easily be solved with the help of machine learning, FACEBOOK is already implementing gesture detection through front cameras on their Oculus devices, this is perfect for phones since most phones have cameras on the back, the new iPhone has multiple cameras on the back.

4. VR Concerts

I am very passionate about music but I do not think VR concerts will be something that is going to work. There are many obstacles from achieving a good concert experience, the sound of a concert is very hard to replicate. This would require expensive audio gear along with VR headsets to replicate the kind of sound you hear at a concert, also big sub woofers to replicate the kind of vibrations in the body from bass frequencies. Even if all that is properly replicated, the whole point of seeing a concert live as opposed to listening to a studio quality recording at home is to meet the artist in real life. A VR mock off would lack the ability to interact with the performers, making the whole point of seeing a concert void.

VR Tools Review

GOAL 

Take a comprehensive look around Mettle’s Mantra VR, Foundry’s Cara VR (including Nuke compositing), and Boris FX Mocha (and Continuum). These are the most popular high-end tools for VR and VR effects (like compositing). Keep any eye out for possible applications for your project.
Write your thoughts and observations about these tools in documentation. What do they do? What are their highest priorities? What do they tell you about the state of VR and AR today?

Continue reading “VR Tools Review”

Week 11: VR & VR Effects (Repost&Update)

I’ve recently been using 3D modeling software for class (Rhino) and my primary goal or interest was to find methods of integrating it into these applications and my final project. I wanted to find other applications that can be used in conjunction with the MochaVR, MantraVR, and CaraVR. 

Key Takeaways: 

BorisFX – MochaVR  – SI – MochaVR has a sister software called Silhouette that focuses primarily on non invasive/abrasive paint that allows users to take a more graphics driven approach to VR effects. This however, is an extra software that is just as expensive but the features are STUNNING and something I’d be willing to invest in. Best Feature: Layout – the layout of programs by BorisFX is very similar to other art programs like Photoshop or Lllustrator. If I were the user/consumer this is what I’d prefer as the controls seem the most familiar and with the least learning curve.

Mettle -Mantra VR- Shapeshifter: Mantra VR has a extra software that acts as a plug-in called ShapeShifter AE. However, it is mainly limited by a lack of features (in comparison to the other 2) and  not as advanced with the features it offers. It is mainly used for AfterEffects while the others have better optimization for other applications. Best Feature: THE PRICE! The price point is good enough to be a good enough supplemental software to support MantraVR.

Foundry – CaraVR – Modo – Modo is another application that is focused more on amazing texturing and rendering tools. The program is quite intuitive and has a mid-price range. Best Feature: Modo’s workflows are very artist friendly, it’s very similar to what I’m used to in the past. This can make it easier to learn (ideally). It is also a powerhouse for lighting and shading effects as well as a power translator aka great for CAD formats and etc. 

If I were to invest in a particular software, I would invest monetrily and learning wise on MochaFX. The layout is a lot easier to understand compared to the other two and the sister application SI is also one that I find the most interesting. Both applications would be incredible outlets to produce VR videos with 3D modeled/rendered add ons. 

On 3 Products

During our shooting, while tracking the lifestream of the VR video, I started messing with the perspective a bit and got some interesting zooms that made me immediately wonder whether we are able to achieve same effects in AAE. 

Luckily, our the task for our next class happened to be the review of three products, and the very first of it, Mantra, appears to feature the exact effects for converting your footage to such spheric perspective. The latest version of Mantra added the ‘Spherify’ feature.

Cara is more of a technical tool, including stitching, correction and color matching, and the most important feature for our projects’ post-production – tracking & painting directly on the stereoscopic footage. 

From the materials represented on their website, Mocha seems to be an easy-to-use tool for various functions: Mocha Planar Tracking Tool makes it possible to remove objects, Area Brush Quick Masking Tool, Color Management, Mega Plates, etc. 

On high-end tools for VR and VR effects

Boris FX Mocha (and Continuum):

  • “Mega Plate module: Use planar tracking and temporal frame analysis to create extended stitched frames for advanced effects and clean up tasks”
  • Area Brush: Dynamic new paint tool with Quick Mask mode to quickly create tracking and masking layers

This is a powerful processing tool that tracking is (close to) ultimately nailed. It’s fascinating to see that no artificial points are needed in order to track something correctly while moving. This show a prospect in AI and can be well implemented in AR production: To remove actual objects in the view, or to augment it, if it could act in real time. For VR, when producing the immersive experience, this tool is also needed for easier manipulation of the scenes and objects shot or drawn.

 Mettle’s Mantra VR

  • A unique set of Drag-and-Drop effects to instantly transform your footage into surreal and fantastic animations.
  • A comprehensive set of 16 filters to stylize your 360° and Flat footage in After Effects and Premiere Pro.

This is a useful tool in post-production, though the selling point is its “user-friendliness”. Not so sure about what exact effect it could implement with regards to the filters.

 Foundry’s Cara VR (including Nuke compositing)

  • Seamless stitching of mono or stereo VR content
  • Powerful streamlined VR compositing workflows
  • Headset review inside Nuke

Although insta360 is providing the first two functions and we take it as granted, the tool is essential if one wants to customize the camera. But still, it is a basic tool needed for generating 360° videos.