LIPP – Final [Keep This Time Its Running Out]

Keep This Time Its Running Out [temporary name] would be a physical audio visual performance where each pendulum controls a clip recorded live.

Each clip’s time (current frame) will be controlled by an assigned pendulum, this will produce the effect of each clip shortens over time, creating polyrhythms between the clips eventually ending in 4 single notes.

A sketch:

Magic Window final – The portals of René Magritte

 

 

René François Ghislain Magritte was a Belgian surrealist artist. He became well known for creating a number of witty and thought provoking images. Often depicting ordinary objects in an unusual context, his work is known for challenging observers’ preconditioned perceptions of reality.

Magritte’s work frequently displays a collection of ordinary objects in an unusual context, giving new meanings to familiar things. His use of different points of views and windows as objects that can be modified and flipped out of function in a visual composition is notable, especially In today’s AR situation, where digital portals and filters of different visual realities are a common, Magritte’s works are relevant than ever.

In this project I revisit 4 of Magritte’s paintings:

THE KING’S MUSEUSM, 1966
THE PROMISE, 1966
THE MEMOIRS OF A SAINT, 1960
LE BEAU MONDE, 1962

 

The promise, 1966

 

Le beau monde , 1962

 

Portrait of Germaine Nellens , 1960

 

The king’s museum, 1966

 

Each painting was treated with an AR interpretation to live in digital 3D space and to be explored from different points of view.

 

Process:

 

 

 

 

 

Magic Windows – Object Augmentation

Moving to the states to start school involved packing all my stuff and sending it on a plane. My wife and I had the luxury of taking a few furnitures with us as had a small budget for shipment. We took clothes, obviously, a few books, furnitures, our two cats and our vinyl records collection, among other stuff. What we didn’t take was our record player. We thought we will buy a used one once we got here. that didn’t happen.

So now there are a few boxes filled with records, sitting unused in our apartment. Those records hold memories, of our past years, of our childhood and our culture. They are special to us, but we cant use them to do what they are intended to do – play music.

This got me thinking about reusing our records in a different way, use their visual content, which holds a lot of their appeal to us, as the material to augment and enrich them in a different way, to get the memories alive and to maybe experience them in a different light.

I chose one record dear to my heat – 100 first songs. This is a really popular children’s record in Israel that most kids from the 70′ till now grew up on it’s songs. Its beautiful cover was illustrated by israeli illustrator Kariel Gardosh.

 

Augmentation

For this project, I took the illustration of the cover and played with it in photoshop (cutting and masking the illustration) and unity to build an augmented animation on top of the record itself. Using Vuforia, I placed the Illustration on the record and got the record’s songs playing as it animates through. 

This is just a demonstration of how we could start using the visual content and the audio on the physical object using AR, the possibilities to explore are limitless. 

DWD Final Class proposal – Multiplayer Browser Sequencer [temp name]

Vision

I would like to build a multiplayer audio visual musical experience in the browser. I imagine an experience where people with different devices produce sounds and musical patterns to create a musical piece that might find its place in the same room, sonically, but not necessarily. 

Goal

My goal is to create a browser based sequencer that is controlled with UI/Physical gestures from the player. The player will create sequences of sounds (percussive and melodic) using a digital device and will be able to see and hear other sounds emitting from other players that are connected to the app. The player would be able to edit other players patterns on the sequencer but with specific rules restrictions, having a gamification element to the experience.

Plan

  • Build a Java script sequencer.
  • Implement Tone.js for gestured driven sounds (click length – tone,  accelerometer information etc).
  • Node.js, MongoDB, Socket.io to manage session information between users. 

Magic Windows Week 03 – Ground Planes

For this weeks learning I went in to the ground planes feature in the Vuforia Unity library.

This feature, which is native in unity, allows the user to use Vuforia plug-in to detect real world floors using the Vuforia AR Camera and to use the information captured to emulate planes in unity and to interact in space, similar to apple’s ARkit feature.

To test out and to learn how the feature works I took Rene Magritte’s painting from 1956, ‘Sixteenth of September’.

Growing from the earth to the sun, a tree is an image of certain happiness. To perceive this image we must be immobile like the tree. When we are moving, it is the tree which becomes the spectator. It is witness, equally, in the shape of chairs, tables and doors, to the more or less agitated spectacle of our life. The tree, having become a coffin, disappears into the earth. And when it is transformed into fire, it vanishes into air.”

I find this quote by the artist interesting, lovely and a bit sad. he talks about points of view and movement (through time and space), which I think correlates to the subject of our class.

In continuation to my previous exercise, working with Magritte’s painting, I created an AR translation to this piece.

Firstly, I took a 3D model from turbosquid that a close resemblance to the paintings tree, modified it and then imported it into unity as a .FBX file. Than, I colored the textures  in photoshop and placed the textures on the tree and its leaves. 

Secondly, for the moon part I placed a 2D sprite on the scene and attached a look at code to it, making the illusion that it is always on the same place no matter  which angle the user is at the moment.