René François Ghislain Magritte was a Belgian surrealist artist. He became well known for creating a number of witty and thought provoking images. Often depicting ordinary objects in an unusual context, his work is known for challenging observers’ preconditioned perceptions of reality.
Magritte’s work frequently displays a collection of ordinary objects in an unusual context, giving new meanings to familiar things. His use of different points of views and windows as objects that can be modified and flipped out of function in a visual composition is notable, especially In today’s AR situation, where digital portals and filters of different visual realities are a common, Magritte’s works are relevant than ever.
In this project I revisit 4 of Magritte’s paintings:
THE KING’S MUSEUSM, 1966
THE PROMISE, 1966
THE MEMOIRS OF A SAINT, 1960
LE BEAU MONDE, 1962
The promise, 1966
Le beau monde , 1962
Portrait of Germaine Nellens , 1960
The king’s museum, 1966
Each painting was treated with an AR interpretation to live in digital 3D space and to be explored from different points of view.
Moving to the states to start school involved packing all my stuff and sending it on a plane. My wife and I had the luxury of taking a few furnitures with us as had a small budget for shipment. We took clothes, obviously, a few books, furnitures, our two cats and our vinyl records collection, among other stuff. What we didn’t take was our record player. We thought we will buy a used one once we got here. that didn’t happen.
So now there are a few boxes filled with records, sitting unused in our apartment. Those records hold memories, of our past years, of our childhood and our culture. They are special to us, but we cant use them to do what they are intended to do – play music.
This got me thinking about reusing our records in a different way, use their visual content, which holds a lot of their appeal to us, as the material to augment and enrich them in a different way, to get the memories alive and to maybe experience them in a different light.
I chose one record dear to my heat – 100 first songs. This is a really popular children’s record in Israel that most kids from the 70′ till now grew up on it’s songs. Its beautiful cover was illustrated by israeli illustrator Kariel Gardosh.
For this project, I took the illustration of the cover and played with it in photoshop (cutting and masking the illustration) and unity to build an augmented animation on top of the record itself. Using Vuforia, I placed the Illustration on the record and got the record’s songs playing as it animates through.
This is just a demonstration of how we could start using the visual content and the audio on the physical object using AR, the possibilities to explore are limitless.
I would like to build a multiplayer audio visual musical experience in the browser. I imagine an experience where people with different devices produce sounds and musical patterns to create a musical piece that might find its place in the same room, sonically, but not necessarily.
My goal is to create a browser based sequencer that is controlled with UI/Physical gestures from the player. The player will create sequences of sounds (percussive and melodic) using a digital device and will be able to see and hear other sounds emitting from other players that are connected to the app. The player would be able to edit other players patterns on the sequencer but with specific rules restrictions, having a gamification element to the experience.
Build a Java script sequencer.
Implement Tone.js for gestured driven sounds (click length – tone, accelerometer information etc).
Node.js, MongoDB, Socket.io to manage session information between users.
For this weeks learning I went in to the ground planes feature in the Vuforia Unity library.
This feature, which is native in unity, allows the user to use Vuforia plug-in to detect real world floors using the Vuforia AR Camera and to use the information captured to emulate planes in unity and to interact in space, similar to apple’s ARkit feature.
To test out and to learn how the feature works I took Rene Magritte’s painting from 1956, ‘Sixteenth of September’.
Growing from the earth to the sun, a tree is an image of certain happiness. To perceive this image we must be immobile like the tree. When we are moving, it is the tree which becomes the spectator. It is witness, equally, in the shape of chairs, tables and doors, to the more or less agitated spectacle of our life. The tree, having become a coffin, disappears into the earth. And when it is transformed into fire, it vanishes into air.”
I find this quote by the artist interesting, lovely and a bit sad. he talks about points of view and movement (through time and space), which I think correlates to the subject of our class.
In continuation to my previous exercise, working with Magritte’s painting, I created an AR translation to this piece.
Firstly, I took a 3D model from turbosquid that a close resemblance to the paintings tree, modified it and then imported it into unity as a .FBX file. Than, I colored the textures in photoshop and placed the textures on the tree and its leaves.
Secondly, for the moon part I placed a 2D sprite on the scene and attached a look at code to it, making the illusion that it is always on the same place no matter which angle the user is at the moment.
I have started building my jitter patch and running my footage, recorded from the first week, through it. Most of the videos that I chose to record and play with for this week were shot on 120 fps, so this is a feel in the videos that I wanted to preserve and and mess around with..
Starting with a basic play functions – scrubbing and looping, transform and simple color correction functions in the top of each player(currently two players that run videos). in the lower part I created mixing abilities based on luminance key and basic blend options.
Currently, the performance is shaping up to be layers of video images superimposed on each other in different styles and ideas, displaying night themes of streets on the city. Hoping that the themes from the images will connect through the playing technic or with the juxtapositioning between them.