Particles – Installation by Daito Manabe and Motoi Ishibashi

Particles

Particles is an installation by Japanese artists Daito Manabe and Motoi Ishibashi created in 2011. In it, wirelessly controlled illuminated LED light balls travel through an 8-spiral shape rail, imitating a rollercoaster ride. 

The position of each ball is determined via total of 17 control points on the rail. Every time a ball passes through one of them, the respective ballʼs positional information is transmitted via a built-in infrared sensor. Sound is generated via digital synthesis every time the ball passes through one of these check points – the luminance information of the ball’s LED pattern is picked up by the sensor and is being translated to midi parameters to produce sounds that are played through 8 channel speakers. In fact, the movement of the balls, their speed and the way they flicker is the score of this generative piece.

A touch screen UI allows the user to interact with the system. By using it he can change the LED lights patterns through time, changing in effect, the characteristics of the sounds, its rhythm and other properties.

System plan

 

I find the use of movement and light manipulation as a mean to produce notations for a sound in this piece extremely interesting. Balancing the control that the observer has on the system with nature’s randomness makes an interesting piece to watch, both visually and sonically.

   
 

LIPP – Final [Keep This Time Its Running Out]

Keep This Time Its Running Out [temporary name] would be a physical audio visual performance where each pendulum controls a clip recorded live.

Each clip’s time (current frame) will be controlled by an assigned pendulum, this will produce the effect of each clip shortens over time, creating polyrhythms between the clips eventually ending in 4 single notes.

A sketch:

Magic Window final – The portals of René Magritte

 

 

René François Ghislain Magritte was a Belgian surrealist artist. He became well known for creating a number of witty and thought provoking images. Often depicting ordinary objects in an unusual context, his work is known for challenging observers’ preconditioned perceptions of reality.

Magritte’s work frequently displays a collection of ordinary objects in an unusual context, giving new meanings to familiar things. His use of different points of views and windows as objects that can be modified and flipped out of function in a visual composition is notable, especially In today’s AR situation, where digital portals and filters of different visual realities are a common, Magritte’s works are relevant than ever.

In this project I revisit 4 of Magritte’s paintings:

THE KING’S MUSEUSM, 1966
THE PROMISE, 1966
THE MEMOIRS OF A SAINT, 1960
LE BEAU MONDE, 1962

 

The promise, 1966

 

Le beau monde , 1962

 

Portrait of Germaine Nellens , 1960

 

The king’s museum, 1966

 

Each painting was treated with an AR interpretation to live in digital 3D space and to be explored from different points of view.

 

Process:

 

 

 

 

 

Magic Windows – Object Augmentation

Moving to the states to start school involved packing all my stuff and sending it on a plane. My wife and I had the luxury of taking a few furnitures with us as had a small budget for shipment. We took clothes, obviously, a few books, furnitures, our two cats and our vinyl records collection, among other stuff. What we didn’t take was our record player. We thought we will buy a used one once we got here. that didn’t happen.

So now there are a few boxes filled with records, sitting unused in our apartment. Those records hold memories, of our past years, of our childhood and our culture. They are special to us, but we cant use them to do what they are intended to do – play music.

This got me thinking about reusing our records in a different way, use their visual content, which holds a lot of their appeal to us, as the material to augment and enrich them in a different way, to get the memories alive and to maybe experience them in a different light.

I chose one record dear to my heat – 100 first songs. This is a really popular children’s record in Israel that most kids from the 70′ till now grew up on it’s songs. Its beautiful cover was illustrated by israeli illustrator Kariel Gardosh.

 

Augmentation

For this project, I took the illustration of the cover and played with it in photoshop (cutting and masking the illustration) and unity to build an augmented animation on top of the record itself. Using Vuforia, I placed the Illustration on the record and got the record’s songs playing as it animates through. 

This is just a demonstration of how we could start using the visual content and the audio on the physical object using AR, the possibilities to explore are limitless. 

DWD Final Class proposal – Multiplayer Browser Sequencer [temp name]

Vision

I would like to build a multiplayer audio visual musical experience in the browser. I imagine an experience where people with different devices produce sounds and musical patterns to create a musical piece that might find its place in the same room, sonically, but not necessarily. 

Goal

My goal is to create a browser based sequencer that is controlled with UI/Physical gestures from the player. The player will create sequences of sounds (percussive and melodic) using a digital device and will be able to see and hear other sounds emitting from other players that are connected to the app. The player would be able to edit other players patterns on the sequencer but with specific rules restrictions, having a gamification element to the experience.

Plan

  • Build a Java script sequencer.
  • Implement Tone.js for gestured driven sounds (click length – tone,  accelerometer information etc).
  • Node.js, MongoDB, Socket.io to manage session information between users.