Musical Gear Table [PCOMP ICM Final]

Musical Gear Table is my PCOMP / ICM Final for the 2017 fall semester in ITP, Tisch School of Arts. It is a musical / visual experience Which draws inspiration from physical / mechanical music boxes and gives it a digital interpretation.

The user assigns different musical patterns to six different instruments through digital inputs and rotates the physical gear to produce sound. The digital layer is projected on the physical gears and give the musical patterns unique visualization.

 

Creative Process:

I have always had an attraction to music and its structure. Drums always come first – High-hat that counts the tempo, kick drum drum that lays the beat down and the snare that snaps and brings the sharp staccato to the beat. Of course, after that comes the baseline, the melody and the harmony- synths keys, and everything else.

There are a lot of ways to bring music to life, the ingredients need balance, but the first thing they need is the tempo.

The initial plan was to build a table filled with gears of different sizes. The user will be prompted to build his own composition with the gears, similar to a puzzle. When done, he can turn the main gear – thus moving all the gears in correlation to that main gear. Each gear holds a certain element of the composition – a drum, cymbal, baseline, keys, synths and more –  and the user can choose weather he wants to add it to the recipe or not (editing a certain gears notes is an option too).

Each gear’s rotation speed will be measured by a rotary sensor that will play the gears part accordingly – all parts will be synced to the same master gear.   

Another element for this project is the visual projection. On each gear will be projected a visualization of the it’s instrument’s pattern . The user could change samples and patterns through an interface incorporated in the project. 

Thought process led to incorporate different size gears that would lead to polyrhythms in the track. This idea was eventually left behind. 

The initial technical specs included a Kinect controller(which was later dropped from the plan), Max MSP, Arduino and a limited set of buttons that were to control the array of gears, that plan changed later in the process.

 

Technical / production process:

Starting with physical exploration of laser cutting acrylic sheets I built a small mockup of the mechanism. This small prototype had a rotary encoder in it that picked up the current position of the gears and transmitted it VIA Arduino’s serial to the processing. 

First sketch of mechanical gear, cut on laser cutter

Processing was the main programing language and the place where all the visual and musical instrumentation data was stored. For producing and sequencing the sound I used Max/MSP. In Max, I’ve built a main sequencer patch that received the rotary encoder data from the Arduino VIA OSC signals transmitted from Processing. It translated that data to 32 step sequencer that looked like this:

The instruments used were different drum samples and two synthesizers built in Max/MSP.

After getting the audio part to work, I’ve started to build a working demo that incorporated a projection of the instrument’s pattern on the gear and the ability to edit an instrument’s pattern. I cut a thick piece of white acrylic sheet and mounted a two gears on a plank of wood.

Next step was to scale and produce a large prototype of all the gears. In this process I designed the final version of the table in Illustrator and laser cut it from birch wood. In this process I’ve added an Adafruit trellis controller that was mounted on the bottom part of the table. this controller is programmed to scroll between gears, add/remove notes and assign patterns from 12 different banked presets. also, I have incorporated a soft potentiometer to handle pitch shifting in the notes.

 

Adding the final gears to the table:

Design for the visual representation of each instrument was made in consideration of the instrument’s tone and shape of its sound, for instance, the bass drum would be round, snare would be sharp etc. synthesizers would have the ability to change their tone and pitch so layers of shapes were stacked and patterned on the gear to display the selected note.

————————————————————-

Musical Gear Table was presented at the 2017 ITP winter Show, Below you can find a couple demo video from users in the show.

Shadow Party – Halloween Trick [PCOMP Midterm]

‘Shadow party’ is an interactive shadow play especially for Halloween. For our Intro to Physical computation midterm Hadar Ben – Tzur and I were paired together to create a Halloween trick. After a few Ideas were tossed in the air we chose ‘Shadow Party’ as our project concept. The user is invited to control the dance movements while interacting with three different knobs and explore the surprising elements in the scene.  

A look inside
 
First sketches:
 
As a prototype, we laser cut a skeleton figure and created moving joints, in order to explore the movement and shadows using servo motors and LED lights.
 

 Later in the process we designed a 3d model as a mockup before fabricating, this helped us understand proportions and dimensions
 

3D model 
 
 

Gear table – final ICM / PCOMP assignment

I have always had an attraction to music and its structure. 

Drums always come first – High-hat that counts the tempo, kick drum drum that lays the beat down and the snare that snaps and brings the sharp staccato to the beat. Of course, after that comes the baseline, the guitar and then the harmony- synths keys, and anything else.

There are a lot of ways to bring music to life, the ingredients need balance, but the first thing they need is the tempo.

I have decided to have this as the concept for my final project, an interactive audio/visual music box that is generated through physical tempo.

I plan to build a table filled with gears of different sizes. The user will be prompted to build his own composition with the gears, similar to a puzzle. When done, he can turn the main gear – thus moving all the gears in correlation to that main gear. Each gear holds a certain element of the composition – a drum, cymbal, baseline, keys, synths and more –  and the user can choose weather he wants to add it to the recipe or not (editing a certain gears notes is an option too).

Each gear’s rotation speed will be measured by a rotary sensor that will play the gears part accordingly – all parts will be synced to the same master gear.   

Another element for this project is the visual projection. From the top will be projected a visualization for each cog that is added by the user by projection mapping. The user could change samples and patterns through an interface incorporated in the project. This will be coded in processing.

The Sound part will be synthesized in MAX MSP and controlled from Processing through OSC signals.

 

Clear table before inserting gears.

Gears and patterns projected after inserting gears.

System diagram.

Components include:

  • computer running processing + Max Msp
  • Arduino
  • projector
  • kinect camera
  • Pegboard 35″X20″
  • 8 X 7 “acrylic gears with IR stickers
  • Rotary incoder
  • 2 X big push buttons
  • 1 X rotary slider
  • Long HDMI
  • 2 X Long USB Cable

Table Music – planning

Table music is the temporary name for my final project.

I have sketched a rough plan for all the components and the communications between them:

TL:DR

A gear based music machine controlled by one rotary encoder mounted on a main handled gear. Players compose their own physical and musical compositions by placing gears on the peg board and editing their patters using physical buttons and digitally projected interface.

Components include:

  • computer running processing + Max Msp
  • Arduino
  • projector
  • kinect camera
  • Pegboard 35″X20″
  • 8 X 7 “acrylic gears with IR stickers
  • Rotary incoder
  • 2 X big push buttons
  • 1 X rotary slider
  • Long HDMI
  • 2 X Long USB Cable

 

PCOMP – Final project concept

I have always had an attraction to music and its structure. 

Drums always come first – High-hat that counts the tempo, kick drum drum that lays the beat down and the snare that snaps and brings the sharp staccato to the beat. Of course, after that comes the baseline, the guitar and then the harmony- synths keys, and anything else.

There are a lot of ways to bring music to life, the ingredients need balance, but the first thing they need is the tempo.

I have decided to have this as the concept for my final project in this course, an interactive audio/visual music box that is generated through physical tempo.

I plan to build a table filled with gears of different sizes. The user will be prompted to build his own composition with the gears, similar to a puzzle. When done, he can turn the main gear – thus moving all the gears in correlation to that main gear. Each gear holds a certain element of the composition – a drum, cymbal, baseline, keys, synths and more –  and the user can choose weather he wants to add it to the recipe or not (editing a certain gears notes is an option too).

Each gear’s rotation speed will be measured by a rotary sensor that will play the gears part accordingly – all parts will be synced to the same master gear.   

Another element for this project is the visual projection. From the top will be projected a visualization for each cog that is added by the user by projection mapping. The user could change samples and part through an interface incorporated in the project. 

First illustration of the gears in motion.

Illustration of the projection mapping.