Brainstorming

I’m still unsure as to what my midterm project will be, but I’m putting out a few scattered ideas in hopes that writing about them will help.

1. I am interested in the idea of physical computing in interactive art, but also taking that a little bit further so that the “result” of the interaction is not only present on the screen, through sound, etc. but can also be physically felt through physical objects. (ex: holding an object, which then sends a vibration). 
2. There’s also the idea of using interactive art to enliven things that already exist within our day-to-day lives and memories. So instead of projecting abstract images, colors and shapes for example, I also want to find a way to project concrete things like a collection of words, geographical maps, popular imagery, etc. and presenting the audience with the ability to manipulate them, or create different meanings out of them. 
3.  Finally, going off of the idea of inter-human relationships in interactive art (Interactive Installations), I am interested in the idea of creating something wherein the audience will have to depend on one another, or work together in some way. This could either be an entirely “group-based” approach (with regards to the audience/group of interactors), or it can be a little “bonus” to what could otherwise also work with one interactor. However, in order to achieve something like that, I will need to think a bit more deeply about the interaction, its multiple outcomes, and how to direct it without being too imposing . On a more technical note, this idea can potentially also be more complex to program. Therefore, I might have to revisit it later on in the course, perhaps towards the final project. 

Here are two simple examples that helped me think a little bit more about some of the previous ideas:

This interactive animation (where you can move/change the painting using hand movement) is somewhat similar to the idea I talked about, wherein interactive art can be used as a way to manipulate, re-view and re-think popular imagery. 

I also like the idea of our bodies being used to “uncover” a certain image. This can also kind of be gamified, as the interactor attempts to solve the puzzle using their bodies and the space around them. If I were to create a project similar to this, I would want to also add an extra layer (or maybe not?) such as sound, or haptics. While this example here is more playful, I think the basis of this idea can be developed further in multiple directions. 

I am still somewhat undecided about my midterm project idea, but I think that I want to create something where: the interactor uses his/her body to uncover an image that is otherwise hidden–although I’ll need to think a bit more deeply about the what exactly that image would be, and how it would create a meaningful interaction. Although I am reluctant about creating a piece aimed towards multiple interactors, I think it would be cool to have that element of people coming together to uncover/excavate a projection with their bodies. 

In an attempt to explore the idea of uncovering/revealing/excavating, I played around with some Processing examples:

In this example, clicking the mouse and dragging it accross the sketch “inverts” the image. I want to be able to do something similar to this in principle, by projecting the image and tracking the interactor’s hands using a Kinect camera so they would be able to create a similar effect with the projected image:

Here’s the code: 

//credits: Image reveal effect testing by Λ B H I N Λ V . K R (openprocessing.org)


PImage img; 
int w; 
void setup() {
size(1000,667);
img = loadImage("1.png");
w = width/2;
}

void draw() { 
background(-1); 
if(mousePressed)w = mouseX;
PImage temp1 = img.get(0, 0, width, height);
PImage temp2 = img.get(w, 0, width, height);
image(temp1, 0, 0);
temp2.filter(INVERT);
image(temp2, w, 0);
//stroke(-1);
line(w, 0, w, height);
}

In this example, the mouse can be toggled/clicked to reveal an image (by painting it) using squares. The process takes some time and I’ve only captured the last part of it, so it would be fun  if I were to use some of this code, but also improve it so the shapes can accumulate to reveal the image faster, and of course also replacing the mouse interaction with the interactor’s fingers or an object ( ex: a laser pointer).

//credits: Reveal/Redraw an Image by Joseph Grennier (openprocessing.org)


INSTRUCTIONS: 
Toggle square/circle: click mouse or trackpad
Decrease brush size: `
Increase brush size: 1
Clear screen: 2
*/

//3 part structure

//part 1: declaration of global variables
float brush;
float xPos, yPos;
PImage cat;
boolean clicked = false;

//part 2: void setup()
void setup() {
  size (720, 480);
  smooth();
  noStroke();
  background(0);
  brush=10;
  cat=loadImage("cat.jpg");
}

//part 3: void draw()
void draw() {
  if(clicked==false) {
    rect(xPos, yPos, brush, brush);
  }else{
    ellipse(xPos, yPos, brush, brush);
  }
  xPos = mouseX;
  yPos = mouseY;
  fill(cat.get(mouseX,mouseY));
}

void mouseClicked() {
  if(clicked==false) {
    clicked=true;
  }else{
    clicked=false;
  }
} 

void keyTyped() {
  if(key=='0' & brush>2){
    brush-=2;
  }
  if(key=='1' & brush<60){
    brush+=2;
  }
  if(key=='2'){
    background(0);
  }
}