Author: rw2440

In our final project, we plan to create a moving object which will be controlled by the movement of the balance board. Therefore, we choose the object workshop to better know how to create an object in processing. We managed to control where objects appear and when to remove them by using “mousePressed” and “keyPressed”. Based on this, we will try to control the object with the sensor and a specific tool we make.

//float x;
//Emoji e;
//Emoji f;
ArrayList<Emoji> emojiList;

void setup() {
  size(1600, 900);
  emojiList=new ArrayList<Emoji>();
  //for (int i=0; i<10; i++) {
  //  emojiList.add(new Emoji(random(width/2), random(height/2), color(random(255), random(255), random(255))));
  //}
  //e= new Emoji(width/2,height/2,color(random(255),random(255),random(255)));
  //f=new Emoji(width/3,height/3,color(random(255),random(255),random(255)));
}

void draw() {
  background(255);
  fill(200);
  for (int i=0; i< emojiList.size(); i++) {
    Emoji e = emojiList.get(i);
    e.display();// same as emojiList[i]
    e.move();
  }
  //e.display();
  // f.display();
}



void mousePressed() {
  float x= map(mouseX, 0, width, width/8, width/2);
  float y= map(mouseX, 0, width, width/8, width/2);
  
  emojiList.add(new Emoji(x, y, color(random(255), random(255), random(255))));
}

void keyPressed() {

    emojiList.remove(emojiList.size()-1);
  
  
}

class Emoji {
  float x, y;
  float size;
  color clr;
  String type;
  float spdX;
  float spdY;
  //type="simley-face";
  //  if(type == "")//never give things value at the top.  
  Emoji(float startingX, float startingY, color startingColor) {
    x=startingX;
    y=startingY;
    size=random(50, 100);
    clr=startingColor;
    spdX= random(-5,5);
    spdY= random(-5,5);
}
  void display() {
    fill(clr);
    ellipse(x, y, size, size);
    fill(255);
    //size=random(50,100);
    ellipse(x-size/4, y-size/6, size/4, size/2);
    ellipse(x+size/4, y-size/6, size/4, size/2);
  }
  void move(){
    x= x+spdX;
    y= y+spdY;
  }
}

// IMA NYU Shanghai
// Interaction Lab
// This code receives one value from Arduino to Processing 

import processing.serial.*;


Serial myPort;
int sensorValue;
PImage photo;
float b=1;
float px;



void setup() {
  size(360, 640);
  photo = loadImage("Liuwen.jpg");

  printArray(Serial.list());
  // this prints out the list of all available serial ports on your computer.

  myPort = new Serial(this, Serial.list()[0], 9600);
  // WARNING!
  // You will definitely get an error here.
  // Change the PORT_INDEX to 0 and try running it again.
  // And then, check the list of the ports,
  // find the port "/dev/cu.usbmodem----" or "/dev/tty.usbmodem----" 
  // and replace PORT_INDEX above with the index number of the port.
}


void draw() {
  image(photo, 0, 0);
 // px=sensorValue;
  printArray(sensorValue);
  // to read the value from the Arduino
  while ( myPort.available() > 0) {
    sensorValue = myPort.read();
  }
  // image(photo, 0, 0);
  //filter(BLUR, b);
  //b= b+0.1;
  if (sensorValue >= 0 && sensorValue< 60) {
    filter(INVERT);
  } else if (sensorValue >= 40 && sensorValue< 80) {
    filter(BLUR, 6);
  } else if (sensorValue >= 80 && sensorValue< 120) {
    filter(GRAY);
  } else if (sensorValue >= 120 && sensorValue< 160) {
    filter(THRESHOLD);
  } else if (sensorValue >= 160 && sensorValue< 200) {
    filter(POSTERIZE, 4);
  } else if (sensorValue >= 200 && sensorValue< 255) {
    filter(BLUR, b);
    b= b+0.1;
  }
}

Reflection:
The first thing I learned during the processing is that the processing page shows an error and we can not find any mistake of the content, we can check if the position of brace is correct. Another is that we can map in the Arduino. In the processing, sometimes we may come across some unknown problem with mapping. After reading Golan Levin’s essay, I gain a different perspective of the whole-body interaction. At first, we want to use a balance board and add sensors to that board to transfer input. While the example of “Interaction modules from Myron Krueger’s Videoplace, 1969-­1975″ inspires me that we can install sensors to our body to trace our movements and transfer them to the computer directly. If we add the sensors to the balance board, it may overreact because some of our movements are out of balance. If may hard to use the balance board to send instructions.

Keep the balance!
We want our project to integrate cooperation between humans, which means users need to interact not only with the device but also with people. So, we plan to make a game with the need of cooperation between friends. Bring your friend and play the game together!
In detail, we plan to make an interacting game with a balance board and the screen. Users need to stand on the board to keep balanced first, and then they will move toward different directions mainly with their upper part of the bodies to make the balance board lean to the corresponding direction. There will be images on the screen moving with the users’ movements. There will be instructions for us to know what we are supposed to do. Some of them can be accomplished by ourselves, while others need our friends and us to accomplish together. The concrete plan of carrying out the project is as follows:
1. After consulting Andy about the balance board, we are suggested that we should buy one online and adjust it according to our needs. We will add sensors to the balance board. Based on the delivering date, we may accomplish this by 2nd, December.
2. We want to use processing to create different scenarios. We will start on creating the image of the image and make the image move according to the Arduino input.
3. One difficulty we imagine is how to make the image move as we move. We may use the sensors on the balance board to perceive our movement and transfer the information through Arduino to the processing. Then the image on the screen will move based on the information.
Our inspiration comes from the online game and the discussion with our professor. We played an online game named “the bouncing ball”, from which we decided to make a simple game but use the tool that needs to interact with our body. However, the outcome will be too similar to the original version and we need to add more experience to our project. After our professor shows two examples which are “decoding the bomb” and controlling an image on a board controlled by hands respectively, we learned that we may add more cooperation part and focus on the different playing experience. How can we play a game with not just our hands? Inspired by the motion-sensing game, we believe we can use the whole body to play the game. To differ from the motion-sensing game, we think about the balance board as the tool but also the challenge. We stand on the board, instructing the direction to the image through it while restraining ourselves to keep balance. It is a game that needs you to relieve power while restraining yourselves. With the cooperation part, we want to drive people to retake the simple happiness that sets in the collaboration face to face. Some of the tasks even need you to touch each other to accomplish. Make people interact physically, assist with each other in a limited situation, and get closer hopefully, is the purpose of our project.

import processing.serial.*;

String myString = null;
Serial myPort;


int NUM_OF_VALUES = 2;   /** YOU MUST CHANGE THIS ACCORDING TO YOUR PROJECT **/
int[] sensorValues;      /** this array stores values from Arduino **/
//int x=sensor1;
//int y=sensor2;
float newvalue1;
float newvalue2;

float px;
float py;

void setup() {
  size(500, 500);
  background(0);
  setupSerial();
}


void draw() {
  px = sensorValues[0];
  py = sensorValues[1];
  updateSerial();
  printArray(sensorValues);
  newvalue1= map(sensorValues[0], 0, 1023,0, width);
  newvalue2= map(sensorValues[1], 0, 1023,0, height);
  ellipse(newvalue1,newvalue2, 100, 100);
  ellipse(sensorValues[0], sensorValues[1], 100, 100);
  // use the values like this!
   sensorValues[0] 
  //stroke(255);
  //line(newvalue1, newvalue2, px, py);
  
  // add your code

  //
}



void setupSerial() {
  printArray(Serial.list());
  myPort = new Serial(this, Serial.list()[0], 9600);
  // WARNING!
  // You will definitely get an error here.
  // Change the PORT_INDEX to 0 and try running it again.
  // And then, check the list of the ports,
  // find the port "/dev/cu.usbmodem----" or "/dev/tty.usbmodem----" 
  // and replace PORT_INDEX above with the index number of the port.

  myPort.clear();
  // Throw out the first reading,
  // in case we started reading in the middle of a string from the sender.
  myString = myPort.readStringUntil( 10 );  // 10 = '\n'  Linefeed in ASCII
  myString = null;

  sensorValues = new int[NUM_OF_VALUES];
}



void updateSerial() {
  while (myPort.available() > 0) {
    myString = myPort.readStringUntil( 10 ); // 10 = '\n'  Linefeed in ASCII
    if (myString != null) {
      String[] serialInArray = split(trim(myString), ",");
      if (serialInArray.length == NUM_OF_VALUES) {
        for (int i=0; i<serialInArray.length; i++) {
          sensorValues[i] = int(serialInArray[i]);
        }
      }
    }
  }
}

import processing.serial.*;

String myString = null;
Serial myPort;


int NUM_OF_VALUES = 2;   /** YOU MUST CHANGE THIS ACCORDING TO YOUR PROJECT **/
int[] sensorValues;      /** this array stores values from Arduino **/
//int x=sensor1;
//int y=sensor2;
float newvalue1;
float newvalue2;

float px;
float py;

void setup() {
  size(500, 500);
  background(0);
  setupSerial();
}


void draw() {
  px = sensorValues[0];
  py = sensorValues[1];
  updateSerial();
  printArray(sensorValues);
  newvalue1= map(sensorValues[0], 0, 1023,0, width);
  newvalue2= map(sensorValues[1], 0, 1023,0, height);
  //ellipse(newvalue1,newvalue2, 100, 100);
  //ellipse(sensorValues[0], sensorValues[1], 100, 100);
  //// use the values like this!
  // sensorValues[0] 
  stroke(255);
  line(newvalue1, newvalue2, px, py);
  
  // add your code

  //
}



void setupSerial() {
  printArray(Serial.list());
  myPort = new Serial(this, Serial.list()[0], 9600);
  // WARNING!
  // You will definitely get an error here.
  // Change the PORT_INDEX to 0 and try running it again.
  // And then, check the list of the ports,
  // find the port "/dev/cu.usbmodem----" or "/dev/tty.usbmodem----" 
  // and replace PORT_INDEX above with the index number of the port.

  myPort.clear();
  // Throw out the first reading,
  // in case we started reading in the middle of a string from the sender.
  myString = myPort.readStringUntil( 10 );  // 10 = '\n'  Linefeed in ASCII
  myString = null;

  sensorValues = new int[NUM_OF_VALUES];
}



void updateSerial() {
  while (myPort.available() > 0) {
    myString = myPort.readStringUntil( 10 ); // 10 = '\n'  Linefeed in ASCII
    if (myString != null) {
      String[] serialInArray = split(trim(myString), ",");
      if (serialInArray.length == NUM_OF_VALUES) {
        for (int i=0; i<serialInArray.length; i++) {
          sensorValues[i] = int(serialInArray[i]);
        }
      }
    }
  }
}

import processing.serial.*;

int NUM_OF_VALUES = 3;  /** YOU MUST CHANGE THIS ACCORDING TO YOUR PROJECT **/


Serial myPort;
String myString;

// This is the array of values you might want to send to Arduino.
int values[] = new int[NUM_OF_VALUES];

void setup() {
  size(500, 500);
  background(0);

  printArray(Serial.list());
  myPort = new Serial(this, Serial.list()[0], 9600);
  // check the list of the ports,
  // find the port "/dev/cu.usbmodem----" or "/dev/tty.usbmodem----" 
  // and replace PORT_INDEX above with the index of the port

  myPort.clear();
  // Throw out the first reading,
  // in case we started reading in the middle of a string from the sender.
  myString = myPort.readStringUntil( 10 );  // 10 = '\n'  Linefeed in ASCII
  myString = null;
}


void draw() {
  background(0);

  // changes the values
  //for (int i=0; i<values.length; i++) {
  //  values[i] = i;  /** Feel free to change this!! **/
  //}
values[0]= mouseX;
values[2]= mouseY;
if(mousePressed){
values[1]=1;
}
else{
  values[1]=0;
}


  // sends the values to Arduino.
  sendSerialData();

  // This causess the communication to become slow and unstable.
  // You might want to comment this out when everything is ready.
  // The parameter 200 is the frequency of echoing. 
  // The higher this number, the slower the program will be
  // but the higher this number, the more stable it will be.
  echoSerialData(200);
}

void sendSerialData() {
  String data = "";
  for (int i=0; i<values.length; i++) {
    data += values[i];
    //if i is less than the index number of the last element in the values array
    if (i < values.length-1) {
      data += ","; // add splitter character "," between each values element
    } 
    //if it is the last element in the values array
    else {
      data += "n"; // add the end of data character "n"
    }
  }
  //write to Arduino
  myPort.write(data);
}


void echoSerialData(int frequency) {
  //write character 'e' at the given frequency
  //to request Arduino to send back the values array
  if (frameCount % frequency == 0) myPort.write('e');

  String incomingBytes = "";
  while (myPort.available() > 0) {
    //add on all the characters received from the Arduino to the incomingBytes string
    incomingBytes += char(myPort.read());
  }
  //print what Arduino sent back to Processing
  print( incomingBytes );
}