Category: Eric

The Better Reader 

The Better Reader is a project to help people with dyslexia or people with reading issues be able to read with more agility and accuracy. It will draw its inspiration from dyslexia reading exercises and the game of Wack-A-Mole.

The project’s foundation will be to develop interaction between the computer (using Arduino and Processing), and the human user. First of all, it will have communication between two languages in the computer world, which are Arduino and Processing. These two together will be interacting together to create animation,  audio, text, and sound depending on the human’s response to the computer. The interaction that we will design is supposed to be easy for the users to figure out. This last will be explained in the following paragraph.

The Better Reader will draw upon common exercises that are used to improve eyesight, as well as exercises for reading more quickly, and will combine this with the concept of the Wack-A-Mole game. These exercises which we draw upon have also been proven useful for people with dyslexia. A user will see on the computer (Processing will be used for the animation) three columns of three words each (nine words in total). One word is going to blink (disappear and appear) from the top left one by one and row by row until it reaches the last word and it goes back to the top to start again. This will allow the user to direct his attention to the word that is blinking, facilitating the interaction between humans and machines. The program will randomly stop at any given word and it will ask the user to identify the last word that disappeared and appeared. It will give for options (four words), and if you select the correct word, the program will accelerate the word blinking pattern to make it harder for the user to follow along. The user will have three “lives” (opportunities to lose and keep playing). To make it more engaging we will use Arduino to connect to a console that has four electronic buttons. These electronic buttons will have the word options written on them. This means that we will have to program the buttons to give different four-word options on each level, and it will obviously have to include the right choice in one of the buttons. The user will have a time limit to choose the right answer; we are thinking of limiting this time to five seconds. We want to have a hammer similar to the one in the Whack-A-Mole game so that the users can quickly hit the given answer.  Furthermore, we would like to have a scoreboard with the ranking of the people that have “played” this game in hopes of incentivizing friendly competition.

This exercise should be useful as it would allow users to develop their peripheral view, their concentration, and their short term memory.  It is not going to feel like those tedious exercises that we who have dyslexia have to do but is rather going to feel like we are just playing a game.  I think that understanding the struggle of dyslexia will push our team to focus on creating not just an exercise for reading but a game that is fun. Something that can put learning and fun together. Hopefully, there will be much to gain not just for people with dyslexia but for everyone. 

In this week’s recitation, we were told to use Arduino and processing to manipulate the media attributes using the physical controller in Arduino. I decided to use an image to be manipulated. At first, i was using the position of the x and y of the mouse to change the size of the image, but i decided that it does not fit what i was going to do. I want to use two potentiometers to control two different things in the image. One potentiometer to control the length of the snow on the bottom of the image, the other one is for the snow that falls. I made the snow with for loops that we learned in class, but i made some modifications to make it seem smaller and use the value from the potentiometer to control the frequency of the for loop.

The code is attached below:

Arduino

void setup() {
Serial.begin(9600);
}

void loop() {
int sensor1 = analogRead(A0);
int sensor2 = analogRead(A1);
/// int sensor3 = analogRead(A2);

// map(sensor1, 0, 1023, 0, 255);

// keep this format
Serial.print(sensor1);

Serial.print(“,”); // put comma between sensor values
Serial.print(sensor2);

// Serial.print(“,”);
// Serial.print(sensor3);

Serial.println(); // add linefeed after sending the last sensor value

// too fast communication might cause some latency in Processing
// this delay resolves the issue.
delay(100);
}

Processing

import processing.serial.*;
PImage photo;
String myString = null;
Serial myPort;


int NUM_OF_VALUES = 2;   /** YOU MUST CHANGE THIS ACCORDING TO YOUR PROJECT **/
int[] sensorValues;      /** this array stores values from Arduino **/
//float psensorValue0;
//float psensorValue1;

void setup() {
  size(800, 800);

  photo = loadImage("image.jpeg");
  setupSerial();
}


void draw() {
    background(#74CFD8);
  updateSerial();
  printArray(sensorValues);
  float m = map(sensorValues[0], 0, 1023, 0, 100);
   float n = map(sensorValues[1], 0, 1023, 0, height); //left
  image(photo, 0, 0, width, height);
 for (int i=0; i<m; i++) {
    int size = int( random(1, 15) );
    int x = int( random(photo.width) );
    int y = int( random(photo.height) );
    // get the pixel color
    color c = photo.get(x, y);
    // draw a circle with the color
    fill(#FFFFFF);
    noStroke();
    ellipse(x, y, size, size);
    rectMode(CENTER);
    rect(400, 800, 800, n);
  //  filter(BLUR, m);


}}



void setupSerial() {
  printArray(Serial.list());
  myPort = new Serial(this, Serial.list()[ 3 ], 9600);
  // WARNING!
  // You will definitely get an error here.
  // Change the PORT_INDEX to 0 and try running it again.
  // And then, check the list of the ports,
  // find the port "/dev/cu.usbmodem----" or "/dev/tty.usbmodem----" 
  // and replace PORT_INDEX above with the index number of the port.

  myPort.clear();
  // Throw out the first reading,
  // in case we started reading in the middle of a string from the sender.
  myString = myPort.readStringUntil( 10 );  // 10 = '\n'  Linefeed in ASCII
  myString = null;

  sensorValues = new int[2];
}



void updateSerial() {
  while (myPort.available() > 0) {
    myString = myPort.readStringUntil( 10 ); // 10 = '\n'  Linefeed in ASCII
    if (myString != null) {
      String[] serialInArray = split(trim(myString), ",");
      if (serialInArray.length == NUM_OF_VALUES) {
        for (int i=0; i<serialInArray.length; i++) {
          sensorValues[i] = int(serialInArray[i]);
        }
      }
    }
  }
}