IMB Capstone: Mentor Reflection (Week 1)

For this week’s meeting with my mentor, I worked with Professor Brandenburger with some help from Professor Alex Ruthmann as well for the brainstorm. For my project, I want to focus on the intersectionality between education, technology, and social media, as well as how that supports student’s social-emotional well-being. Since my question was quite broad, I got some help from my mentor to narrow it down, as well as consider other questions with a startup mindset.

Link to mentor presentation

Motivation

My main motivation for this project stems from my frustration as a college student going through online learning. Since the pandemic, I have adjusted to online learning using zoom and other technology. However, the quality of lectures hasn’t been the best, and I also felt emotionally unsupported from the remote environment. After speaking with some of my peers, I realized that it is a common pain point of online school, ad how that left many students emotionally down and overwhelmed. This has also been a difficult situation to navigate, especially for students of marginalized groups.  Although the covid-19 situation has gotten better in some capacity, e-learning is here to stay. The online learning and education technology market isn’t perfect, and has a lot of potential to grow as a booming sector. Therefore, these reasons motivated me to concentrate my capstone around education technology and how to build a system/platform that helps students during this time, and to improve online learning.

Question #1:  How can online applications connect students with one another in a supportive and efficient manner?

For this question, I thought about how the social aspect/connection part of college has been extremely difficult and changed due to the pandemic. Many people I talked to and researched about have shown signs of depression and felt low during this time. I thought about maybe creating an application that allows students to connect with other students in their classes, university, and/or major in a one-stop-shop manner. Since many universities have large Facebook groups that are often uncategorized, I thought about creating a better-managed system that can categorize different aspects of being a college student, and support them. My inspiration stems from the NYUAD Room of Requirement Facebook group where students ask everything in. In addition, this may include course selection help, more inquiries about professors (that are not on rate my professors), dorm, extracurriculars, internships, and other areas as needed. This can serve as a support network ad social platform that allows students to meet other students in their classes through a short bio and photos + interests w/o utilizing other social media platforms.

Question #2: How can Educational Technology tools improve Student’s Social-emotional Learning and Cultural Competence? 

For this idea, I think social-emotional learning is a really interesting and important sector to examine. I thought about developing an e-learning platform or courses that provide support and social-well being courses for students through video-based technology. However, I still need to further develop this idea and conduct research, since the idea is very broad and hard to pinpoint.

Question #3: How can digital learning tools be used to support students’ learning outcomes and success?

For this idea, I want to focus on supporting student’s mental health specifically. I want to examine how to best support students using digital learning tools, so students can feel best supported, during this time and after the pandemic. I thought about building chat functions into pre-existing online learning platforms to engage with students and connect them to one another, making the process of meeting other students online easier.

Final thoughts

My mentors provided great feedback on scaling the problem, as well as inspirations for looking at pre-existing education technology tools, thinking about how to narrow down the problem, and define pain points for students using digital learning platforms. They also helped me think about who the buyers and ideal users are, with a business-driven mindset, and additional resources for prototyping. For my next steps, I will conduct more research on different student’s experiences with online learning, and how they can be best supported, to narrow down my problem. 

Recitation 10: Object-Oriented Programming Workshop – Ashley Zhu

For recitation, I chose to work on the object-oriented programming workshop with Tristan to learn more about this topic as well as animation. Tristan went over some fundamentals about classes, arrayLists, and objects. I learned how to use the animation function with classes and arrayList, so it’s good to practice and use the map function for more interactivity. I manipulated the map function so every time user click on the left arrow, the balls would appear and when clicked on a different key after pressing the left arrow, the balls will disappear.

Video:

CODE:

Ball ashleyBall;
Ball tristanBall;

float x;
ArrayList<Ball> ballList = new ArrayList<Ball>(); 

void setup(){
  size(1600,900);
  ballList = new ArrayList<Ball>(); 
  
  for(int i=0; i<100; i++){
  ballList.add(new Ball(random(-10,10), random(-10,10),color(random (255))));
  x=map(x,0,1023,0,width);
  }
    
}
void draw(){
  background(137,207,240);
  if (key == CODED) {
    if (keyCode == LEFT) {
     for(int i=0; i<ballList.size(); i++){
    Ball temp = ballList.get(i);
    temp.display();
    temp.move();
    } 
    
  }
  }
}

class Ball{
  float x,y;
  color c;
  float spdX, spdY;
  float r;
  Ball(float newSpdX, float newSpdY, color newColor){
    r=50;
    spdX= newSpdX;
    spdY= newSpdY;
    c=newColor;
    
    x=width/2;
    y=height/2;
    
  }
  void move(){
    x= x + spdX;
    y= y + spdY;
    
  }
  void display(){
    fill(c);
    ellipse(x,y,r,r);
  }
  
}

Final Project Reflection: “Who Are You to Judge?” By Ashley Zhu (Rudi)

My partner Megan See and I created the interactive project called “Who Are You to Judge?” to teach users about the U.S Criminal Justice System as they play the role of a judge and navigate through various real cases and make decisions and final verdicts on whether or not to convict/punish the defendant. 

Final Code in Github: https://github.com/ashlelayy/IXLFinalProject/blob/master/WhoAreYouToJudge

Brainstorm & Questions: https://docs.google.com/document/d/1jjoqQw6s-It60DUhyJQ-1kpc4E0fh_xQ_T_JP1SYoU4/edit?usp=sharing

CONCEPTION AND DESIGN:

For this project, we were inspired by The Marshall Project‘s online journalisms about criminal justice, as the website creates stories about incarcerated people and tries to educate people about the on-going issues in hopes of changing the system and inspiring people to go out and vote, to change public policies. We hoped to also create a movement for people to learn more about U.S criminal justice, and to inspire change, especially in light of the upcoming 2020 election.

Initially, my partner and I wanted to create a game centered around who is most likely to become a criminal, to test their judgements. We wanted to create quizzes and a drag-and-drop game to allow users to interact and decide to incarcerate an individual based on a specific task they performed or based on their background description. Another idea we had was to have users decide their own faith through an interactive audiovisual game to punish themselves, as if they were a person who has committed a crime. Also, we were going to have users strapped down to a chair using velcro and a solenoid motor, so if they users make a wrong decision, they would be punished and get lightly ‘buzzed’ or ‘shocked’ on the chair, to simulate the electric chair effect.

However, after talking to our professor, we tossed the ideas and kept the quiz bowl concept. Instead, we made a judging audiovisual game to simulate a judge making a verdict in a court. We used a gavel and striking block to mimic a real court experience, as the users are essentially playing the role of a Judge and making decisions. Users navigate through the game by making verdicts on 9 real cases.  For instance, we used some famous U.S court cases such as the Central Park 5, the Troy Davis Case, as well as the Rodney Alcaca case (Dating Game Killer). Our cases range from innocent defendants who received wrongful convictions to serial killer and school shooting cases. Some of the choices users need to make include giving life/death sentences, convicting a defendant, and determining whether or not the defendant is guilty or innocent.

When users select the correct answer (the real verdict), they move on to the next case, and when users select the wrong choice (wrongful conviction), the game stops and the screen displays texts that read “Check your assumptions. Here’s what actually happened…” and the real verdict (explanation of the case) is displayed, to educate users on what actually happened, as well as the implications of the case. This way, while users are interacting with the project, they are stimulated positively through thinking about the cases and how their decisions will affect a person’s life forever. 

For the design aspect, we wanted to keep the project minimal and sleek, therefore, we employed black and white colors as the main colors for the project. In addition, we used the “TravellingTypewriter” font to match the typewriter music we have as the background music and plays in accordance with the displaying of text on the screen. 

We also only decided to center around U.S laws and cases because my partner Megan and I were both very interested in the U.S criminal justice department in particular, and wanted to create a project centered around how sometimes our preconceived notions can cloud our interpretations of a scenario and case. Given the 10 second countdown, users are forced to quickly make a decision based on given information and what they believe in as the correct decision. We intentionally made the countdown option with 10 seconds to create a nervous feeling for the user, as they are rushed to make a decision that would determine a person’s fate, similar to real life scenarios, where a judge would have to make a final verdict given limited evidence and pressure/time crunch to make a ruling to a case.

FABRICATION AND PRODUCTION:

For fabrication, we used a 3D printer to print our interactive countdown timer as well as LED lights to display response from the system (ex. Red lights up with buzzer sound effect when user selects the wrong choice, which also lights up when users run out of time (10seconds)) The timer was used to create a nervous and rushed effect, so when users run out of time, they lose the game. 

 

During user testing, we originally had the keyPressed function as a form of interaction, as users navigated through the game, they would press on the left and right arrows. Then, we switched that form of interaction to sensors for more interactivity. Some users also suggested using Chinese laws as part of the cases. However, since my partner and I had limited knowledge of the Chinese criminal justice system, and the fact that we wanted to concentrate on U.S criminology, we ended up not following that suggestion. But, users did suggest adding music when getting answers correct/wrong and we did adopt that recommendation later on.

CONCLUSIONS:

In conclusion, we accomplished our original goals of educating the masses about the U.S criminal justice system. Through interaction with our project, users act as judges and decide on the outcomes of individual cases, as well as the implications one could have over someone else’s life. In addition, we included the actual verdicts of the real cases for users to understand more about how and why a certain decision was made. In terms of interactivity, I think we did meet my expectations and aligns with my definition of interaction, which is input, processing and output. Users communicate with the project through hitting the gavel on the sensor pads to make a verdict after reading a case, while thinking about the right judgement to make. Then, the system processes it and displays output of texts on screen, informing users of different questions and outcomes of cases for them to understand more about the U.S criminal justice system. In terms of inconsistency, I think my project did not align with my definition of interactivity since users can only answer up to 9 questions/cases. I wanted the project to be more interactive, where users can continuously interact with the project in a loop, however, was limited in this project due to time shortage. 

Users interacted with our projects with a lot of concentration, as many people took a long time to make a final decision and to judge the case. Sometimes, they would run out of time and would start over again to get the answers correct. Many users also liked the headphone component, so they can really immerse themselves in the game and think about the decisions that they make, since they can only hear music and sounds from the project itself.

If we had more time, we would want to code more scenarios for users to interact with, and add motors to ‘buzz’ users as a form of punishment if they got the answers wrong, in a form of negative reinforcement. In addition, we also want to add more media (ex. pictures , documents, videos) of the actual cases in the explanation for a more concrete and complete explanation of the cases. Also, we would want to make a box to store all the wires, so it would be more visually pleasing and easier to transport.

In terms of accomplishments, I learned a lot of UI/UX in terms of how the users interact with the actual product, and revising the product to produce a more user-friendly and satisfactory output. Moreover, I also learned more about interaction using Arduino and processing, as well as the collaboration between the two. Some values I learned from the project is to think outside the box, since we did have many different project ideas at first, which were scattered and all over the place. I learned about how to take one idea and develop the concept in a more focused and concentrated setting and to bring that ideation to life.

Therefore, I am satisfied with our project, considering how much work and effort we have put in throughout the process, as well as the final feedback from our peers. We hoped that this project allowed more people to understand the impacts of the quick judgements on people, and to never judge a book by its cover. Furthermore, I hoped our project allowed our peers to learn more about the U.S Criminal Justice system, as well as the changes that should be made in the future, to spark activism and for people to go out and vote in the upcoming 2020 election.

Works Cited:

https://blog.oup.com/2016/08/criminal-justice-10-facts/

https://www.naacp.org/criminal-justice-fact-sheet/

https://www.sentencingproject.org/criminal-justice-facts/

https://deathpenaltyinfo.org/policy-issues/innocence/description-of-innocence-cases

https://www.justice.gov/civil/current-and-recent-cases

https://theintercept.com/2019/01/13/misdemeanor-justice-system-alexandra-natapoff/

Inspiration: The Marshall Project https://www.themarshallproject.org/

Recitation 9: Media Controller by Ashley Zhu

In recitation today, we manipulated media and used Arduino as a controller to induce media output through processing. This exercise was simpler, after working with AtoP and PtoA using multiple values from last week’s recitation.

Steps

For my task, I used a potentiometer to control the translation and rotation feature of my sunset image that I took. After putting the image in a new folder in my big folder, I called on the image and then manipulated the pushMatrix and popMatrix functions to allow my image to rotate as I twisted my potentiometer for interactivity. I looked at a few of the example codes given to us in class earlier this week and adjusted the movie rotate code to fit into my image rotating code. I also put the relevant ledPin in the Arduino code for the two programs to connect.

Reading

After reading the article “Computer Visions for Artists and Designers” by Golan Levin, it made me reflect a lot about technology and the course of interaction lab as a whole, as we manipulate technology with media in the class. As computer programming develops, the ways people use it evolves as well. Whereas before, people mostly coded for hardware or software for websites, businesses or other mediums, today, coding can also be used to display art and media. One of the quotes in the article stood out to me, “many more software techniques exist, at every level of sophistication, for detecting, recognizing, and interacting with people and other objects of interest” (Levin). This is very interesting because the interaction between technology and art is possible through these developments in specific levels of detection and interaction that allows the audience to communicate with the subject. I was inspired by how this article displays many different art projects to present art in a new fashion, through technology. In my project, I was able to combine media with interaction using technology, which is both innovative and interesting not only to look at but also to create. I was also inspired by how I can use technology as a medium to communicate and interact with the audience in an amusing and modern way.

Video

Final Code: Arduino

void setup() {
Serial.begin(9600);
}

void loop() {
int sensor1 = analogRead(A0);
int sensorValue = map(sensor1, 0, 1023, 0, 255);
Serial.write(sensorValue);

delay(10);
}

Final Code: Processing

// IMA NYU Shanghai
// Interaction Lab
// This code receives one value from Arduino to Processing 

import processing.serial.*;


Serial myPort;
int valueFromArduino;
PImage img1;
color mouseColor;
float mouseR, mouseG, mouseB;

void setup() {
  size(1086, 724);
  img1 = loadImage("SUNSET.jpeg");
  background(0);

  printArray(Serial.list());
  // this prints out the list of all available serial ports on your computer.

  myPort = new Serial(this, Serial.list()[13], 9600);
}


void draw() {
  // to read the value from the Arduino
  while ( myPort.available() > 0) {
    valueFromArduino = myPort.read();
  }
  println(valueFromArduino);//This prints out the values from Arduino
  
  pushMatrix();
  translate(100, 100);  
  rotate(radians(map(valueFromArduino, 0, height, 0, 500)));
  
  image(img1,100,100,width/(valueFromArduino+1),height/(valueFromArduino+1));
  
  
  popMatrix();
  
  mouseColor = img1.get(mouseX, mouseY);
  mouseR = red(mouseColor);
  mouseG = green(mouseColor);
  mouseB = blue(mouseColor);
  println(mouseR+" "+mouseG+" "+mouseB);
  set(width/2,height/2,mouseColor);
}

Final Project Essay by Ashley Zhu

For our final project, my partner Megan and I decided to create an interactive video game project called “Are You Going to be a Criminal?/Check your Assumptions” to highlight the importance of not to judge a book by its cover and educating the masses about justice system statistics.

Project Statement of Purpose

In this project, we strive to educate our audience about common perceptions and judgment towards justice issues like who will most likely become a criminal. We want to create this game to allow people to grasp more knowledge about common perceptions toward criminals and incarcerated people and to hopefully alleviate some of those preconceived notions by creating a game that has quizzes about what is a paradigm of a criminal or about to commit a crime based on family history, personalities and physical attributes. Then, commenting on how people should not judge a book by its cover, and to hopefully diminish some of those negative attitudes towards people of certain communities.

Project Plan

We plan on using Arduino and Processing to create an interactive game that allows user input through Arduino’s sensors and buttons and then displaying output on the computer using processing animations and graphics. We want to combine physical input from users to connect it with a processing game to make the project more interactive. Also, users can also use the keyboard and mouse functions to play with functions on the screen through processing and code. We will also use laser cutting as our digital fabrication method to decorate our Arduino and add it to the interactive project. The colors in this project will be simple, as we will use mostly black and white colors to create a sleek style. 

Project Context & Significance 

We were inspired by The Marshall Project‘s online journalisms about criminal justice, as the website creates stories about incarcerated people and tries to educate people about the on-going issues in hopes of changing the system and inspiring people to go out and vote, to change public policies. We were inspired by the efforts made by this non-profit online journalism company and wanted to create a project that will be A. educational and spark interest for people to learn more about the U.S criminal justice system; and B, be a fun and interactive way for people to know about social issues that need to be discussed. At the end of our project, we will also attach links to websites and news sources for people to read more about these social issues if they wish to learn more about it. This way, we hope to educate our audience (NYU Shanghai students and faculty) to learn more about how our perceptions and biases could influence our judgment. This could be especially critical in the case of the futures of the younger generation exercising misdemeanors and how assumptions could critically and negatively affect their hearings and cases, in times of trial. Because no matter how hard we try, sometimes our biases get in the way of understanding each other.

One of our readings from Tom Igoe’s article “Making Interactive Art: Set the Stage, Then Shut Up and Listen” is especially inspiration. In particular, the author states, “Think of it [interactive artwork] more as a performance…Figure out how to suggest to them what their course of action could be, and how they might uncover their story, and their own emotional interpretation of the work.” This quote was inspirational in framing how we should set the stage for this interactive project. We want this performance to work and allow our audiences to include their honest and raw input, whether it be a biased assumption or not. We want to make the project simple, intuitive and entertaining, so the audience finds joy in it and hopefully wants to learn more about it in the future, in our case, criminal justice issues and how our psychological biases influence our judgment in the case of criminology. We also want this to influence our audiences, to inspire them and hear their story as well.

Additional Info: one article that raises awareness about perceptions can turn innocent people into criminals. https://theintercept.com/2019/01/13/misdemeanor-justice-system-alexandra-natapoff/

The Marshall Project: https://www.themarshallproject.org/