Inspiration
After going to the museum field trip and experiencing the “fake smart house” piece, I knew I wanted to do something engaging. I met with Aven to discuss a project using a modified “fake” AI Chatbot.
Motivations
There is something to be said about social cues and the intricacies of human conversation. There is a growing gap between individuals who trust and do not trust technology. This was an idea first introduced to me in my Information Technology in Business and Society course last year, most notably with the: Will Robots Take My Job exploration. There was a project by Google, an AI essentially took the job of being an assistant and made appointments on behalf of the boss.
There is a new face scanning system to get into the building, there is a certain level of distrust with that program too, as many outside of IMA and CS don’t understand the safety mechanisms regarding the program. It is very interesting to see that sort of divide.
Modifications
For an actual Turing test, I would need social science experiment approval. We did not have the time to get that paperwork processed, so as I result I modeled the setting as an IMA user-test with questions one would normally ask after a user test.
So a summary is:
- Test of a machine’s ability to exhibit intelligent behaviour equivalent to, or indistinguishable from, that of a human (wikipedia)
- In this case, I will create a Chat-room occupied by myself (masked by the username: AI) and an unsuspecting user tester
- Data not collected for privacy issues.
- My “chat bot” was coded in node.js
There was a five question, paper survey. The questions were as follows:
After Use Survey
(type in a greeting to begin chatting)
Date:
- How human is it? (0 being not remotely human, 5 being very human) Circle one.
0 1 2 3 4 5
- What was most human about it?
- How un-human is it? (0 being it’s not remotely un-human, 5 being very un-human) Circle one.
0 1 2 3 4 5
- What was most unhuman about it?
- Would you feel comfortable using this project again? Why or why not?
Method
I used node to create a very simple interface that was easily local hosted. We learned about node in Moon’s Machine Learning Class, so I took the skills I learned in that class a couple days later to actually build this project. It was my first time using node, so I consulted a number of blogs for a guide. The source I linked just before was my favorite!
Next-Steps
I wanted to run the experiment live at the IMA show, but due to three other projects I couldn’t. As it is, I straight up abandoned my project in Leon’s class and didn’t get to talk about it at all. It’s very sad.
Aven and I talked about showing this in a very different setting. Should the opportunity come to show this, I would be more than happy to.
If I were to do this again, I would start the approval process for a social science experiment so I can conduct more Turning test-y environment tests.
Survey- Comments
Answers to question 2:
This was exciting!
Answers to question 4:
Apparently, I’m not a good listener
Answers to question 5:
“Very comfortable”
“It comforts me! :)”
“Definitely!”
“No”
“Yes”
“Yes!”
“Ok, it’s slow”
“Yes, but later”
Overall, users would like to talk to the bot/me again. That was really exciting. I scored an average score of 3.5625 in terms of my human-ness, and a 1.3125 in terms of my inhuman-ness out of 5.
It was interesting because many of the users, knew me… quite well! So it was shocking that they didn’t pick up on my mannerisms, but of course that being said a couple of them questioned whether or not I was just typing out the answers.
PowerPoint (Final Presentation)
I presented my final project as a powerpoint, where I explained what I had done. My live server wasn’t working, but in theory you can run this project modified with your server information. I have added the code to the end of this.