Demonstration
My project is called Good Omens. Here is a brief demonstration of my project.
Inspiration
After seeing all the examples, I was impressed by the ear one and the nose one. Then I reviewed the basic Posenet example to see what I can create based on it. For the basic Posenet example, I found that this model can position certain parts of the human body and facial parts, such as our left and right eyes. And the feedbacks are the small green ellipses and the name of the part. As for me the feedback is a little bit boring because the aim of it is only to give information. Therefore, my plan is to take advantage of this image recognition and location technology to create an interesting and interactive project, and the initial step is to replace the original feedback with some funny pictures.
The next step is to think about the thesis and the content of my project. I was inspired by a poster of Good Omens, which is a British TV series. The content of this poster is a combination of angle, Aziraphale and devil, Crowley.
I think this poster is very interesting because it embodies the harmonious coexistence of the opposite side. So I want to make a kind of special effect to let the users act as an angel or a devil and they can switch the character only by a hit on the space bar. Also in order to show the harmonious coexistence, I have exchanged some elements of the angel and devil. For example, in my project, the angle has a devil aura while the devil has an angel aura.
Technical issues
In the process of my programming, I met lots of difficulties and problems. At first my code did not work because it could not find the files that were some related pictures. After asking my friends for help, I knew that I should create a new folder in the project folder and put all my files in it. I also needed to mark the file path in the code to let the program know where they are. What’s more, the functions of images and GIFs are totally different. At first I just applied image() and loadImage() on GIFs and the website didn’t run. But now I know that I should use createImg() and [name].position(), [name].size() to display a GIF.
When the images can be shown on the screen, here comes another issue: When the ellipses become images, the position is slightly deviated. I have to test several times to adjust the coordinates of images to guarantee they are in the right position.
And it is difficult for the model to identify the difference between the left and right wrists. My initial idea was to put different images on the left and right wrist but the outcome was not what I expected. Thus I had to make some changes and got my final version of my project.
Reflection & Development
I have become more familiar with the functions of JavaScript and the principle behind the object or image classification through this assignment. It reminds me of some special effects of TikTok, Snapchat and beauty camera. Now I can make a special effect by myself and it is really exciting. However, this model still needs improving to solve the issues that I have mentioned before. My expectation of a mature version is a more interactive special effect with various forms of feedback. The user can change the character by some specific gestures or by saying certain words. Also the background and the lightness can be changed to fit the mood or style of music, and we can use Body pix to achieve this expectation. therefore, users will fully interact with this project by moving their bodies, hearing sound, shouting words and so on.