I decided to dive into the possibilities of poseNet. Through experimenting with different body parts, I decided to build a game using poseNet. Here’s the initial setup that displays scores for different boydparts as well as an added x & y for each bodypart which we can use to make a game.
The initial idea was to use bodyparts to break objects on the screen and score points, similar to something like guitar hero. I started first by using the nose since it’s almost always visible and is easily tracked by poseNet. I then used the X & Y position of the nose combined with a function for collision detection to break squares.
I also added some different colors, locations, sizes for the rectangles, as well as a score counter for QOL.