Introduction
For my final project, I will continue work on my midterm project and further develop the body segmentation function and try to match the segmentation with the clothing image dataset I have.
Implementation
I plan to first develop BodyPix with p5 and get the body part segmentation images I want. Then I would like to training my own Pix2Pix model using the segmentation map I generated from the original database. And then I will try to optimize the output model I could get and try to adjust it into the machine learning model I want to achieve. In the end, I want to build an online interactive page just like the Monet project we go through in class. The user can change different outfit input images and they can see the virtual outfit generated on their body.
Goal
The goal is try to transfer the clothes in the input image into the body part of my real-time video or the picture I captured from my real-time video. In this way, I could synthesize a virtual outfit on top of my body part.
Resources
BodyPix: https://medium.com/tensorflow/introducing-bodypix-real-time-person-segmentation-in-the-browser-with-tensorflow-js-f1948126c2a0
Training Pix2Pix: https://medium.com/@dongphilyoo/how-to-train-pix2pix-model-and-generating-on-the-web-with-ml5-js-87d879fb4224