Week 3 : Video Classifier with TTS – Andrew

For this week’s assignment, I tried to get something more ambitious to work  with javascript, but certain roadblocks prevented me from continuing, (namely website OAuth Api Keys). I first implemented the Video classifier from the example code, and then I added Text to speech from the examples in the github documentation. After seeing how sometimes, the predictions from the model were not optimal, this got me thinking, what if I could play a game of telephone with the model, where given some random image A, it would classify A, I would pick the second largest probability classification, I would then search for images of that class online, and repeat this process. I want to see how far I would deviate from the original image. It would be very interesting to see how far I get, but I shouldn’t get anything outside of the 1000 classes of Image-net. However, I couldn’t get Imgur’s API key’s to play nice, so then I just decided to stick with what I have for time’s sake. Creativity wise I’d say I didn’t get very far, but I think the real-time video classifier is still a pretty useful tool to have.

MobileNet classification of my phone

Code: https://drive.google.com/open?id=1UMI0viojNqtMdsvSC0coh5Zez88s1GmK

Leave a Reply