Category: Machine Learning for New Interfaces

Posted on

Week 1 MLNI: Reading Response and Presentation(Ronan)

Click here to get my presentation slides.

What I think of Zero UI:

The best interface is no interface.  – Golden Krishna

After reading the articles and watching the lectures, I think that zero UI really means “screenless user interface”. Just as Golden Krishna says, “the best interface is no interface”. I really like the idea that designers need to think “non-linearly” as John Brownlee indicated in his article, which requires the designers to think beyond a 2D screen and work in a 3D environment to cohere different senses such as sound, vision, etc. This has led me to wonder: How does zero UI influence our life now? Through what means can zero UI change our life experience?

How zero UI change our life:

Although zero UI is a fairly new phrase, it actually has been used in several different areas in our life.

1.Zero UI and Game:

八分音符酱(Ba Fen Yin Fu Jiang) is a Japanese platforming game where the player controls the main character using their voice. The higher the pitch is, the higher the character can jump. Although it is just a simple game, it really changes our traditional way of playing platform games which involves the keyboard. Click here to see the video

2.Zero UI and Business

Amazon Alexa is a virtual assistant embedded in the smart speaker called Echo. Now it is in collaboration with both Uber and Starbucks. When installed at one’s home, Alexa will record the geographical information automatically and connects itself to Uber and Starbuck’s service. The user simply needs to say “Book a ride to ..” or “I’d like to order ..” to Alexa, it will complete the order for you.

3. Screenless interface: wearable technology

Huawei has collaborated with Gentle Monster, a Korean sunglass brand, and developed smart sunglasses. The user just needs to tap on the glasses to answer phone calls or play music. Click here to learn more.

Posted on

MLNI – Presentation Homework (Jessica)

Artechouse & Machine Hallucination by Refik Anadol

Summary

            Machine Hallucination is a new installation in the newly opened Artechouse in Chelsea Market, NYC. The artist wants to “reveal the hidden connections between these [architectural styles and movements] moments in architectural history” (artechouse). The installation produces images of NYC architecture that move and morph into different buildings to help show the “future” of architecture. There are also sounds such as radio transmissions and city sounds that are played along with the visuals (Saraniero). Artechouse itself is a place to host installations, such as this project, and supports such emerging tech. For example, its balcony bar has drinks and coasters that can “come to life” through augmented reality which you activate through a smartphone app.

My Thoughts

            Regarding Artechouse, I think it’s really great that more people are recognizing the growth of machine learning and the potential it has, as shown by the project mentioned above. It makes me wonder if there are going to be more places opening in cities that integrate technology such as AR and ML, which is exciting. As for the Machine Hallucination, I was really interested in how immersive it seems, since it’s an entire room that’s covered in the visuals and the sounds. I think it’s a good example of zero UI in that there’s no screen. People are just completely surrounded by the experience.

Technology that went into making it:

            I would assume there would be machine learning algorithms, speakers, projectors, Manhattan architecture and image databases (3 million images), and lots of coding. One of the articles mentioned that Artechouse has “L-ISA Immersive Hyperreal Sound technology with 32 separate channels for an entirely multidimensional audio experience” (Waddoups)

Sources

https://www.artechouse.com/nyc

Saraniero, Nicole, “Photos Inside Chelsea Market’s New Hidden Underground Art Space”, https://untappedcities.com/2019/09/05/photos-inside-chelsea-markets-new-hidden-underground-art-space/

Waddoups, Ryan, “Enter Manhattan’s Sprawling New Digital Art Mecca”, https://www.surfacemag.com/articles/artechouse-nyc-opening/

Zandl, Irma, “Machine Hallucination at ARTECHOUSE NYC”, https://www.youtube.com/watch?v=BLjSNqzWOMk

Posted on

Week 1: Introduction to Machine Learning for New Interfaces (Homework) Eszter Vigh

My Presentation

The guiding question of this work on the “painting robots” is “Can robots be creative?”. Now the creator, Pindar Van Arman would argue yes, mainly because at times robots have to make the decisions in terms of where a stroke goes and have the ability to view their own work via camera. 

Summary of Hardware

  • Robot arm
  • The robot “watched” what they make using a camera.
  • Art Supplies

Summary of Method

  • A target image and a style image… the target image is stylized based on the characteristics and images presented in the style inspiration work.
  • This combination comes through a complex algorithm. 
  • The robot has memory of the previous works it has created
  • Over time the works develop a unique style based on the training

Why is it interesting?

  • I never thought about robots as creative.
  • The robots aren’t simply combining the images, there is actual painting happening. 
  • Will robots at one point have the power to be creative?
  • For now all the inputs come from the data scientist, but how long before robots can “think” of their own combination ideas? 
  • Not even “painting the next person you see” is really the idea of the robot, it’s just part of the coding. 

Sources

“An Artificially Intelligent Painting Robot.” Cloudpainter, http://www.cloudpainter.com/.

Arman, Pindar Van. “Creativity Is Probably Just a Complex Mix of Generative Art Algorithms.” Medium, Data Driven Investor, 29 Dec. 2018, https://medium.com/datadriveninvestor/creativity-is-probably-just-a-complex-mix-of-generative-art-algorithms-6d37a0087e86.

Arman, Pindar Van. “From Printing to Painting: Computationally Creative Robots.” Medium, Medium, 16 May 2018, https://medium.com/@pindar.vanarman/from-printing-to-painting-the-emergence-of-computationally-creative-robots-cb2f41846dd0.

Arman, Pindar Van. “Does AI Art Belong in the Physical, Digital, or Crypto World?” Medium, Medium, 8 Apr. 2019, https://medium.com/@pindar.vanarman/does-ai-art-belong-in-the-physical-digital-or-crypto-world-3cb4fe5e01b0.

Fitzpatrick, Sophie. “Art in a Technological World.” EDGY_ Labs, 4 June 2019, https://edgy.app/art-in-a-technological-world.

Muoio, Danielle. “Watch a Robot Paint Incredible Pieces of Art.” Business Insider, Business Insider, 5 Feb. 2016, https://www.businessinsider.com/pindar-van-armans-robot-can-paint-2016-2.

News, VICE. YouTube, YouTube, 10 Aug. 2017, https://www.youtube.com/watch?time_continue=112&v=dkTjEi7O4Ic.