Category Archives: class

DM-UY 4913 Live Media Processing for Performance and Installation

This hands-on studio class will introduce students to the fascinating world of real-time video and audio processing. Using a range of tools, students will build playback systems for live performance and multi-channel media installations. The course is based in Isadora, but we will build expandable systems that can incorporate a variety of generative media programs such as Resolume and Modul8, as well as hardware including sensors and controllers (both virtual and physical). Topics will include projection mapping, live mixing, live-feed cameras, serial, OSC and MIDI communication and designing multi-projector, immersive environments. We will also explore how to develop a project conceptually as well as production and editing skills to generate your own dynamic video images.

Instructor: Lauren Petty (website)

Sample syllabus

DM-UY 4913 Motion Capture

This course provides an introduction to motion capture and the virtual production pipelines used to record 3D animation for film, video games and live performance. While using the motion capture studio, students will learn the tools for tracking performers, cameras, and props. Students develop concepts around the technology and integrate their motion capture data and video along with 3D models into a virtual world they construct using the Unreal gaming engine.

Instructor : Matthew Rader (website)

Sample Syllabus

DM-UY 4193 Designing the Post Natural

This design studio explores the post natural environments we now inhabit and asks how we might design ways of paying better attention to their shifting dynamics. Through a series of projects that engage with digital technologies, we will probe opportunities to amplify our daily environmental encounters and ecological entanglements. Course readings will introduce different theoretical concepts of the environment and probe our relationship to it, as well as offer a range of perspectives on what it means to live in an era shaped by human disturbance. We will work with environmental data, explore collections and develop experimental interfaces.

Instructor : Tega Brain

Sample Syllabus

DM-UY 4193 3D FOR AR

In this course, students will learn how to create original content for Augmented Reality (AR) experiences. Far too often, found and premade assets are used in AR experiences. Having to rely on other people’s creations waters down a creators vision and may completely break a user’s experience. AR has the potential to engage an individual’s senses in a unique and deeply engaging way, different than other extended reality technologies like VR. Students will learn a professional pipeline for AR content creation including proper modeling techniques, automated content creation, file optimization, animations + keyframes, and exporting.

Instructors : Mark Skwarek

Sample Syllabus

DM-UY 4193 PROBLEM SOLVING THROUGH XR

Together, we will unpack the definition of XR and speculate what future applications of extended reality could look like. We will learn to pitch ideas for both creative and professional applications of XR and prototype these ideas using low tech web based methods. The first half of the class will focus on 3D asset creation and environment world building using web based platforms. In the latter half of the class, we will discuss XR in the context of physical installation and learn the basics of creating and deploying scenes in Unreal to headsets. This class is meant to introduce students to a sampling of tools within the XR toolkit and will focus on incorporating XR into students’ creative design practice.

instructor : Tee Topor

Sample syllabus

DM-UY 4913 DATA VISCERALIZATION

This is a hands-on, project based studio course that pushes beyond typical notions of data visualization, examining ways that data can be transformed into embodied experiences. Students will engage with techniques in physical computing, haptic technologies and VR towards the creation of a series of unconventional data visualizations. Each project will interpret dynamic data sets, conveying complex phenomena such as climate change through tactile and embodied forms of representation.

Instructor : Craig Fahner

Sample Syllabus

DM-UY 4153 Experimental Game Narratives

How do games tell stories? How can we move beyond the traditional narrative in games? Is there a more holistic approach that embeds the story deeply into the interaction? In this class, students will begin to answer these questions by analyzing games and developing their own experimental narrative games.

Prerequisite: DM-UY 2153

instructor : Toni Pizza

Sample syllabus

DM-UY 3183 Photography and Words

This course explores various image editing techniques and outputs, utilizing various styles of text, including fiction and non-fiction. The assignments foreground how text influences viewers’ perception of images, and how images can enrich a body of writing. Students will use a range of production skills to create work — using After Effects for animation, HTML/CSS for website creation, book and print design, and archival printing methods. All projects are accompanied by readings that provide historical and theoretical grounding to support the concepts explored through practice. An emphasis on refining technical and aesthetic photography skills are central throughout the semester.

Instructor: Jack Toolin

Prerequisites: DM-UY 2183 or DM-UY 2263

Sample syllabus

DM-UY 2123 Narrative Cinema

In this course, students complete a coordinated sequence of short projects that add up to a finished, live-motion video project. The course strongly emphasizes the relevance of particular tools and techniques to the specific project Concepts are introduced through the screening of historical examples, from 1895 to the present. The course format is modeled on professional standards and workflow for preproduction, production and postproduction.

Prerequisites: DM-UY 2263

Sample syllabus

DM-UY 2113 Sound Design for Media

This course explores sound design, primarily within visual contexts. The course will focus on the use of sound within visual and interactive media, including film, video production, interactive user experience, web design, and gaming. Students will create weekly studio assignments in all of these areas, with an emphasis on developing a strong competence in integrating digital audio techniques into other media. Final projects could include novel sound design developed for film, video, web, applications, or games.
 
Prerequisite(s): DM-UY 1113 or MPATE-UE 1001
Instructor: Hideki Kato