Generative AI in Virtual Production

Friday, Apr 18, 2025

Student image of a pink fluffy giant in a desert created using AI

Charner Ramsey’s ‘Desert Giant’ was created with Runway AI frames.

Sang-Jin Bae and Ariana Taveras have designed a course called “Generative AI For Virtual Production” as part of NYU’s Masters of Professional Studios program. This 14-week course, which commenced last fall at NYU’s Martin Scorsese Center for Virtual Production, has 22 students from around the world.

Their goal is to give students hands-on experience at building immersive worlds, designing characters and creating a compelling narrative. Their workshop approach includes structured exercises, with the eventual goal of the students’ producing a 10-minute film.

To provide hands-on guidance about integrating Runway’s AI tool into the process, Bae and Taveras brought in an expert, Adjunct Professor Leilani Todd. She’s part of Runway’s Creative Partner program, which is focused on building user relationships with the production community.