Skip to content

IDS Guest Seminar - by Dr. Anyi RAO

Title: Bridging the Representation Gap between Humans and Computers for Video Production

Speaker: Anyi Rao, Postdoctoral Scholar, Stanford University 

Date: May 14, 2024
Time: 9:30am – 10:30am
Venue: HKU IDS Seminar Room, P603, Graduate House / Zoom

Mode: Hybrid. Seats for on-site participants are limited. A confirmation email will be sent to participants who have successfully registered. 


Videos are a beautiful way to share our lives, ideas, stories, and emotions. Recent generative models (e.g. SORA) can generate photorealistic short videos. However, they remain far from being able to create complicated artwork (e.g. films) that requires more human creativity due to the huge gap between human mental representations on control signals and computer representations on pixels, timestamps. To address this challenge, I design controllable and reliable tools to bridge this gap such that creators interact with the tool with conceptual-friendly control signals and produce desired content in a more efficient way. Each module in the tool is reliable and explainable, which allows the creators to input their intentions, get their expected outputs, and know what happened within it. This allows creators to make iterative improvements in the video creation process rather than numerous trial-and-errors.


Dr. Anyi Rao
Postdoctoral Scholar @ Stanford University  

Anyi Rao is a Postdoctoral Scholar at Stanford. He studies reliable human-centered AI for creativity and film, focusing on intelligent media editing and creation, semantic and cinematic analysis, aiming to build connections between AI and humans for collaborative intelligence and unleash human creativity and productivity. His works include ControlNet, AnimateDiff, MovieNet, Virtual Studio, Shoot360, and CityNeRF, with a Marr Prize (ICCV best paper award). He leads the organization of the Creative Video Editing and Understanding Workshop at CVPR24, ICCV23, the Generative Models Course at SIGGRAPH24, and the 2023 Paris AI Short Film Festival.

For information, please contact: