Skip to content

HKU IDS Scholar Seminar Series #25:

3D Indoor Scene Generation for Simulation and Beyond

Speaker

Prof Bo Dai, Assistant Professor, HKU IDS & Department of Computer Science, School of Computing and Data Science, HKU

Date

Apr 30, 2026 (Thu)

Time

05:00pm – 06:00pm

Venue

Tam Wing Fan Innovation Wing Two  |   Zoom 

Mode

Hybrid. Seats for on-site participants are limited. A confirmation email will be sent to participants who have successfully registered.

Abstract

Generating 3D scenes that support rich interactions are of growing interest due to its importance in embodied ai and spatial intelligence. However, it remains difficult due to issues like data scarcity and complex spatial reasoning. In this talk, we present our exploration of this direction, which consists of two novel approaches: DirectLayout, a top-down LLM framework that generates open-vocabulary layouts from text using explicit spatial planning; and Pair2Scene, a bottom-up method that learns local pairwise support and functional relations to assemble scenes hierarchically. We examine how LLM-driven semantic flexibility complements learned local geometric priors. By analyzing these divergent strategies, we explore how integrating global language reasoning with physics-aware local rules can yield 3D scenes that are both instruction-aligned and physically plausible beyond training distributions.

Speaker

Prof Bo Dai

Assistant Professor @ HKU IDS & SCDS

Professor Bo Dai is an Assistant Professor at the School of Computing and Data Science and the Institute of Data Science, The University of Hong Kong. His research interests are centered around Generative AI and its interdisciplinary applications in areas covering Embodied AI, Scientific Discovery, Metaverse and Creativity. He obtained his Ph.D. from MMLab at the Chinese University of Hong Kong. Representative works from him and his team include AnimateDiff, CityNeRF, Scaffold-GS, MaskCLIP, etc. He is listed among the World’s Top 2% Scientists by Stanford University since 2023. He serves as an Area Chair for major conferences including CVPR, NeurIPS, ICLR and AAAI. 

For full biography of Prof. Dai, please refer to: https://datascience.hku.hk/people/bo-dai/

Moderator

Prof Xihui Liu

Assistant Professor @ HKU IDS & EEE

Professor Xihui Liu is an Assistant Professor at the Department of Electrical and Electronic Engineering (EEE) and the Musketeers Foundation Institute of Data Science (IDS), The University of Hong Kong. Before joining HKU, she was a Postdoctoral Researcher at UC Berkeley working with Prof. Trevor Darrell. She received her Ph.D. degree from Multimedia Lab, The Chinese University of Hong Kong in 2021 and her Bachelor’s degree from Tsinghua University in 2017. She has won several awards such as Adobe Research Fellowship 2020, MIT EECS Rising Stars 2021, CVPR 2021 Doctoral Consortium Award, WAIC Rising Star Award 2022, CVPR Outstanding Reviewers Award, and ICLR Outstanding Reviewers Award.

For full biography of Prof. Liu, please refer to: https://datascience.hku.hk/people/xihui-liu/

For information, please contact:
Email: datascience@hku.hk