Skip to content
Dr HUANG Yukun
Post-doctoral Fellow
HKU Musketeers Foundation Institute of Data Science
About me

Dr. Yukun Huang is a Post-doctoral Research Fellow at the HKU Musketeers Foundation Institute of Data Science (HKU IDS), working alongside Dr Xihui Liu and Prof. Yi Ma. Dr. Huang obtained his Ph.D. from the University of Science and Technology of China (USTC) and did his undergraduate studies at the South China University of Technology. His research interests broadly lie in the computer vision, machine learning, and computer graphics. In particular, he is interested in 3D synthesis, virtual human, generative model, and visual recognition.

Current Research Project

Currently, Dr. Huang’s project focuses on high-quality 3D asset synthesis with generative artificial intelligence learned from large amounts of 2D image and video data.

Humans are situated in a 3D world. To simulate this experience for production or entertainment, we require a significant number of 3D assets to populate virtual environments like robotics simulations and games. Generating such 3D assets is both expensive and time-consuming, necessitating skilled artists with extensive aesthetic and 3D modeling knowledge. Recent advances in generative artificial intelligence show promise for automatic 3D content creation, but still suffer from low visual quality, high computational cost, and poor controllability. In general, existing native 3D generative methods are limited by the scarcity of 3D data, while popular 2D lifting methods struggle with the ill-posed problem of inferring 3D entities from inconsistent image observations. This project aims to explore effective generative models and algorithms for 3D asset synthesis, particularly the use of physical and semantic priors.

Selected Publications
  • Yukun Huang, Jianan Wang, Yukai Shi, Boshi Tang, Xianbiao Qi, Lei Zhang. “DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation.” International Conference on Learning Representations (ICLR), 2024.
  • Yukun Huang, Jianan Wang, Ailing Zeng, He Cao, Xianbiao Qi, Yukai Shi, Zheng-Jun Zha, Lei Zhang. “DreamWaltz: Make a Scene with Complex 3D Animatable Avatars.” Conference on Neural Information Processing Systems (NeurIPS), 2023.
  • Yukun Huang, Xueyang Fu, Liang Li, Zheng-Jun Zha. “Learning Degradation-Invariant Representation for Robust Real-World Person Re-Identification.” International Journal of Computer Vision (IJCV), 2022.

Research Interests

Computer Vision; Machine Learning; Computer Graphics.