Institute of Electronics, Information and Communication Engineers
Lecture on August 7, 2023 (Mon) at Hokkaido University
August 7, 2023 (Mon), 14:00–15:30
Room A24, Faculty of Information Science and Technology, Hokkaido University, Japan.
Hongbo Fu (Professor at City University of Hong Kong)
Towards More Accessible Tools for Content Creation
Traditional game and filming industries heavily rely on professional artists to make 2D and 3D visual content. In contrast, future industries such as metaverse and 3D printing highly demand digital content from personal users. With modern software, ordinary users can easily produce text documents, create simple drawings, make simple 3D models consisting of primitives, take images/videos, and possibly edit them with pre-defined filters. However, creating photorealistic images from scratch, fine-grained image retouching (e.g., for body reshaping), detailed 3D models, vivid 3D animations, etc., often require extensive training with professional software and is time-consuming, even for skillful artists. Generative AI, e.g., based on ChatGPT and Midjourney, recently has taken a big step and allows the easy generation of unique and high-quality images from text prompts. However, various problems, such as controllability and generation beyond images, still need to be solved. Besides AI, the recent advance in Augmented/Virtual Reality (AR/VR) software and hardware brings unique challenges and opportunities for content creation. In this talk, I will introduce my attempts to lower the barrier of content creation, making such tools more accessible to novice users. I will mainly focus on sketch-based portrait generation and content creation with AR/VR.