세미나 : Multimodal Interfaces for Immersive Virtual Reality

  University of Texas at Dallas 의 김진용 교수님와 아래 세미나를 개최할 예정이오니 학우 여러분께서는 참석하여 주시기 바랍니다.

  Title: Multimodal Interfaces for Immersive Virtual Reality
  2024. 8. 12.  11 AM, X-Space, Arena

  Abstract:
Humans perceive the world through multiple modalities, including the basic senses of sight, hearing, smell, taste, and touch. For example, a person in a coffee shop can see nearby people, hear the ambient noise in that setting, smell the coffee in their cup, and feel its warmth while holding it. These modalities work together to give them a rich and reliable sense of their surroundings. A multimodal human-computer interface is a user interface that offers different types of sensory stimuli simultaneously (e.g., visual, auditory, haptic, olfactory, etc.). Multimodal interfaces are necessary to support multi-sensory experiences, which can greatly benefit usability and user experience. They can lead to more “natural” interaction with digital environments, providing multiple types of sensory information similar to what we perceive when interacting with physical environments. However, it is challenging to create high-quality multimodal interfaces: This requires an in-depth understanding of human perception and device output capabilities and how these can be combined to make interactions with a convincing multi-sensory experience. In this talk, I will discuss how I have designed and engineered interactive multimodal and haptic interfaces and how they could impact the user experience by delivering multi-sensory experiences in an immersive virtual reality.

Bio:
Jin Ryong Kim is an Assistant Professor of Computer Science at the University of Texas at Dallas. Before joining UT Dallas, he was a Staff Researcher at Alibaba Group in Sunnyvale, California, USA, and a Senior Researcher at ETRI, Korea. He is a researcher in the fields of haptics, VR, and HCI, with a focus on advancing interactive technologies with multimodal interaction. Central to his research is the exploration of haptics and multimodal interaction to create user interfaces and interaction techniques that leverage human’s full sensory capabilities. Currently, Dr. Kim serves as an associate editor for Frontiers in VR and a committee member for the IEEE Haptics Symposium 2024 and ACM UIST 2024. He’s been an associate editor of IEEE Robotics and Automation Letters, guest editor of the IEEE Transactions on Haptics, and guest editor of Frontiers in VR. His awards include the IEEE RA-L Outstanding Associate Editor Award, ACM SIGGRAPH Asia Emerging Technologies Best Demo Award, IEEE Haptics Symposium 2024 Best Demo Honorable Mention Award, ACM VRST Best Poster Award, and Young Researcher Award from the Korea Haptics Community. Dr. Kim obtained his Ph.D. in Electrical and Computer Engineering (advisor: Dr. Hong Tan) and M. S. in Computer Science, both from Purdue University.