Humans are dexterous at performing many physical tasks, including perceiving precise tactile cues and controlling their motor actions (e.g., using chopsticks). Advanced haptic devices (e.g., those that generate sensations of texture and force) are designed to replicate these interactions, primarily for simulated training and tele-operation; yet they often suffer from bulkiness, which limits their use in labs. In contrast, our everyday computing systems have remained very limited in their output capabilities (e.g., vibrations) and offer little physical assistance. In my research, I envision adding “dexterous interfaces” to everyday computing by engineering devices and systems that deeply integrate sensory experiences and motor capabilities with physical activities. I demonstrate this vision through two directions: (1) increase the availability of haptic experiences by combing energy harvesting for all day use and propose novel mechanisms so users can swiftly switch between virtual and physical sensory experiences; and (2) augment users’ physical skills by leveraging miniature haptic devices that guide the user (e.g., tactile feedback for Blind users) or even move the user’s body to communicate physical movements (e.g., using unfamiliar tools). Finally, I discuss the roadmap of such interfaces to support and enhance users' physical activities in everyday life.

Shan-Yuan Teng is an Assistant Professor and Yushan Young Fellow in the Department of Computer Science & Information Engineering (CSIE) at National Taiwan University (NTU). Shan-Yuan leads Dexterous Interaction Lab, which focuses on advancing a new generation of interactive systems, especially haptic devices (e.g., those that can create a programmable sense of touch, forces, etc.), to augment users’ dexterity in real-world and Mixed Reality environments. Shan-Yuan has published works at top Human-Computer Interaction (HCI) conferences, including ACM CHI & UIST, and also demonstrated at SIGGRAPH and World Haptics. Shan-Yuan graduated from the Department of Electrical Engineering at NTU, holds a Master’s degree from the Graduate Institute of Networking and Multimedia, and received a PhD degree in Computer Science at the University of Chicago. Learn more: 連結點我