Presentation / Installation
AffectiveWear (2015) Extension - FaceDrive: Using Face Expression to Control Virtual Supernumerary Robotic Arms towards Human Augmentation with Affective Computing
SessionBlasts From the Past
DescriptionAffectiveWear was first shown at SIGGRAPH 2015, and is an eyewear system that uses optical sensors to detect facial expressions anytime, anywhere. FaceDrive is the latest application of AffectiveWear, demonstrating an innovative approach for using facial expressions as commands for supernumerary robotic arms. Supernumerary robotic arms offer human augmentation possibilities beyond inherent human capabilities, but controlling these arms is difficult.
Our concept involves using the AffectiveWear sensors inside a head-mounted display to map facial expressions to the control of supernumerary robotic arms. These sensors collect data which is then classified using a machine learning technique to discern the various facial expressions. By predicting the operator's facial expressions, the supernumerary robotic arms can execute their tasks accordingly.
To explore the optimal correlation between facial expressions and the control of supernumerary robotic arms, we have developed a virtual reality environment. Within this immersive setting, we have integrated the supernumerary robotic arms alongside an avatar synchronized with the body motion of the operator. This framework allows us to investigate and identify the suitable mapping between facial expressions and the operation of these robotic arms. Through these advancements, we aim to enhance the harmony between human intention and the actions of supernumerary robotic arms.
Our concept involves using the AffectiveWear sensors inside a head-mounted display to map facial expressions to the control of supernumerary robotic arms. These sensors collect data which is then classified using a machine learning technique to discern the various facial expressions. By predicting the operator's facial expressions, the supernumerary robotic arms can execute their tasks accordingly.
To explore the optimal correlation between facial expressions and the control of supernumerary robotic arms, we have developed a virtual reality environment. Within this immersive setting, we have integrated the supernumerary robotic arms alongside an avatar synchronized with the body motion of the operator. This framework allows us to investigate and identify the suitable mapping between facial expressions and the operation of these robotic arms. Through these advancements, we aim to enhance the harmony between human intention and the actions of supernumerary robotic arms.
Event Type
History
TimeThursday, 10 August 202310am - 4pm PDT
Session Time & Location
FC
FCS
E
EO
EFC
EE
