MyJournals Home  

RSS FeedsSensors, Vol. 19, Pages 4441: Hands-Free User Interface for AR/VR Devices Exploiting Wearer`s Facial Gestures Using Unsupervised Deep Learning (Sensors)

 
 

14 october 2019 14:03:52

 
Sensors, Vol. 19, Pages 4441: Hands-Free User Interface for AR/VR Devices Exploiting Wearer`s Facial Gestures Using Unsupervised Deep Learning (Sensors)
 


Developing a user interface (UI) suitable for headset environments is one of the challenges in the field of augmented reality (AR) technologies. This study proposes a hands-free UI for an AR headset that exploits facial gestures of the wearer to recognize user intentions. The facial gestures of the headset wearer are detected by a custom-designed sensor that detects skin deformation based on infrared diffusion characteristics of human skin. We designed a deep neural network classifier to determine the user’s intended gestures from skin-deformation data, which are exploited as user input commands for the proposed UI system. The proposed classifier is composed of a spatiotemporal autoencoder and deep embedded clustering algorithm, trained in an unsupervised manner. The UI device was embedded in a commercial AR headset, and several experiments were performed on the online sensor data to verify operation of the device. We achieved implementation of a hands-free UI for an AR headset with average accuracy of 95.4% user-command recognition, as determined through tests by participants.


 
306 viewsCategory: Chemistry, Physics
 
Sensors, Vol. 19, Pages 4442: Novel Enzyme-Free Multifunctional Bentonite/Polypyrrole/Silver Nanocomposite Sensor for Hydrogen Peroxide Detection over a Wide pH Range (Sensors)
Sensors, Vol. 19, Pages 4440: Aerial Cooperative Jamming for Cellular-Enabled UAV Secure Communication Network: Joint Trajectory and Power Control Design (Sensors)
 
 
blog comments powered by Disqus


MyJournals.org
The latest issues of all your favorite science journals on one page

Username:
Password:

Register | Retrieve

Search:

Physics


Copyright © 2008 - 2024 Indigonet Services B.V.. Contact: Tim Hulsen. Read here our privacy notice.
Other websites of Indigonet Services B.V.: Nieuws Vacatures News Tweets Nachrichten