In addition to the Oculus Connect 6 event for Oculus QuestAdd functions such as connecting to PCFacebook also plans to enable Oculus Quest to recognize the wearer's operating gestures through the front camera, thereby achieving a more realistic and natural interactive effect.
Compared to operating with the Oculus Touch handheld controller, users are obviously more receptive to the interactive experience of operating directly with their fingers.
This technology was primarily born out of Facebook's internal lab research project, and is planned to undergo further testing in 2020. It is also expected that SDK tool resources will be made available to the public, allowing developers to create more virtual reality application content.
Facebook explained that this technology uses deep learning to allow the front camera of Oculus Quest to determine the actual position of the user's fingers and gestures, thereby mapping them to virtual reality content, allowing users to experience the effect of interacting with objects in virtual reality.
At the same time, during the entire operation process, no additional depth of field sensing components or additional hardware equipment are required, and the user's gesture operation can be quickly determined through image recognition.
