Home Technology New Technology Uses Mouth Gestures to Interact in Virtual Reality

New Technology Uses Mouth Gestures to Interact in Virtual Reality

Interpreting mouth gestures as a medium for interaction.

Binghamton scientists have recently cultivated a new technology that allows control virtual reality by using only mouth gestures.

The expansion of moderate virtual reality head-mounted showcases furnishes clients with sensible immersive visual encounters. However, head-mounted displays occlude the upper half of a user’s face and prevent facial action recognition from the entire face. To overcome this issue, scientists created a new framework that read mouth gestures as a medium for interaction within virtual reality in real-time.

When a user put on a head-mounted display, they are represented to a simplistic game. The objective of the game is to guide the player’s avatar around a forest and eat as many cakes as possible. Here, by just rotating the head, players here can select their movement, move using mouth gestures and eat the cake by smiling.

Furthermore, the system could potentially detect user’s mouth movements and thus achieved high correct recognition rates.

computer program can efficiently depict your facial expressions and replicate them so it looks real.”

“The virtual world isn’t only for entertainment. For instance, healthcare uses VR to help disabled patients. Medical professionals or even military personnel can go through training exercises that may not be possible to experience in real life. This technology allows the experience to be more realistic.”

See stories of the future in your inbox every morning.

EXPLORE MORE

Must Read

First photo of the moon from Chandrayaan 2 shows the Mare Orientale basin in the top right-of-centre, and the Apollo crater in the centre-right of the image. Image: ISRO

Chandrayaan 2 captures the first image of the Moon from Lunar...

India's second lunar exploration mission, Chandrayaan-2- which launched on 22nd July 2019- has recently sent the first images of Moon taken from the moon's...