New Technology Uses Mouth Gestures to Interact in Virtual Reality

Interpreting mouth gestures as a medium for interaction.

Binghamton scientists have recently cultivated a new technology that allows control virtual reality by using only mouth gestures.

The expansion of moderate virtual reality head-mounted showcases furnishes clients with sensible immersive visual encounters. However, head-mounted displays occlude the upper half of a user’s face and prevent facial action recognition from the entire face. To overcome this issue, scientists created a new framework that read mouth gestures as a medium for interaction within virtual reality in real-time.

When a user put on a head-mounted display, they are represented to a simplistic game. The objective of the game is to guide the player’s avatar around a forest and eat as many cakes as possible. Here, by just rotating the head, players here can select their movement, move using mouth gestures and eat the cake by smiling.

Furthermore, the system could potentially detect user’s mouth movements and thus achieved high correct recognition rates.

computer program can efficiently depict your facial expressions and replicate them so it looks real.”

“The virtual world isn’t only for entertainment. For instance, healthcare uses VR to help disabled patients. Medical professionals or even military personnel can go through training exercises that may not be possible to experience in real life. This technology allows the experience to be more realistic.”

See stories of the future in your inbox every morning.


Astronomers discovered the first exposed core of a planet

Astronomers from the University of Warwick have recently discovered the surviving core of a gas giant named TOI 849 b, orbiting a...

New species of Ichthyosaur discovered

Hauffiopteryx altera (Latin for different from) has been identified as a new species of Ichthyosaurs.

Stunning new image of star cluster G286.21+0.17

Astronomers created a stunning new image showing celestial fireworks in star cluster G286.21+0.17.