Now, interact in virtual reality using your smile

NEW YORK: Scientists have developed a new technology that allows users to interact in a virtual reality environment using only mouth gestures such as a smile.

Now, interact in virtual reality using your smile

Photo for representational purpose only. iStock

monicakchauhan@gmail.com

New York

Scientists have developed a new technology that allows users to interact in a virtual reality environment using only mouth gestures such as a smile.

The proliferation of affordable virtual reality head-mounted displays provides users with realistic immersive visual experiences.

However, head-mounted displays occlude the upper half of a user's face and prevent facial action recognition from the entire face.

 

Follow The Tribune on Facebook; and Twitter @thetribunechd)

To combat this issue, researchers from Binghamton University in the US created a new framework that interprets mouth gestures as a medium for interaction within virtual reality in real-time.

The team tested the application on a group of students.

Once a user put on a head-mounted display, they were presented with a simplistic game.

The objective of the game was to guide the player's avatar around a forest and eat as many cakes as possible.

Players had to select their movement direction using head rotation, move using mouth gestures and could only eat the cake by smiling.

The system was able to describe and classify the user's mouth movements, and it achieved high correct recognition rates. The system has also been demonstrated and validated through a real-time virtual reality application.

"We hope to make this applicable to more than one person, maybe two. Think Skype interviews and communication," said Lijun Yin, professor at Binghamton University.

"Imagine if it felt like you were in the same geometric space, face to face, and the computer programme can efficiently depict your facial expressions and replicate them so it looks real," said Yin.

Researchers believe that the technology is applicable to a plethora of fields.

"The virtual world isn't only for entertainment. For instance, health care uses VR to help disabled patients," said Yin.

"Medical professionals or even military personal can go through training exercises that may not be possible to experience in real life. This technology allows the experience to be more realistic," he said. —PTI

Cities

View All

Two Jamaatis test +ve in Mohali, district count 12

Belong to Kumbhra and Mauli Baidwan, admitted to hospital

Grocery stores in Chandigarh run short of branded stock

Companies, distributors yet to streamline delivery system, a...

19-year-old budding golfer converts backyard into range

Aadil, who won his maiden PGTI title last month, tries innov...

Not wearing mask may land you FIR

Police have registered several FIRs under Disaster Managemen...

Shimlapuri patient off ventilator, stable

Health team searches for contacts

Patiala villagers self-isolate

Seal entry and exit points of their area/localities

Fear being created by fake video: Patient

Says person shown in clip not me, urges people to follow hea...