IISc research team designs eye gaze-controlled robotic arm for speech and motor impaired : The Tribune India

Join Whatsapp Channel

Innovation@campus

IISc research team designs eye gaze-controlled robotic arm for speech and motor impaired

IISc research team designs eye gaze-controlled robotic arm for speech and motor impaired


Bengaluru, July 10

An Indian Institute of Science (IISc) research team has designed a robotic arm that can be manipulated by eye movement using a computer interface, to help people with Severe Speech and Motor Impairment (SSMI).

This interface is non-invasive since it is through a webcam and a computer, unlike other eye gaze-tracking devices that use head-mounted systems, according to Bengaluru-based IISc.

People with SSMI find it difficult to physically operate devices such as a joystick, mouse or trackball, or use speech recognition systems, it was noted. Eye gaze-controlled computer interfaces can help them perform various tasks on par with their non-disabled peers.

To help people with SSMI (a condition caused by disorders like cerebral palsy), a research team at the Centre for Product Design and Manufacturing (CPDM), IISc, worked with young adult students who have SSMI at Vidya Sagar (formerly The Spastics Society of India) in Chennai, an institution for individuals with disabilities.

"Many of these students [with cerebral palsy] are not able to precisely focus at a single point in their visual field, due to uncontrolled gaze movement. They are also not comfortable to look at all portions of the visual field equally," says project lead Pradipta Biswas, Assistant Professor at CPDM.

Biswas and his team used computer vision and machine learning algorithms to analyse live feeds of facial video from the users, and were able to estimate where the user was looking.

They coupled this with an Augmented Reality application to allow the user to use a robotic arm for tasks like picking up and dropping objects, and placing them where they desire, as long as it was within reach of the robotic arm, according to an IISc statement.

One of the main applications of this eye gaze-controlled robotic arm is rehabilitation of young adults with SSMI, through tasks such as fabric printing.

They usually require assistance in doing such tasks, as they can only do a small part of it by themselves.

Using the robotic arm designed by the researchers, people with SSMI can use their eye gaze to perform mechanical tasks that can help them work on handicrafts independently, it said.

This eye gaze-controlled interface has been deployed at Vidya Sagar and is in regular use. "This validation and evaluation (of the interface and robotic arm) with end users is a major contribution of the study," says Biswas.

The students with SSMI are able to use the robotic manipulator almost as well as their non-disabled counterparts, and the results were the same during repeated trials. This technology can also be used by younger individuals with SSMI, to move toys like cars.

"We are using play as a medium to teach new technologies, which they can use for the rest of their lives," adds Biswas.

Further modifications to this tool could also allow young individuals with SSMI to use it for e-learning. The authors believe that this interface is a step towards designing future technologies which ensure that physical impairments do not stand in the way of pedagogical training and professional lives of individuals with SSMI.

Biswas also says that such a system could be useful for automotive and aeronautical applications, as well as for developing collaborative robots used in smart manufacturing. — PTI 


Top News

Global Microsoft outage hits Indigo, Akasa, Spicejet, Air India operations, airport services

Chaos at airports as computer outage hits airline check-in; banks largely unaffected

In one of the biggest-ever IT outages, an update of a produc...

'Anticipate a resolution is forthcoming': Microsoft on massive global outage

CrowdStrike deploys fix for issue causing global tech outage

Microsoft says it has fixed the underlying cause for the out...

Judiciary will take its course, says controversial IAS officer Puja Khedkar as she leaves Washim

Judiciary will take its course, says controversial IAS officer Puja Khedkar as she leaves Washim

The UPSC has initiated a series of actions against Puja Khed...

FIR against trainee IAS Puja Khedkar; UPSE  begins termination process

UPSC files forgery case against probationary IAS officer Puja Khedkar; to debar her from future exams

Official sources say the commission had on Thursday filed a ...

Amritpal Singh moves Punjab and Haryana High Court against detention orders

Amritpal Singh moves Punjab and Haryana High Court against detention orders

Khadoor Sahib MP Amritpal says his detention under the NSA i...


Cities

View All