Researchers at the National Institute of Technology (NIT) Rourkela have created a robotic system aimed at engaging with people in a highly human-like way.

Utilizing Artificial Intelligence (AI) and Large Language Models (LLMs), the social robot is capable of comprehending everyday language, executing spoken commands, answering queries, and participating in real-time discussions that go beyond scripted replies.

Additionally, it can identify users’ emotions by analyzing facial expressions, including happy, neutral, or sad. The robot can welcome users, give instructions, and respond with natural, conversational speech.

This system can be utilized in various settings such as households, schools, workplaces, hospitals, and community areas. It also has the ability to recognize simple gestures like waving and raising a hand, responding accordingly.

Dr. Anup Nandy, Associate Professor in the Department of Computer Science and Engineering at NIT Rourkela, stated, “The indigenously developed robotic system is well-aligned with the Government of India’s Make in India and Atmanirbhar Bharat initiatives. Unlike currently available global systems, NIT Rourkela’s social robot presents a uniquely integrated framework that merges gesture, emotion, speech, and LLM-based conversational capabilities within an economical platform tailored for Indian contexts.”

The Institute has also successfully obtained a patent for the innovative system.

The robot employs a Raspberry Pi system to process user inputs like spoken commands or text queries.

The LLM evaluates the input, identifies the context, and generates a suitable, human-like response. This response is then conveyed through the robot’s speech system utilizing Google Text-to-Speech.

The robot features a wheel-based platform and a navigation system for effortless mobility. Its built-in distance-sensing module aids in avoiding obstacles and ensuring safe navigation within crowded environments.

As detailed in a paper published in the journal Computers and Electrical Engineering, the anticipated cost of the developed robot is between Rs 80,000 and Rs 90,000, depending on production scale and component optimization, according to the researchers.