"Sensor-Tech" and "Nanosemantic" within the framework of a technological partnership created a chatbot with a built-in 3D sign language translator

2025: Creating a chatbot with a built-in 3D sign language translator

The non-profit organization and the IT company "Sensor-Tech" created an intelligent chatbot with a built-in virtual sign language translator Dasha for the inclusive center "Warm Contact," the main employees of which are blind specialists. GC "Nanosemantics" acted as a technological partner of the project. This was announced by "Nanosemantics" on March 5, 2025.

The Sensor-Tech laboratory develops software, creates technical devices, and also manually assembles devices that help people with serious sensory impairments navigate space and easily contact in public places.

The chatbot was created on a dialogue platform DialogOS from Nanosemantics, which employs the communicative of AI many leading domestic leading companies in their industries. DialogOS is designed to develop and support AI-based spoken systems, can run in 40 languages, and includes a huge knowledge base that has 3,611 dialog scripts, 5,230 specialized dictionaries, and more than 3 million adaptive questions.

One of the tasks of the chatbot on the Warm Contact website ‒ to questionnaire the user. A deaf person can go into a widget and enter into a dialogue with a chatbot, which asks various questions: for example, about the accessibility of the environment, social life and employment opportunities for people with disabilities. The chatbot automatically duplicates all its text questions and answers in sign language. Also, if a deaf person experiences difficulties in the survey process, he can contact the operator: he can help him through the screen access program and connect him to a live sign language translator.

The virtual sign language translator Dasha generates Russian sign language based on the entered text. Everything works using artificial intelligence, which was trained on the basis of a collected dataset of more than 50 thousand gestures.

More than 500 people took part in testing the chatbot ‒ they were deaf, hard of hearing, sign language interpreters, sign language pedagogues. 87% of the audience reached the end of the questionnaire, and this is a high figure for this audience.

We thank Sensor-Tech for the trust and opportunity to take part in such a necessary social project: this is the case when AI provides real assistance, empowers people with disabilities and allows them to do without assistance. Nanosemantics were to share its many years of expertise on communicative artificial intelligence and building systems on neural networks, ‒ said Ilya Ivanov, commercial director, Nanosemantika Group Nanosemantics.