Microsoft is developing a digital sign language interpreter based on Kinect

Despite the fact that even earlier patents related to the functions of the interactive console Kinect for Xbox, clearly testified in favor of the high potential of the device for use as a translator for sign language, Microsoft itself considered that this function would be completely useless. Nevertheless, the Redmond giant, as it turned out, decided not to give up the interesting idea.

The Asian division of Microsoft Research has recently revealed an application that allows you to translate almost any gesture used by the deaf in all of North America for an ordinary person who does not speak such a language.

In addition to the fact that the system converts signs and gestures into human-readable text and speech, the device, thanks to special software, is able to read the text (aloud), using the virtual avatar of the owner of the device.

Work on the project is still far from its completion, but researchers hope that sooner or later they will create a convenient communication system that will allow deaf and healthy people to communicate with each other without the help of people who know sign language.

I am glad that the recent reforms announced by the company did not affect such development departments as Microsoft Research.

The article is based on materials https://hi-news.ru/technology/microsoft-razrabatyvaet-cifrovoj-perevodchik-yazyka-zhestov-na-osnove-kinect.html.