Mitsubishi Electric SwipeTalk Air

2019: Development of the interface and application

On March 21, 2019 the corporation Mitsubishi Electric announced development of the user interface SwipeTalk Air on the basis of augmented reality technology (DR) for instant display of the delivered speech in the form of the three-dimensional text at record of video in real time. For placement of the text it is enough to run a finger over the screen tablet or smartphone. The technology formed applications SwipeTalk Air basis based on operating system iOS which integrates the user interface, a video, etc. for creation of "live" videos of century social networks.

In Mitsubishi Electric are going to expand in the future abilities to manage and functions of the user interface and the application for use in commercial goods and services.

Key characteristics of the solution mentioned by the developer:

• The user interface instantly displays the pronounced words in the form of 3D - the text on video as soon as the operator runs a finger over the screen of the mobile device. The camera of the device goes to the subject, several words are pronounced, on the screen the finger draws a line then in this area the text immediately appears. Record of video and editing are completely integrated therefore users can conduct shooting and enter the text at the same time.

• The application integrates different functions for creation of expressive videos. Placement of the text in any place of virtual space of the screen allows to add more expressiveness to the created video. As the text remains on the fixed place even at change of a camera angle, creation integrating the text and the image of subjects of video expands sales opportunities of the ideas of users. Thanks to fast placement of the text the user can easily create original videos.

Other characteristics of the application:

• Display of the text using markers of augmented reality (DR-markers)

The text is displayed on the screen on the trajectory set using the DR-marker.

• Drawing using the additional reality (AR)

Use of additional illustrations during a video, for example, the shooter, geometrical figures or animation images gives expressiveness and visualization to the message.

• Multilingual transfer

The placed text can be translated into a foreign language instantly. Support of audio when translating of the displayed text allows to communicate and interact with the people speaking other languages.

You look also Virtual reality