TrueConf AI Server

The main articles are:

• Speech Recognition (Technology, Market)
• Speech technology: On the path from recognition to understanding

2024: Release of AI-based Offline Secretary for Video Conferencing

On October 8, 2024, Trukonf introduced TrueConf AI Server, a secure AI-based corporate tool for conducting video conferencing protocols . The virtual assistant also analyzes speakers' speech and writes a brief or extended summary, highlighting key topics, tasks, upcoming meetings and important talking points. At the same time, AI works locally and does not send data to third-party servers - the entire process takes place in the customer's corporate network.

𝓲

TrueConf

According to analysts at MarketsandMarketsworld, the artificial intelligence market will grow to $1.339 billion by 2030, with an average annual growth of 35.7%. At the same time, AI is one of the main trends in the video conferencing market: developers are introducing smart modules into their products in order to solve user problems with sound and video, as well as reduce the burden on IT specialists.

Analysts from Video + Conference interviewed more than 500 IT specialists in Russia and found that according to data for 2024, only about 1% of domestic companies use AI to create protocols based on online meetings.

Customers of VKS systems among medium and large businesses, telecom operators, federal and regional services, industry and medicine in 33% of cases appoint responsible employees to maintain the protocol. In 28% of cases, users save audio or video, in 38% - each participant independently records the results of meetings.

As reported, in "Trukonf" the weak interest in decryption services is associated primarily with issues of confidentiality and the transfer of meeting records to other people's "clouds," where they are decrypted by AI. The second reason is the complexity of integrating VKS solutions and existing systems for decrypting speech, which complicates the process of creating, storing and distributing meeting protocols between employees.

Taking into account demand for autonomous Aerospace Forces systems which grew to 58% among representatives of the private and state companies, Trukonf let out the safe AI secretary who creates transcripts of meetings without connection to the Internet and sending data for external servers.

To create a protocol using AI, it is enough for the user to invite a special bot to the conference in two clicks, which, after the meeting, will prepare a transcript and send the corresponding link in a personal message in the built-in corporate messenger "Trukonf."

Users authorized in the system can choose which of their colleagues to share access to the received protocols and resumes, as well as upload them as a document or table if necessary.

AI training took more than a year and made it possible to achieve optimal accuracy in recognizing Russian speech. The Trukonf solution takes into account punctuation, non-standard terminology and creates a detailed scenario taking into account the names of participants and timecodes, as well as the ability to quickly reproduce any fragment of the dialogue in audio format.

By automating shorthand, AI will reduce the time spent on processing and reporting without risks to data security and privacy.

AI from Trukonf is also able to analyze the created protocol and extract important information from it to create a brief summary and convenient reports.

Three options are available to users: short - with the most important information, standard - with extracting information from the protocol about meetings, tasks and responsible employees, and detailed - with a detailed description of the main topics and issues discussed.

Previously free user applications "Trukonf" for, and OS Windows macOS Linux received a built-in "smart" noise cancellation module, which in real time removes any extraneous sounds, music and other noise from speech, including construction production.

Another built-in AI serves to use virtual backgrounds without chromakei, and also allows you to display a speaker's image on top of a presentation, video and other content. Another built-in module centers the image on the speaker's face so that the participant can remain in the frame even if moved in the frame.

Also built into the applications is a "smart assistant," which prompts users about the quality of the connection and the need to turn on the microphone, and eliminates the need for moderation of online meetings. Thanks to the special VKS mode "Auto Selector," the images of speaking participants automatically become visible on the screens of other users.