MTS AI: Cotype (Large Language Model, LLM)

The main articles are:

• Speech Recognition (Technology, Market)
• Speech technology: On the path from recognition to understanding

2025: Implementation in MTS Live

The service for buying tickets MTS Live and the developer of large language models MTS AI (MTS Artificial Intelligence Center) completed a pilot project in which Large Language Model (LLM) Cotype was tested to prepare SEO-optimized descriptions for performances for the ticket window. This was MTS announced on March 26, 2025. More. here

2024

Cotype Nano Launch

The company MTS AI has released an open large language model (LLM) Cotype Nano to solve business problems related to the creation and analysis of texts on. Russian The company announced this on November 26, 2024. The model can be run locally on personal devices - mobile phones desktop computers laptops and medium performance, which makes it available to a large range of users.

Model weights - the parameters that it uses to make decisions are open to researchers and developers. This allows them to study how the model works, customize it for their own needs and use it in their own projects without the need to build everything from scratch.

The model performed well in its class at the Ru Arena Hard benchmark. Testing assesses the accuracy, quality, and relevance of responses to user questions compared to other models.

Cotype Nano is capable of processing context up to 32,000 tokens (about 45 pages of text) at a time, which allows you to work with large amounts of data. The model is trained to create content, accurate and fast translations between Russian and English, process and analyze text data to improve client service, and can be used to develop chatbots and virtual assistants. In addition, it has advanced data classification capabilities - this is necessary for scenarios such as automatic search and analysis of information in corporate knowledge bases. 

Cotype Nano is optimized to run on CPU and GPU, with additional optimization for, processors Intel which allows you to run it on laptops and even smartphones makes the model available to a wide range of developers and companies that do not have access to powerful computing resources.

MTS AI adheres to the principles of openness and transparency in the development of generative artificial intelligence. We launch an open large language model with a commercial license and develop new services for automatic training of neural networks and code creation that will speed up the development process. The development of open LLM models in Russia will allow companies and novice developers and researchers to create solutions based on neural networks without investing significant resources in development and equipment, "said Sergey Ponomarenko, director of LLM products at MTS AI.

Deployment of MTS AI Cotype Plus in the AFL Process Sandbox

The AFL Technology Sandbox has deployed a GPU-oriented infrastructure for high-performance matrix and vector operations in order to pilot solutions using technologies. artificial intelligence The Association announced this on September 12, 2024. In particular, a large MTS AI Cotype Plus language model has already been deployed on this infrastructure. More. here

Optimization for Tatar language texts

MTS AI developed an updated version of the large Cotype Lite language model for working with texts in Tatar the language. The company announced this on September 10, 2024.

LLM is able to process documents up to 8 thousand tokens (approximately 5 A4 sheets), extract and summarize data in a few seconds.

Cotype Light can be used in archives, libraries, state in and private organizations - wherever there is a need for processing information and analyzing documents in Tatar. For example, with the help of a large language model, it is possible to speed up the processing of applications to government agencies.

The Cotype will extract key information such as the subject matter of the request, the location and the personal data of the applicant, and transfer them to the appropriate database. Like other models of the Cotype family, this version can be installed in the contour of the organization, which allows you to eliminate information leaks.

{{quote 'Creating a large language model in Tatar, the developers of MTS AI pursued several goals. First, we wanted to support the diversity of languages ​ ​ existing in Russia, help them develop and be in demand in the digital era. Secondly, this project has shown that we are able to adapt our models to any scientific and business tasks, including such non-trivial ones as information processing in the languages ​ ​ of the peoples of Russia, "said Dmitry Markov, Executive Director of MTS AI. }}

So that the Cotype Light model can understand an unfamiliar language, the developers collected the datacet and translated it from Russian into Tatar. After that, all the data and answers of the model were checked by Turkologists and native speakers. Cotype Light training takes place at MTS Web Services facilities .

According to the developers, Cotype Light is among the best LLM in its class: it contains 8 billion parameters. If necessary, MTS AI can create LLM in Tatar with a large number of parameters - up to 70 billion parameters, as well as a large context window of up to 32 thousand tokens - so that the model can perform tasks such as translation and generation of long texts. Also, MTS AI is ready to adapt models of the Cotype family for other regional languages ​ ​ of Russia.

Ability to process a long user context

MTS AI has released an updated version of its large Cotype PRO business language model. This model can handle a long user context - up to 20 pages, which allows you to produce personalized and accurate responses when computing power is low. The company announced this on August 28, 2024.

Cotype is a large language model created by MTS AI specifically for working with corporate data. It is trained on a large amount of business correspondence, job descriptions, documentation and other texts, which provides high LLM expertise in this area and allows the use of AI in business processes. Cotype is in the top 3 Russian-language models, according to the MERA benchmark.

An increased amount of context storage without data loss is the Cotype Pro function, which is used in more than 10 pilot projects of the corporate sector and government agencies to create an end-to-end search system for internal documentation and databases, generate technical instructions and corporate letters, SEO-optimization of materials on the site and analyze and summarize the results of meetings - said Sergey Ponomarenko, senior manager of LLM products of MTS AI.

Cotype PRO was created using a unique two-stage method of further training and its own benchmarks developed by MTS AI specialists. This approach has achieved high quality performance for a large language model that runs on just one NVIDIA A100 graphics card, unlike competitive solutions that need 4 graphics cards.

A large context window gives the Cotype PRO language model the ability to process a significant amount of information at a time. That is, the user can download a 20-page contract or other document. Thanks to which, the model has a better understanding of what it is about and gives more accurate answers, which is extremely important when it comes to analyzing corporate documents and regulations.