T-Lite (neural network)

2024: Product Announcement

In July 2024, T-Bank announced the release of the most powerful Russian language model T-lite. It is designed to create AI solutions in the field of data analysis, search and development of chatbots.

T-lite has 8 billion. Parameters are numerical values that the model adjusts to better understand and generate text. The more parameters, the greater the ability of the model to perform complex tasks, but as the size increases, the cost effectiveness of the model also deteriorates. T-lite, after further training for specific business tasks in the field of natural language processing (NLP), gives a quality comparable to proprietary models with a size of 20 billion parameters, but at the same time several times cheaper to operate, the bank said.

They also noted that on industrial and internal benchmarks the model overtook foreign llama3-8b-instruct and chat-gpt 3.5 in terms of indicators. At the same time, T-lite is created using only 3% of the computing resources that are usually required for this type of model.

T-lite is part of Gen-T - a family of its own specialized language models of T-Bank, which can learn to solve specific highly specialized problems. Unlike universal models such as ChatGPT, Gen-T technology is focused on specific areas and offers solutions with maximum adaptation to the needs of the user, the bank said in a statement.

Our Gen-T models have shown their effectiveness in our services, are optimal in terms of the ratio of used capacities and quality. And we are ready to share this development with other companies, with users, with the professional community. This is our contribution to the development of artificial intelligence in Russia, "said Artem Bondar, head of NLP at the T-Bank Center for Artificial Intelligence.