Tinkoff Oleg Golosovoy assistant

Main articles:

• Smart columns Voice assistants (world market)
• Smart columns Voice assistants (market of Russia)

2020

Start of the voice assistant 2.0 who can be configured under himself

On December 24, 2020 Tinkoff of Mobile announced start of version 2.0 of the voice assistant Oleg in which subscribers can create own telephone secretary with individual skills and parameters.

The voice assistant to Tinkoff Mobayla allows to set an individual name, to select a voice and a floor, to configure communication of the assistant under different contacts from the telephone directory and unfamiliar numbers, to register own phrases of greetings, etc.

Each user can create the Oleg, and not only Oleg: it is possible to select a voice and a name for the telephone secretary from functionality. The usual name "Oleg" can be changed on Olya or any other name or a nickname, and the voice can be set men's or women's.

The subscriber of Tinkoff Mobayla can select as Oleg will represent it on calls. It is possible to set a name, characteristic, a nickname, a position, etc. Under different contacts it is possible to set and as the secretary will represent the user: for example, not from the telephone directory Oleg will tell contacts that he will transfer information to "subscriber", and the acquaintance — Kostya, Crutch or Super Boss (depending on what representation for himself will be registered by the subscriber).

For the telephone secretary of Tinkoff Mobayl it is possible to configure greetings and phrases which Oleg will communicate with interlocutors (to 400 characters). The subscriber can leave or standard greetings, or set own turnovers and phrases which will be sounded by the voice assistant.

Different greetings can be installed separately for numbers from the telephone directory, and separately for unfamiliar contacts.

Oleg will be able to welcome contacts from the telephone directory by the subscriber by name - and the assistant is able to define a contact name even if it is written not in a standard form.

For example, Sveta of eyebrow Oleg will tell contact: "Hi, Sveta! Sasha cannot answer. I am an assistant Oleg what to transfer to me?".

The contact written in the telephone directory without specific name — for example, Flowers delivery — Oleg will meet by a standard greeting without the personal address.

For Oleg 2.0 it is also possible to configure when to answer calls:

• to answer automatically all incoming calls instead of the subscriber;
• phone is not in network;
• the person resets a call;
• the subscriber does not answer 10 and more seconds.

Interpretation and audio recording of each call will remain in the Mobayla Tinkoff application.

In the nearest future the private secretary will learn to block spam calls or to automatically accept them instead of the subscriber. Also Oleg is integrated into Mobailie's Tinkoff with service of determination of numbers Tinkoff "Ktozvonit": the secretary will send in the SMS message information on calls from unknown numbers and will warn if the subscriber was called by spammers or swindlers.

To the voice assistant Oleg in Mobailie's Tinkoff was one year. During this time it to much learned and fallen in love to our many subscribers. The next version of the private secretary was created on the basis of their wishes, we implemented many of which in the next version of the assistant. Now Oleg will be able to begin alter ego of the subscriber — to say it phrases, to learn familiar contacts. And at the same time with it remained his ability to simplify any communication, reliability and sense of humour. Are sure that the updated voice assistant will be able to please and save time to a bigger number of subscribers, - Georgy Chesakov, the CEO of Tinkoff Mobayla speaks

Upgraded version of the voice assistant Oleg is already available to subscribers of Tinkoff of Mobayl in the next versions of mobile application on iOS and Android. Within 7 days it is possible to test Oleg's possibilities free of charge, then — at cost from 59 rubles a month.

Additional skills of Oleg: help in economy and reminder on payments

On July 21, 2020 it became known that Oleg purchased at once several skills which will help clients of Tinkoff to make the expenses and expenditure is more effective. So, now Oleg will help clients with the Tinkoff application to put restrictions for the expenses, in time to make regular payments and to register payments on the credit card.

The voice assistant Oleg will help users to limit unplanned expenditure. On command in a chat of mobile application of Tinkoff "Oleg, let's save" he will set the restrictions of expenses selected by the client per day, week or month, and will monitor their observance. If expenses of the client approach a limit, Oleg will warn about it and will remind that this week or this month the user decided to spend less. At any time at the voice assistant it is possible to specify what budget remained before exceeding of a limit. On a result of day, week or month Oleg will report whether it was succeeded to meet the budget.

Also Oleg will remind clients of regular payments which need to be made in time. A part of payments in an ecosystem of Tinkoff is automated (for example, payment of taxes, housing and communal services, penalties of traffic police), and clients make a part manually. For example, monthly pay lease of the apartment or service of tutors. If transactions such are made regularly (for example - once a month), Oleg will notice it and next time in advance will remind of them in the push-notification. And not only will remind, but also will help to make payment at once.

One more skill of, - fast credit card payments. On command "Oleg, Check the Credit Card" the voice assistant will show the amount of minimum payment according to the card, the amount of payment for the interest-free period and a full amount of a debt. For payment it is not even necessary to leave a chat with — it is possible just to tell it the necessary amount, to select the account for payment and to confirm transaction.

Since launch in June, 2019 the voice assistant Oleg learned to execute the different transactions facilitating everyday life of clients of an ecosystem of Tinkoff. Now Oleg is able:

• make money transfers;
• pay the mobile phone;
• show income and the client's expenses;
• advise on bank questions;
• pay the credit card;
• register statements for an insurance event for owners of policies of the CMTPL and KASKO from Insurance Tinkoff;
• order and send to mail electronic documents — for example, the reference for the visa to foreign embassies;
• change personal data in the Tinkoff ecosystem;
• it is simple to communicate on free subjects and to give not banal financial advice.

For subscribers of Tinkoff of Mobile Oleg acts as the personal voice concierge at all — receives for them incoming calls, can talk and joke with interlocutors, write and decrypt messages using speech technologies.

In the future Oleg will become even more capable: he will tell about the latest financial news, to prompt the cost of securities, will remind of all important payments, to help to keep the budget — will prompt how many spare cash and that can be planned on the next large purchases. Also Oleg will be able to organize a travel, to pick up and pay hotels, railway and air tickets, will be able to manage armorings, to purchase theater tickets, on concerts and sporting events, to write on appointment, to offer leisure options for the evening, will prompt the investment idea in the Tinkoff Investitsii application, etc.

Besides, Oleg will be able to identify the client's voice using own biometric Tinkoff technologies and to execute his voice commands requiring authorization in mobile application — for example, to make money transfer during driving.

2019: The announcement of the voice assistant in the field of finance and layfstayl-services

On June 13, 2019 the Tinkoff company provided Oleg — the voice assistant in the field of finance and layfstayl-services created in Russia. Its mission - to help users with solving of tasks in an ecosystem of Tinkoff.

According to the company, Oleg is a man from 25 to 40 years. He is polite, does not love familiarity, and if it is necessary, can be persistent. The sense of humour is not alien to it, and he does not teach the user of life until that asks. In irrational situations it can express disagreement or even disapproval – but not long, he will not nag. Oleg guesses that he not absolutely the person, but it not too concerns him. Another is more important for it: day which Oleg lived, without helping people, passed in vain.

Oleg speaks by voice of the Russian actor of cinema and dubbing-in Nikita Prozorovsky. Nikita Prozorovsky wrote about 30 hours of remarks for the voice assistant to Tinkoff on the basis of which Oleg's voice began to be synthesized further.

Oleg will "live" in mobile application of Tinkoff. The voice assistant will be able to distinguish and interpret requests of users, to ask the specifying questions, to solve their problems, to talk on different subjects. Oleg will help them to manage voice all key financial and lifestyle services of an ecosystem of Tinkoff.

In the first version Oleg will be able:

• make money transfers into accounts in Tinkoff and Sberbank
• reserve tables at restaurants
• write users in beauty shops
• buy tickets at cinema with a cashback of 15%
• look for discounts for goods and services
• communicate on free subjects
• give useful tips and life hacks from Magazine Tinkoff
• advise on bank questions and actions
• manage financial products (debit and credit cards)
• change personal data in the Tinkoff ecosystem
• order and send to mail electronic documents (for example, the reference for embassy)

In the future Oleg will become even more capable: he will be integrated into all elements of an ecosystem of Tinkoff – Travel, Mobile, Investments, Insurance, Entertainments, Business, Junior, etc. So, Oleg will be able to call the taxi, to organize a travel, to pick up and pay an avia and rail tickets, hotels, to manage armorings, to purchase theater tickets, on concerts and sporting events, to write on appointment, to pay bills, to offer leisure options for the evening, to show statistics of expenses, to prompt the investment idea in the Tinkoff Investitsii application and many other things. The Tinkoff mobile bank can be operated entirely using Oleg.

Also Oleg will be able to identify the client's voice using own biometric Tinkoff technologies and to execute his voice commands requiring authorization in mobile application. For example - to make money transfer during driving.

On start Oleg will appear step by step at users in mobile application of Tinkoff on iOs, a bit later - on Android. The first owners of Oleg will be able to share it with the friends, having transferred money through the voice assistant. It is necessary just to ask Oleg to make transfer to the necessary client of Tinkoff, and – within an hour after receipt of money for the account of the receiver - in his mobile application there will be Oleg (on Android - after updating of the application to version 4.8 which will be published in the nearest future).

To begin communication with the assistant in mobile application of Tinkoff - it is enough to tell: 'Hi, Oleg!' or 'Listen, Oleg!' (the application should have an access to the smartphone microphone). It is possible to find Oleg also in the section Chat or having pressed the Microphone button near search string on any screen.

The assistant can ask a question, for example – "What to do in the evening?" or to appeal to make transfer to the friend and so forth. To learn about the current opportunities of Oleg, it is necessary to ask him: 'What are you able to do?'

Oleg will be able to talk to users on different subjects, including — about himself. For example, he with pleasure will answer such questions: "What is your name?", "How are you doing?", "What are you doing in free time?", "To what music you listen?", "That new in bank?", "Oleg is a handsome man?", 'What dollar exchange rate?', etc.

It is possible to ask council for Oleg, and he will make the recommendation from Tinkoff-Zhurnala about money and life. Or to tell: "Show discounts for sneakers" on what Oleg will show all suitable special offers from Tinkoff (discounts can be looked for on categories or by names of favourite firms). It can also play with the user a quiz if to tell it "Oleg, ask a question". He will suggest to guess, for example, what products cannot be purchased in Australia that Leo Tolstoy could purchase on the fee for Anna Karenina or how many a cashback you received for last year.

The voice assistant will also consult on financial and bank questions - he can be asked: 'What is the interest-free period', 'What full amount of debt at me', 'How to reissue the card', 'What minimum payment at me', 'As is charged a cashback', 'How to pay utility payments', etc. He will tell about the commissions, limits, the loyalty program how to use the current banking services in Tinkoff, etc.

Oleg will be able to interpret requests of the user and if necessary to ask the specifying questions. For example, if the client says "I want in restaurant tomorrow", the voice assistant will not ask date, and will specify only missing information (the name of restaurant, the number of guests, time) and will confirm the order. If the client decides to transfer a visit of restaurant, the voice assistant will cancel armoring and will offer other options.

For June, 2019 Oleg is absolutely young voice assistant, and it still should learn much. All is interesting to it new, it daily improves the skills of communication. Oleg can sometimes tell or answer a question, without having thought. He explains it with hot temper, but works on himself and every day it becomes better. Users can help in Oleg's training - to put it to the remarks 'laikas' or 'dislikes' which will be analyzed by the Tinkoff command. If Oleg will have difficulties with the solution of a task of the client, he can tell 'Will be enough' or 'Call the person'.

Oleg will automatically solve the most part of the user problems. The voice assistant will involve operators from call center of Tinkoff to the remained circle of tasks: he will specify necessary information at the user, and then will deliver a task which will be performed by the person. Such solution will allow to automate as much as possible all processes, for example — to write clients in those beauty shops which are still not connected to the general system through partners.

In process of development and communication with users Oleg will study and change the character. For example, will be able to carry out the speech analysis of remarks of the client: study his mood in real time and select style of answers — from friendly to more official.

Oleg the Tinkoff supercomputer (the Cluster Kolmogorov) - for June, 2019 helps to train one of the most powerful in Russia. With its help the Tinkoff command trains neural network models for speech recognition, speech synthesis, natural languag processing, communication for free subjects quicker.

For Oleg's creation deep neural network models and speech technologies with which Tinkoff works since 2014 within the strategy of AI First were used. In 2016 Tinkoff began development of own sensing technology of the speech. She equally well copes with the noisy speech in express speaker circuit, and with the blank speech received from qualitative data sources. For June, 2019 the speech sensing technology correctly defines up to 95% of the pronounced words, uses terabytes of data and tens of thousands of hours of the human speech for training. In 2017 Tinkoff started own biometric system which correctly makes the decision in 99.99% of cases. In 2018 Tinkoff became the first bank vendor of a Single biometric system on voice biometrics. In 2018 Tinkoff began development of own technology of speech synthesis on the basis of such neural network models as WaveNet, Tacotron, Deep Voice. Neural network architecture allows quality of the synthesized voice to come very close to human.

Voice technologies are used not only in the voice assistant: they help the Tinkoff group to automate the processes connected with service. So, through speech recognition daily there pass about one million calls of service, and the biometric system trained at voices of clients successfully helps to eliminate all fraudulent activity in call center.

You look also (voice assistants)

You watch also (messengers)