Yandex: Masterpiece (neural network)

Main article: Neural networks (neural networks)

2023

Creating a video using a neural network

Yandex was the first in Russia to launch video creation using a neural network. The corresponding function appeared in the "Masterpiece," the press service of the company reported on August 28, 2023.

The neural network generates video four seconds long at 24 frames per second. After publishing, you can share them with friends or save them in MP4 format. In order to generate a video in "Masterpiece," you need to describe with text what you want to see. In response, the application will offer four options for the first frame and a set of animated effects for creating motion. The neural network takes as a basis the image chosen by the user, generates a set of its changed versions and combines everything with the selected effect. By the end of August 2023, there are seven of them: zoom (approach), timelapse (accelerated rewind), flight, panorama, rotation, rise and morphing (gradual change).

Yandex launched video creation using a neural network

Cascade diffusion is used to create personnel of future video. With this technology, Masterpiece generates individual images. First, the neural network creates pictures in accordance with the request, and then gradually increases their resolution, saturating with details.

As noted in Yandex, video generation complements other capabilities of Masterpiece - creating images and text posts with a title and illustration. You can send a request for commercial use of content from the Masterpiece through the feedback form - the answer will come within 5 working days.

By August 28, 2023, the video creation function using Masterpiece works in test mode. Video generation is available to active users of the service, but everyone can watch the results in the application feed, Yandex specified.

According to the company, the Masterpiece neural network by the end of August 2023 contains 5 billion parameters and studied for 330 million examples of pairs of pictures with a text description.^[1]

Adding YandexGPT

On June 15, 2023, Yandex announced the addition of a large language model of the latest generation YandexGPT (YaLM 2.0) to the Masterpiece. Thanks to this, users can receive in response to a text request not only pictures, but also meaningful posts with a title and a suitable illustration. This opens up even more opportunities for creativity, fun and the preparation of useful content.

With YandexGPT in the Masterpiece, you can write a short story, compose a slogan, an announcement, an invitation to a party and just come up with a funny joke. Neural networks will formulate a title and offer cover options - images previously generated by users of the Masterpiece. Ready-made posts are published in a common feed, where users can like them, watch popular works and subscribe to each other.

Use in Yandex.Business

Yandex on June 6, 2023 announced that it had begun to use illustrations in Yandex.Business created by the same neural network that works in the Masterpiece application. Read more here.

Product Announcement

Yandex has released a generative neural network Masterpiece, which can create images according to the description. The company announced this on April 5, 2023.

The neural network works in applications for iOS and Android in Russian and English. It is able to work in different artistic styles, take into account the wishes of users, as well as imitate famous artists.

The system generates a picture using the cascade diffusion method: first creates an image according to the request, then increases its resolution and adds details, Yandex said in a statement. You can like the images you like in the shared feed. The most popular of them fall into the top best on a separate tab. To generate pictures according to your own requests, you need to leave a request and wait for its confirmation. In the future, all registered users will receive this opportunity.

The developers explained that the neural network loves specifics very much. The more detailed the description, the more accurate the result. Artistic AI from Yandex takes into account special wishes, for example, "photorealism" or "high detail," and is also able to imitate famous painters and work in given artistic styles.

The first version of the application was trained for 240 million pictures with text descriptions, by April 6, 2023, training continues on a set of 500 million examples, the company added.

The Masterpiece is based on a prototype neural network that has a lot to learn. By the time of the final release, it will be able to generate banners, illustrations, create images for Internet storefronts and more. The beta test of the application for users is a new experience and a little good mood, for us it is an opportunity to understand a little better in which direction to develop the neural network further, - said Alexei Gusakov, head of the Yandex machine intelligence and research department.[2][3][4][5]

Notes