RSS
Логотип
Баннер в шапке 1
Баннер в шапке 2

Microsoft и MIT: MosAIc

Product
The name of the base system (platform): Artificial intelligence (AI, Artificial intelligence, AI)
Developers: Microsoft, Massachusetts Institute of Technology (MIT)
Date of the premiere of the system: 2020/08/18

Main articles:

2020: Announcement of the MosAIc system

On August 18, 2020 it became known that researchers from Microsoft and the Massachusetts Institute of Technology (MIT) developed the MosAIc system for search of interrelations between objects of art from different cultures and eras.

MosAIc

As it was explained, MosAIc uses deep learning (deep learning) for the analysis of base of images of the objects of art provided in Metropolitan Museum of Art (New York) and the national museum of Amsterdam Reyksmuzeum. The purpose of scientists was to create an algorithm which will select the objects of art similar not only for color and style, but also for value and a subject.

As a result a system analyzes not only circuits and colors on the image, but also allows to consider culture to which the subject and also material of which it is made belongs by search. Thus with its help it is possible to monitor process of cultural exchange between different eras and territories. For example, on a request "what musical instrument is most of all similar to this image of a white-blue dress?" to a house coat which was worn by rich Dutches in the 17th century a system offered a white-blue porcelain Dutch violin. Both pictures not only are similar on a pattern and a form, they are also evident demonstration of exchange between the Dutch and Chinese cultures – tells use by Dutches of porcelain about it.

In creation of an algorithm the command used the data structure for search of images called "by a conditional tree of KNN (K-nearest neighbors, the k-closest neighbors)" which groups similar images together in a tree structure. By search of coincidence a system begins with "trunk" of a tree and follows the most perspective branch, will not find the closest image yet.

Researchers were inspired by the Rembrandt and Velasquez exhibition in Reyksmyuseum within which the pictures of artists integrated by imperceptible at first sight common features were exposed by pairs. This widespread phenomenon in art when in works from different time frames and parts of the world it is possible to trace the similar lines which became result of cultural exchange. However, the person could not analyze millions of pictures for thousands of years and to find in them parallels in subjects, motives and visual styles. Development is useful not only in art criticism, but also in any sphere where search of similar factors can be useful: humanities, medicine and others.