Semantic ELISE ELVEES Image Semantic Engine processor

The semantic ELISE processor (ELVEES Image Semantic Engine) is the multiplatform system on a crystal (SNK) developed on technology process of 28 nanometers and containing more than 1.6 billion transistors which is focused on the world markets of video analytics: "smart cities", retail, Internet of Things, augmented reality, multimedia and other applications.

Skeleton diagram SNK ELISE

On the basis of the ELISE chip IP cameras with functions of video analytics, multimedia devices and mobile gadgets, communication devices and navigation, robots with computer vision can be created.

SNK ELISE is joint development ElVIS-NeoTech and SPC ELVIS.

Development History

2017: Announcement

ElVIS-NeoTech and SPC ELVIS announced on November 9, 2017 creation of the ELISE processor for the systems of computer vision.

ELISE (ELVEES Image Semantic Engine) represents the multiplatform system on a crystal (SNK) made on technology process of 28 nanometers and containing more than 1.6 billion transistors.

Appointment

Functionality of a chip allows to create based on the ELISE processor of a system and the device for the fast-growing world markets: "smart cities", Internet of Things, retail, business monitoring, augmented reality, multimedia, navigation, security.

According to information ElVIS-NeoTech, on the basis of SNK ELISE IP video camera prototypes with the resolution of 4K and stereocameras are already created. The company is going to release based on the ELISE chip specialized video cameras for the existing and perspective world markets of systems with computer vision.

Technologies

The feature of the ELISE processor consists in total the used specialized hi-tech blocks, including own development, explained in ElVIS-NeoTech.

SNK ELISE integrates standard main cores: a dual core cluster of MIPS P5607 Apache (1.2 GHz), the MIPS InterAptiv audioprocessor (1 GHz), the service processor with the hardware supported virtualization of MIPS Virtuoso M5150 (600 MHz).

In ELISE IP blocks of development of SPC ELVIS are used: the 8-core Velcore2 video processor with API Khronos OpenVX support, the hardware SGBM block, an accelerator of FFT, a navigation core of Navicore4 with support GLONASSGPSGalileo///BeiDou which allow to implement processing of stereoflows and support video analytics algorithms.

Thanks to it on the basis of SNK ELISE video cameras with the built-in difficult algorithms of video analytics, including based on convolution neural networks (CNN) can be created. For example, face recognition, protection of perimeter and detection of ignitions for security systems, management of gestures for devices of virtual reality, recognition of a sex, age and emotions for retail, recognition of the state registration signs of cars and traffic offenses for intelligent transport systems.

The path of video processing includes the processor of preimage processing PowerVR V2500 Felix, the PowerVR E4500 Onyx video encoder and the PowerVR D5500 Coral video decoder allowing to work with 4K UHD video flows in ELISE.

The built-in graphic processor (GPU) with two cores of PowerVR Series6 GX6250 (600 MHz) with support of cross-platform API Vulkan, OpenGL ES 3.x, OpenCL 1.2 EP is responsible for processing of graphics in SNK ELISE.

2016: Transfer to production

ElVIS-NeoTech, the project company RUSNANO entering into ELVIS group, and Imagination Technologies company transferred in the spring of 2016 to production the semantic ELISE processor (ELVEES Image Semantic Engine) – a multiplatform system - on - a crystal (SNK), developed on technology process of 28 nanometers which is intended for creation of the systems of video analytics: smart cities, retail, Internet of Things, augmented reality, multimedia, etc.

On the basis of the ELISE chip IP cameras with functions of video analytics onboard, multimedia devices and mobile gadgets, the systems of the help to the driver (ADAS), the communication device and navigation, robots can be created.

"Emergence of the ELISE chip gives an opportunity to refuse use in the systems of expensive servers and to transfer information analysis directly to devices. It will allow our company to enter the existing and potential world markets of video analytics with the unique offer", – the president of ELVIS group Petrichkovich Yaroslav says.

SNK ELISE integrates a set of multifunction IP blocks, including blocks for preliminary and postprocessing of a stereo of video images with ultrahigh permission, several cores of central processors for accomplishment of problems of different degree of intensity, the high-performance graphic processor and the multistandard navigation processor.

For SNK ELISE the ElVIS-NeoTech company acquired the rights to use a wide line of IP modules and platforms of Imagination:

• The integrated PowerVR Vision IP platform integrating in itself: the graphic processor PowerVR GX6250, the processor of images PowerVR V2500 (ISP), the PowerVR E4500 video encoder and the PowerVR D5500 video decoder allowing to save energy and resources in modern cameras.
• The high-performance MIPS Warrior P5607 dual-core processor and also the MIPS InterAptiv processor allowing to work with several flows and the energy efficient MIPS M5150 processor which provide substantial increase of speed of operation of applications of video analytics and the sound processing requiring big computing power.
• The communication processor Ensigma Explorer C4250 (RPU) providing communication the standard Wi-Fi and Bluetooth on a crystal which in the future can be used for work with multidimensional wireless cameras with video analytics.

IP cores of Imagination company were complemented with IP blocks of own development of ELVIS group:

• Semantic Velcore2 video platform which represents the powerful specialized 8-cluster DSP processor with IP cores of accelerators: SGBM is calculation of the card of depth of the image for a video flow of Full HD, FFT is fast Fourier transform in the background in real time which in total with other platforms of ELISE create a basis for implementation of such opportunities as processing of a stereo of flows for face recognition, creations of augmented reality, etc.
• The built-in navigation core of GNSS with support of four standards of navigation: GPS/GLONASS/BeiDou/Galileo which was also provided ELVIS for Imagination company within licensing of GNSS technology.

Hardware-software resources of 28 nanometers of "a system on a crystal" ELISE provide highly productive and at the same time a flexible energy efficient solution for creation of the whole range of the modern systems of video processing with video analytics, allowing to apply optimization depending on a solvable task, by the performance/energy consumption parameter.

The ELVIS group developed tools among which library for API Khronos OpenVX™ for a 8-core cluster of Velcore2 which are also supported by other SNK ELISE processor platforms: Imagination dual cores CPU P5607 (new version of the MIPS Apache Warrior processor) and Imagination GPU PowerVR GX6250.

The debug module ELISE Board is developed for demonstration of opportunities of SNK ELISE, prototyping of devices on its basis and debuggings of application programs of users by ELVIS-Neotek company.

The ELISE processor and the debug module ELISE Board will be available on sale in the fourth quarter 2016.