Qualcomm Robotics a Platform RB series for development of robots

2020: Robotics RB5

On June 18, 2020 it became known that the Qualcomm Technologies company submitted the Qualcomm Robotics RB5 platform — the integrated complete solution developed especially for robotics. The Qualcomm Robotics RB5 platform includes hardware and program components and also development tools. The platform supports a 5G and the artificial intelligence (AI), providing to producers and developers an opportunity to create robots and drones of the next generation with a big computing power for consumers and the enterprises, defense and manufacturing industry, for providing professional services. The full-function set of development of Qualcomm Robotics RB5 Development Kit provides to developers flexible means for transformation of concepts into commercial reality. For June, 2020 Qualcomm Technologies attracted many companies which approved the Qualcomm Robotics RB5 platform which are engaged in assessment of opportunities of the platform. Besides, more than 30 players of an ecosystem develop hardware and the software necessary for implementation of different robotic projects.

According to the developer, the Qualcomm QRB5165 processor used in the platform is adapted for robotic applications. The heterogeneous architecture in combination with the AI system of the 5th generation Qualcomm AI Engine provides performance of AI calculations of 15 TOPS (Tera Operations Per Second) that gives the chance to carry out difficult tasks of AI and deep learning. Using the Qualcomm Hexagon Tensor Accelerator (HTA) accelerator, the signal processor of image processing (image signal processor, ISP) with simultaneous support of seven cameras and the specialized block of computer vision for video analytics (enhanced video analytics, EVA), the processor shows good opportunities for request processing of machine learning on network edge in the conditions of the limited budget of power. Supporting technologies 4G and 5G using the accompanying module, the Qualcomm Robotics RB5 platform opens a way to distribution of a 5G in robotic and intelligent systems. The combination of the Qualcomm Robotics RB5 platform and the Qualcomm QRB5165 processor allows to implement different constructive options, including the commercial "systems on the module" (system-on-module) and the flexible constructions executed on "crystal on a payment" technology (chip-on-board). As of June, 2020 the solution is available in different options, including to commercial and industrial temperature ranges, the option with expanded life till 2029 is also provided.

"The Qualcomm Robotics RB5 platform will help to accelerate progress in the most different sectors of robotics, including independent mobile robots (autonomous mobile robots, AMR), the robots performing delivery, control and inventory, industrial and collaborative robots and also unmanned aerial vehicles. All this will allow to implement robotic projects of the Fourth industrial revolution (Industry 4.0) and to lay the foundation for management systems for traffic of UAVs (UAV Traffic Management, UTM)", Singh (Dev Singh), the senior director on business development and the head of department of autonomous robotics, unmanned aerial vehicles and intelligent machines of Qualcomm Technologies company marked out Maidens

Still to expand possibilities of the Qualcomm Robotics RB5 platform and to facilitate creation of the next generation of robotic solutions and constructions, Qualcomm Technologies was included into strategic partnership with TDK company. TDK sensors for expanded robotic applications became a part of the Qualcomm Robotics RB5 platform, also TDK played a role in providing the platform with touch solutions and hardware components of traffic control.

According to the statement of the developer, the full-function set of development of Qualcomm Robotics RB5 Development Kit well adapts and is easy in use. Developers are given flexible opportunities programming: the platform supports Linux, Ubuntu and Robot Operating System (ROS) 2.0 and also regular drivers for different cameras, sensors and 5G communication. Support OpenCL, OpenGLES and OpenCV is provided. For determination of depth the set includes support Intel RealSense Panasonic of the cameras Depth Camera D435i and TOF Camera. Cooperation with TDK company helped to equip a set with the 6-axial inertial measuring TDK ICM-42688-P IMU block, the ICP-10111 atmospheric pressure sensor and the T5818 Digital microphone (PDM) with the lower port. One more deposit TDK to a set of development are ultrasonic Time-Of-Flight CH101 and CH201 sensors, the built-in controller of the movement HVC4223F and the inertial measuring block with the built-in reservation of IIM-46220. Other TDK technologies include Hall sensors and temperatures and also validirovanny and verified program algorithms for robotic applications. Qualcomm Robotics RB5 Development Kit uses specification 96Boards Consumer Edition which helps to create prototypes and prototypes quickly.

Features of the Qualcomm Robotics RB5 platform mentioned by the developer:

• possibilities of heterogeneous calculations. High-performance computing on RB5 Qualcomm platform is provided with the Qualcomm QRB5165 processor, the central processor Octa Core Qualcomm Kryo 585 CPU, the graphic processor Qualcomm Adreno 650 GPU, digital signal processors (computing, audio and touch) and image processing processors. Also the platform is equipped with an AI system with the Hexagon Tensor Accelerator accelerator and the hardware block of computer vision (EnhancedVideo Analytics);
• Qualcomm AI Engine AI system of the 5th generation. The specialized Hexagon Tensor Accelerator accelerator based on the AI system of the 5th generation of Qualcomm Artificial Intelligence Engine provides performance of AI transactions 15 TOPS with high rates of processing of MO-requests;
• image processing. The processor of image processing of Qualcomm Spectra 480 Image Signal Processor (ISP) provides quality of photo and video filming with processing speed to 2 gigapixels per second. Such speed allowed to implement characteristics of the camera, including video Dolby Vision, record of video in format 8K (@30 FPS), photographing with the resolution of 200 megapixels, simultaneous video filming in format 4K HDR (@120 FPS) and photographing with the resolution of 64 megapixels with zero delay of operation of a lock. For processing of all problems of computer vision (Computer Vision, CV) the hardware accelerator uses the mechanism of video analytics of EVA. The additional ISP functions include photographing in the HEIF format, the slowed-down video filming and also advanced formats of video filming (including Dolby Vision, HDR10, HDR10+, HEVC and HLG). Seven cameras facilitate simultaneous localization and map development (simultaneous localization and mapping, SLAM), identification and classification of objects, autonomous navigation and planning of a route for accomplishment of tasks in difficult conditions in and out of premises;
• security. The Qualcomm Secure Processing Unit block is designed to ensure safety without deterioration in performance. The block is certified according to the FIPS 140-2 standard and includes function of the protected boot strap loading, enciphering accelerators, the entrusted environment of execution Qualcomm Trusted Execution Environment (TEE) and protection of the camera. Protection of a key (key provisioning security), protection against the malware, technology Qualcomm Content Protection, Qualcomm Mobile Security, Qualcomm Processor Security and also the protected electronic key for remote certification and safe configuring of the device is in addition supported. Security of AI and machine learning is provided with biometric authentication (on a fingerprint, a retina, a voice and the person);
• communication. The Qualcomm Robotics RB5 platform supports distant Wi-Fi and Wi-Fi 6 (802.11ax), Bluetooth 5.1, 4G and 5G.^[1]

2019: Announcement of Robotics RB3

The Qualcomm company used the MWC 2019 exhibition which at the end of February started in Barcelona to announce the platform for creation of robots — Robotics RB3.

It represents a set of software and hardware tools into which are introduced a system - on - the Qualcomm SDA/SDM845 chip, the built-in LTE modem for connection to mobile networks, the Quallcomm AI Engine block  for implementation of algorithms of machine learning and computer vision and module Wi-fi 802.11ac 2×2 with MU-MIMO support. Besides, the special software developed by the company is used.

Qualcomm submitted the platform for development of robots

Robotics RB3 supports connection of different sensors, including gyroscopes, accelerometers and barometric pressure sensors. Support of a 5G networks is in the future planned. The Qualcomm Secure Processing Unit block includes several components of protection, including the mode of safe loading, cryptographic accelerators and technology of protection of the camera.

The producer claims that Robotics RB3 is intended for acceleration of development processes of "useful and smart" robots and drones of new generation and also their output to the commercial market. The platform is compatible to a cloud service of Amazon RoboMaker (helps developers to create, test and unroll applications for robotics) and the Ubuntu operating system.

At the time of the announcement of Robotics RB3 several large companies already expressed to use the platform for the projects. Among the first clients — Amazon, Anki, Misty and JD.com.

Qualcomm hopes that Robotics RB3 will promote increase in number of the new robots intended for agriculture, consumer services, delivery, the industry and other purposes. The output of the first devices constructed on this platform is expected in 2019.^[2]

Notes