Apple RealityKit

2021: Announcing 3D Modeling Tool in AR from iPhone Photos

In early June 2021, Apple announced an update to the platform for modeling and rendering virtual 3D content in augmented reality. RealityKit Developers will have more control over rendering, sound, and animation when working with augmented reality, but the most notable part of the update is supporting the ability to create 3D models in minutes using only iPhone.

According to Apple, RealityKit 2 represents Object Capture, an API on macOS Monterey, which allows you to create photorealistic 3D models of real-world objects in high quality in a matter of minutes, using photos taken using iPhone or iPad. They are converted into 3D models optimized for augmented reality. Users can view them in Quick Look or add them to AR scenes in Reality Composer or Xcode, which greatly simplifies the creation of such content.

Apple introduced a tool for creating 3D models in augmented reality from photos with iPhone

The company also noted that thanks to the new APIs, developers will also be able to create more realistic and complex AR interfaces with more visual, sound and animation control, including complex rendering and dynamic shaders.

This is a huge step forward in the design of 3D content. What used to be the most difficult and expensive part of creating AR experiences and 3D scenes is now available to everyone in the Monterey macOS, "said Susan Prescott, Apple's vice president of developer relations around the world.

Apple said that development teams of companies such as Wayfair, Etsy and others are using the Object Capture solution to create 3D models of real objects. This indicates that online stores will soon receive a large AR update. Maxon and Unity use Object Capture to create 3D content with applications such as Cinema 4D and Unity MARS.^[1]

Notes