RealityKit

The RealityKit framework was built from the ground up specifically for augmented reality with photo-realistic rendering, camera effects, animations, physics and more. With native ARKit integration, incredibly realistic physics-based rendering, transform and skeletal animations, spatial audio, and rigid body physics, RealityKit makes AR development faster and easier than ever before.

Automatic UpdatesNEW

Because of RealityKit’s native ARKit integration, Location Anchoring, extended support for face tracking, and improved object occlusion rendering are available for apps using RealityKit automatically.

Video TextureNEW

Video textures can now be added to any part of your scene in RealityKit. This brings objects, surfaces, and even characters to life by adding rich video to animate virtual TV screens to play a movie, or make a virtual character smile.

Improved Object Occlusion RenderingNEW

By combining information from the LiDAR Scanner, and the improved edge detection built into RealityKit, virtual objects are able to interact with your physical surroundings just as you’d expect.

Now, virtual objects can be placed under tables, behind walls, or around corners and you’ll see only the parts of the virtual object you’d expect to, with crisp definition of where the physical object hides part of the virtual one. And, all AR experiences powered by RealityKit or AR Quick Look benefit from these improvements automatically, without having to write a single line of code.

World-class Rendering

RealityKit seamlessly blends virtual content with the real world using realistic physically-based materials, environment reflections, grounding shadows, camera noise, motion blur, and more, making virtual content nearly indistinguishable from reality.

Swift API

Easy to use yet incredibly powerful, RealityKit uses Swift’s rich language features to automatically provide the full feature set so you can build AR experiences even more quickly, without the need for boilerplate code.

Scalable Performance

Utilizing the latest Metal features to get the most out of the GPU, RealityKit takes full advantage of CPU caches and multiple cores to deliver incredibly fluid visuals and physics simulations. And because it automatically scales the performance of an AR experience to each iPhone or iPad, you only need to build a single AR experience.

Shared AR Experiences

RealityKit simplifies building shared AR experiences by taking on the hard work of networking, such as maintaining a consistent state, optimizing network traffic, handling packet loss, or performing ownership transfers.