Lack of documentation on RealityKit

SceneKit was perfect to import 3D assets directly into our app scene. Since it's soft deprecation and the coming out of RealityKit, tutorials or documentation on how to bridge old possibilities are missing, everything seems to be about AR.

More specifically, I am not able to find any resources on how to create a scene, load 3D assets, add a light and a camera, and everything within the app itself. No augmented reality.

Is it intended to add some support about this? Any guidance would be appreciated.

Answered by Vision Pro Engineer in 892634022

Hi @_lrmathias

RealityKit supports the "just embed a 3D scene in my app" use case. No ARKit required.

Start here: the SceneKit to RealityKit migration guide

Other on-point WWDC sessions

Authoring scenes with Reality Composer Pro

Reality Composer Pro lets you build scenes (entities, lights, materials, cameras) visually and load them into your app with Entity(named:). The "AR" branding is misleading; the output works in any RealityKit context.

Hosting the scene (the SCNView replacement)

  • RealityView. SwiftUI view for embedding a RealityKit scene.
  • Model3D. Drop a USDZ into a SwiftUI layout like an Image.

Loading 3D assets (the SCNNode replacement)

Cameras and lights

Sample code (non-AR, in-app 3D)

Offscreen / custom Metal rendering (the SCNRenderer replacement)

Two filtering tips

  • Filter the docs: Open the RealityKit landing page and use the sidebar filter at the top. Type a topic ("lights", "camera", "model") and toggle to Sample Code or Articles to view.
  • Filter WWDC sessions: Visit the WWDC videos page, pick a year, and apply the Graphics & Games and Spatial Computing topic filters. Most of the relevant non-AR RealityKit content lives there.

If something is missing

If there's specific documentation or sample code you'd like to see, please file a feature request via Feedback Assistant.

Hi @_lrmathias

RealityKit supports the "just embed a 3D scene in my app" use case. No ARKit required.

Start here: the SceneKit to RealityKit migration guide

Other on-point WWDC sessions

Authoring scenes with Reality Composer Pro

Reality Composer Pro lets you build scenes (entities, lights, materials, cameras) visually and load them into your app with Entity(named:). The "AR" branding is misleading; the output works in any RealityKit context.

Hosting the scene (the SCNView replacement)

  • RealityView. SwiftUI view for embedding a RealityKit scene.
  • Model3D. Drop a USDZ into a SwiftUI layout like an Image.

Loading 3D assets (the SCNNode replacement)

Cameras and lights

Sample code (non-AR, in-app 3D)

Offscreen / custom Metal rendering (the SCNRenderer replacement)

Two filtering tips

  • Filter the docs: Open the RealityKit landing page and use the sidebar filter at the top. Type a topic ("lights", "camera", "model") and toggle to Sample Code or Articles to view.
  • Filter WWDC sessions: Visit the WWDC videos page, pick a year, and apply the Graphics & Games and Spatial Computing topic filters. Most of the relevant non-AR RealityKit content lives there.

If something is missing

If there's specific documentation or sample code you'd like to see, please file a feature request via Feedback Assistant.

Thank you very mushed for your detailed reply, I will be taking a look very soon. Beforehand, I want to ask you if there is any content that you shared that are only available in visionOS? I'm asking this question because I know that Model3D is only available in it.

Thanks a lot

Lack of documentation on RealityKit
 
 
Q