Augmented Reality

Explore new realities in your app with RoomPlan, ARKit, and RealityKit.

Sessions

  • Bring your world into augmented reality

    8:00 a.m.

    Follow along as we demonstrate how you can use Object Capture and RealityKit to bring real-world objects into an augmented reality game. We'll show you how to capture detailed items using the Object Capture framework, add them to a RealityKit project in Xcode, apply stylized shaders and animations, and use them as part of an AR experience. We'll also share best practices when working with ARKit, RealityKit, and Object Capture. To get the most out of this session, we recommend first watching "Dive into RealityKit 2" and "Create 3D models with Object Capture" from WWDC21.

    Watch

  • Create parametric 3D room scans with RoomPlan

    8:00 a.m.

    RoomPlan can help your app quickly create simplified parametric 3D scans of a room. Learn how you can use this API to easily add a room scanning experience. We'll show you how to adopt this API, explore the 3D parametric output, and share best practices to help your app get great results with every scan.

    Watch

  • Qualities of great AR experiences

    8:00 a.m.

    Discover best practices and techniques to help craft magical AR experiences for iPhone and iPad. We’ll provide guidance to help you determine if AR is a good fit for your experience, explore examples of great AR apps, and take you through key considerations when designing for augmented reality.

    Watch

Labs

  • USD and AR Quick Look lab

    Tuesday @ 9:00 - 11:00 a.m.

    USD and USDZ enable the production-grade description of 3D scenes and delivery into AR Quick Look and apps for AR. Request an appointment with an Apple engineer for guidance and conversation around these file formats, best practices for creating AR experiences for AR Quick Look, and more.

  • RealityKit and Reality Composer lab

    Tuesday @ 3:00 - 5:00 p.m.

    RealityKit is Apple’s rendering, animation, physics, and audio engine for augmented reality. Request an appointment with an Apple engineer for guidance and conversation about RealityKit and Reality Composer, best practices, and more.

Digital Lounges

  • Q&A: RealityKit and Reality Composer

    Tuesday @ 9:00 - 11:00 a.m.

    Ask Apple engineers about RealityKit and Reality Composer during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

  • Q&A: Object Capture

    Tuesday @ 3:00 - 5:00 p.m.

    Ask Apple engineers about Object Capture during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

  • Q&A: USD

    Tuesday @ 5:00 - 7:00 p.m.

    Ask Apple engineers about USD during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

Sessions

  • Explore USD tools and rendering

    8:00 a.m.

    Discover the latest advancements in tooling to help you generate, inspect, and convert Universal Scene Description (USD) assets. We'll learn about updates to these tools and help you integrate them into your content creation pipeline. We'll also explore the power of USD Hydra rendering, and show how you can integrate it into your own apps. For an introduction to USD, watch "Understand USD fundamentals" from WWDC22.

    Watch

  • Understand USD fundamentals

    8:00 a.m.

    Discover the fundamentals of Pixar's Universal Scene Description (USD) and learn how it can help you build great 3D assets and workflows. We'll introduce you to the core concepts behind USD and explore how you can integrate the format into your content creation pipeline. We'll also show you how to harness the power of USD by using composition to create flexible and versatile assets.

    Watch

Labs

  • Object Capture lab

    Wednesday @ 9:00 - 11:00 a.m.

    Object Capture is a photogrammetry technology for MacOS that enables the creation of lifelike 3D models with no prior 3D experience. Request an appointment with an Apple engineer for guidance and conversation about the Object Capture API, best practices, and more.

  • USD and AR Quick Look lab

    Wednesday @ 3:00 - 5:00 p.m.

    USD and USDZ enable the production-grade description of 3D scenes and delivery into AR Quick Look and apps for AR. Request an appointment with an Apple engineer for guidance and conversation around these file formats, best practices for creating AR experiences for AR Quick Look, and more.

Digital Lounges

  • Q&A: RoomPlan

    Wednesday @ 9:00 - 11:00 a.m.

    Ask Apple engineers about RoomPlan during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

  • Q&A: RealityKit and Reality Composer

    Wednesday @ 3:00 - 5:00 p.m.

    Ask Apple engineers about RealityKit and Reality Composer during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

  • Q&A: RoomPlan

    Wednesday @ 4:00 - 6:00 p.m.

    Ask Apple engineers about RoomPlan during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

Sessions

  • Discover ARKit 6

    8:00 a.m.

    Discover how you can build more refined and powerful augmented reality apps with ARKit 6. We'll explore how you can create AR experiences rendered in 4K HDR and take you through camera settings customizations for your app. We'll also share how you can export high-resolution still images from an ARKit session, take advantage of Plane Estimation and Motion Capture, and add AR Location Anchors in new regions.

    Watch

Labs

  • RoomPlan lab

    Thursday @ 9:00 - 11:00 a.m.

    RoomPlan can help your app quickly create simplified parametric 3D scans of a room. Request an appointment with an Apple engineer for guidance and conversation about the RoomPlan API, best practices, and more.

  • ARKit lab

    Thursday @ 9:00 - 11:00 a.m.

    Request an appointment with an Apple engineer for guidance and conversation around ARKit, general troubleshooting, or specific features like plane detection, face tracking, Location Anchors, and Scene Geometry.

  • RealityKit and Reality Composer lab

    Thursday @ 9:00 - 11:00 a.m.

    RealityKit is Apple’s rendering, animation, physics, and audio engine for augmented reality. Request an appointment with an Apple engineer for guidance and conversation about RealityKit and Reality Composer, best practices, and more.

  • Core Motion lab

    Thursday @ 10:00 - 12:00 p.m.

    Request an appointment with an Apple engineer for guidance and conversation about your app and the Core Motion APIs, best practices, and more.

  • RoomPlan lab

    Thursday @ 3:00 - 5:00 p.m.

    RoomPlan can help your app quickly create simplified parametric 3D scans of a room. Request an appointment with an Apple engineer for guidance and conversation about the RoomPlan API, best practices, and more.

  • Object Capture lab

    Thursday @ 3:00 - 5:00 p.m.

    Object Capture is a photogrammetry technology for MacOS that enables the creation of lifelike 3D models with no prior 3D experience. Request an appointment with an Apple engineer for guidance and conversation about the Object Capture API, best practices, and more.

Digital Lounges

  • Q&A: ARKit

    Thursday @ 3:00 - 5:00 p.m.

    Ask Apple engineers about ARKit during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

Labs

  • ARKit lab

    Friday @ 3:00 - 5:00 p.m.

    Request an appointment with an Apple engineer for guidance and conversation around ARKit, general troubleshooting, or specific features like plane detection, face tracking, Location Anchors, and Scene Geometry.

Digital Lounges

  • Q&A: ARKit

    Friday @ 9:00 - 11:00 a.m.

    Ask Apple engineers about ARKit during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.

  • Q&A: Object Capture

    Friday @ 10:00 - 12:00 p.m.

    Ask Apple engineers about Object Capture during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.