利用 visionOS 27 打造新一代体验

Overview of what's new in visionOS 27, including platform momentum across consumer, enterprise, and creative use cases, and a tour of what the session covers.

A recap of the visionOS scene model — Shared Space, Volumes, Windows, and Immersive Spaces — and the three paths to build a visionOS experience: existing iOS/iPadOS apps, apps designed for spatial computing, and existing macOS/PC experiences via Spatial Preview and Foveated Streaming.

An overview of the three paths to building a visionOS experience: bringing existing iOS or iPadOS apps via compatibility or recompilation; building apps designed from the ground up for spatial computing using native frameworks, third-party game engines, or custom renderers; and a new third path for bringing existing macOS or PC experiences to visionOS using Spatial Preview or Foveated Streaming.

Highlights of new RealityKit capabilities in visionOS 27, including physical space lighting, cloth simulation, acoustic ray tracing, and Gaussian Splatting, followed by an overview of Reality Composer Pro 3's new AI-assisted, collaborative tools — Animation Graph, Script Graph, and enhanced shader materials.

Updates to Unity PolySpatial, Unreal Engine, and Godot on visionOS 27, including new spatial controller, ARKit, and PHASE audio plug-ins available on GitHub, plus support for custom rendering engines via CompositorServices.

Introduction to the new Spatial Preview framework on macOS, which lets developers preview spatial content — including 3D assets, spatial photos, and Apple Immersive Video — directly on Apple Vision Pro from a Mac, with SharePlay support.

How the Foveated Streaming framework enables existing macOS and PC experiences to stream to Apple Vision Pro with native spatial rendering, using eye-tracked, foveated video compression to deliver high-quality visuals at practical bandwidths.

Enhancements to visionOS object tracking including high-frame-rate support and a new ARKit API that brings object tracking to iOS. Also covers spatial accessories — custom tracked hardware that extends the Apple Vision Pro input model with plug-and-play physical controllers.

An overview of the visionOS immersive media pipeline: Apple Immersive Video formats, the Immersive Media Support framework for reading and writing rich AIV metadata, live production tools via SMTPE 2110, wide-aspect-ratio portal support, and static foveation for streamable AIV delivery.

A look at additional visionOS 27 platform updates, including wider Safari windows and Web Environments enabled by default, a redesigned Control Center with streamlined notifications and high-quality capture, accessory widget support for glanceable information on Apple Vision Pro, and a preview of further enhancements including Siri improvements, the Iceland environment, Spatial Panoramas, and Personal Environments.

Closing highlights across the visionOS 27 platform — Spatial Web enhancements, wider windows, accessory widget support, and pointers to related sessions for deeper dives into each featured technology.