How do I configure a Unity project for a fully immersive VR app on Apple Vision Pro using Metal Rendering, and add a simple pinch-to-teleport-where-looking feature? I've tried the available samples and docs, but they don't cover this clearly (to me).
So far, I've reviewed Unity XR docs, Apple dev guides, and tutorials, but most emphasize spatial apps. Metal examples exist but don't include teleportation. Specifically:
-
visionOS sample "XRI_SimpleRig" – Deploys to device/simulator, but no full immersion or teleport.
-
XRI Toolkit sample "XR Origin Hands (XR Rig)" – Pinch gestures detect, but not linked to movement.
-
visionOS "XR Plugin" sample "Metal Sample URP" – Metal setup works, but static scene without locomotion.
I'm new in Unity XR development and would appreciate a simple, standalone scene or document focused only on the essentials for "teleport to gaze on pinch" in VR mode—no extra features. I do have some experience in unreal, world toolkit, cosmo, etc from the 90's and I'm ok with code.
Please include steps for:
-
Setting up immersive VR (disabling spatial defaults if needed).
-
Integrating pinch detection with ray-based teleport.
-
Any config changes or basic scripts.
Project Configuration:
- Unity Editor Version: 6000.2.5f1.2588.7373 (Revision: 6000.2/staging 43d04cd1df69)
- Installed Packages:
- Apple visionOS XR Plugin: 2.3.1
- AR Foundation: 6.2.0
- PolySpatial XR: 2.3.1
- XR Core Utilities: 2.5.3
- XR Hands: 1.6.1
- XR Interaction Toolkit: 3.2.1
- XR Legacy Input Helpers: 2.1.12
- XR Plugin Management: 4.5.1
- Imported Samples:
- Apple visionOS XR Plugin 2.3.1: Metal Sample - URP
- XR Hands 1.6.1
- XR Interaction Toolkit 3.2.1: Hands Interaction Demo, Starter Assets, visionOS
- Build Platform Settings:
- Target: Apple visionOS
- App Mode: Metal Rendering with Compositor Services
- Selected Validation Profiles: visionOS Metal
- Documentation: Enabled
- Xcode Version: 26.01
- visionOS SDK: 26
- Mac Hardware: Apple M1 Max
- Target visionOS Version: 20 or 26
- Test Environment: Model: Apple Vision Pro, visionOS 26.0.1 (23M341), Apple M1 Max
- No errors in builds so far; just missing the desired functionality.
Thanks for a complete response with actionable steps.