Colocating iPhone and Vision Pro in one shared scene

Question

Created 8h

Replies 3

Boosts 1

Participants 4

This post is from the WWDC26 ARKit Q&A.

On iOS I colocate multiple iPhones/iPads by sharing ARWorldMap over MultipeerConnectivity. visionOS 26 added the conceptual equivalent (shared coordinate spaces via SharedCoordinateSpaceProvider) but as far as I can tell it's Vision Pro-to-Vision Pro only, and visionOS has no ARWorldMap, so there's no bridge.

Is there any supported way today to put an iPhone and a Vision Pro into one shared coordinate space or should I file feedback for cross-platform colocation?

It would be useful to my users, for example, to have someone controlling an AR scene layout on a Vision Pro while using iOS devices to preview and record the scene from various specific angles.

Answered by Vision Pro Engineer in 891269022

That sounds like an interesting use case. I don't believe we currently have a way for these to interop as you want, so a feature request would be great!

Feedback System

Providing Feedback: How and Why? has tips on creating a successful report.

Answer 1

Vision Pro Engineer OP

Apple

8h

Recommended

That sounds like an interesting use case. I don't believe we currently have a way for these to interop as you want, so a feature request would be great!

Feedback System

Providing Feedback: How and Why? has tips on creating a successful report.

Answer 2

Vision Pro Engineer OP

Apple

8h

Ooh, my colleague suggested using image anchors to help establish a shared coordinate system between devices, as both visionOS & iOS support tracking images.

I think that SharePlayKit would also allow you to have multiple devices in the same virtual space and have a shared coordinate system there. Here's a link to some sample code.

Answer 3

Vision Pro Engineer OP

Apple

8h

Is there any supported way today to put an iPhone and a Vision Pro into one shared coordinate space or should I file feedback for cross-platform colocation?

Since iOS 27 both iOS and visionOS support ML-based object tracking: https://developer.apple.com/documentation/visionos/implementing-object-tracking-in-your-app

So if it is an option for your use case that users need to have a specific real world object in their environment then you could track that via object tracking and thus both the iPhone and Vision Pro could agree on the position of that object as their shared coordinate system.