How to integrate Apple Immersive Video into the app you are developing.

Question

Created Feb ’25

Replies 2

Boosts 1

Participants 3

Hello,

Let me ask you a question about Apple Immersive Video. https://www.apple.com/newsroom/2024/07/new-apple-immersive-video-series-and-films-premiere-on-vision-pro/

I am currently considering implementing a feature to play Apple Immersive Video as a background scene in the app I developed, using 3DCG-created content converted into Apple Immersive Video format.

First, I would like to know if it is possible to integrate Apple Immersive Video into an app. Could you provide information about the required software and the integration process for incorporating Apple Immersive Video into an app? It would be great if you could also share any helpful website resources.

I am considering creating Apple Immersive Video content and would like to know about the necessary equipment and software for producing both live-action footage and 3DCG animation videos.

As I mentioned earlier, I’m planning to play Apple Immersive Video as a background in the app. In doing so, I would also like to place some 3D models as RealityKit entities and spatial audio elements.

I’m also planning to develop the visionOS app as a Full Space Mixed experience. Is it possible to have an immersive viewing experience with Apple Immersive Video in Full Space Mixed mode? Does Apple Immersive Video support Full Space Mixed?

I’ve asked several questions, and that’s all for now. Thank you in advance!

Boost

Answer 1

Versatile OP

1w

Hello Do u already know how to create apple immersive video using cg， unreal engine or anything else

0

Answer 2

Vision Pro Engineer OP

Apple

1w

Hello @sadaotokuyama, thank you for your question! I think there's some confusion over what is required to show immersive video so hopefully I can clarify in this post.

Based on the description of what you want to do, I recommend searching for the term "APMP" or Apple Projected Media Profile. Check out the video Learn about the Apple Projected Media Profile from WWDC25 for more information. Specifically, there is a graphic shown at about 1 minute and 20 seconds that shows all the different formats side by side. For additional resources check out Explore video experiences for visionOS which goes into all the different ways of presenting media on Vision Pro, and also Support immersive video playback in visionOS apps.

Apple Immersive Video is a high-end immersive video format on Vision Pro. To shoot content for this format you'll need a piece of equipment like Blackmagic's URSA Cine Immersive camera.

However, APMP video is much more accessible, and can be shot on a wider variety of cameras, because APMP is really just extra meta data that can exist inside a .MOV or .MP4 file.

To play back APMP content, there's a wide variety of APIs in AVKit, like AVPlayer. Additionally, there are some RealityKit APIs for playing video attached to an Entity with VideoPlayerComponent. The shape of your video is determined by your APMP metadata.

You also have the option of directly controlling the shape of your screen by providing a mesh and applying a VideoMaterial to the mesh. Additionally, VideoMaterial supports transparency.

Let me know if that helps!

0