Deliver video content for spatial experiences

RSS for tag

Discuss the WWDC23 Session Deliver video content for spatial experiences

Posts under wwdc2023-10071 tag

7 Posts

Post

Replies

Boosts

Views

Activity

How to display stereo images in Apple Vision Pro?
Hi community, I have a pair of stereo images, one for each eye. How should I render it on visionOS? I know that for 3D videos, the AVPlayerViewController could display them in fullscreen mode. But I couldn't find any docs relating to 3D stereo images. I guess my question can be brought up in a more general way: Is there any method that we can render different content for each eye? This could also be helpful to someone who only has sight on one eye.
9
0
5.1k
Mar ’25
Suggested guidance for creating MV-HEVC video files?
After taking a look at the Deliver Video Content for Spatial Experiences session, alongside the Destination Video sample code, I'm a bit unclear on how one might go about creating stereoscopic content that can be bundled up as a MV-HEVC file and played on Vision Pro. I see the ISO Base Media File Format and Apple HEVC Stereo Video format specifications, alongside new mvhevc1440x1440 output presets in AVFoundation, but I'm unclear what sort of camera equipment could be used to create stereoscopic content and how one might be able to create a MV-HEVC using a command-line tool that leverages AVFoundation/VideoToolbox, or something like Final Cut Pro. Is such guidance available on how to film and create this type of file? Thanks!
6
8
5.2k
Oct ’23
Play spatial video shot on iPhone 15 Pro in visionOS simulator
I heard that iPhone 15 Pro or iPhone 15 Pro Max can shoot spatial video. However, I also know that the iPhone 15 Pro does not support spatial video shooting at first. When the iPhone 15 Pro becomes able to shoot spatial video, can the shot spatial video be played back on the visionOS simulator? When played back, is the video playback represented in three dimensions as a spatial video also performed in visionOS simulator? I would like to play back the spatial video shot with the iPhone 15 Pro using the VideoPlayerComponent of RealityKit. I am concerned that if the visionOS simulator does not support the operation verification of the shot spatial video, it will take a long time to verify it because I do not have an Apple Vision Pro device.
0
1
2.1k
Sep ’23
Using MV-HEVC Format for Stereoscopic Playback on 3D Objects in visionOS
I just watched the videos "Create a great spatial playback experience" and "Deliver video content for spatial experiences," and I have the following question: I have an idea to create a video player not on a flat surface but on a 3D object. In the video "Deliver video content for spatial experiences," it was mentioned about the MV-HEVC format capable of storing separate images for the left and right eyes. My question is: if I use such a video file as material on my geometry, will it be displayed in stereoscopic mode (where each eye sees a separate image projected onto the geometry) or will it be displayed only in 2D mode (where both eyes see the same image)?
1
3
1.8k
Jun ’23
How to display stereo images in Apple Vision Pro?
Hi community, I have a pair of stereo images, one for each eye. How should I render it on visionOS? I know that for 3D videos, the AVPlayerViewController could display them in fullscreen mode. But I couldn't find any docs relating to 3D stereo images. I guess my question can be brought up in a more general way: Is there any method that we can render different content for each eye? This could also be helpful to someone who only has sight on one eye.
Replies
9
Boosts
0
Views
5.1k
Activity
Mar ’25
How/where to encode MV-HEVC stereo video?
Where can I find sample video, sample encoding apps, viewing apps, etc? I see specs, high level explanations, etc. but not finding any samples or command lines or app documentation to explain how to make and view these files. Thank you, looking forward to promoting a spatial video rich future.
Replies
8
Boosts
2
Views
5.6k
Activity
Jul ’24
Suggested guidance for creating MV-HEVC video files?
After taking a look at the Deliver Video Content for Spatial Experiences session, alongside the Destination Video sample code, I'm a bit unclear on how one might go about creating stereoscopic content that can be bundled up as a MV-HEVC file and played on Vision Pro. I see the ISO Base Media File Format and Apple HEVC Stereo Video format specifications, alongside new mvhevc1440x1440 output presets in AVFoundation, but I'm unclear what sort of camera equipment could be used to create stereoscopic content and how one might be able to create a MV-HEVC using a command-line tool that leverages AVFoundation/VideoToolbox, or something like Final Cut Pro. Is such guidance available on how to film and create this type of file? Thanks!
Replies
6
Boosts
8
Views
5.2k
Activity
Oct ’23
Play spatial video shot on iPhone 15 Pro in visionOS simulator
I heard that iPhone 15 Pro or iPhone 15 Pro Max can shoot spatial video. However, I also know that the iPhone 15 Pro does not support spatial video shooting at first. When the iPhone 15 Pro becomes able to shoot spatial video, can the shot spatial video be played back on the visionOS simulator? When played back, is the video playback represented in three dimensions as a spatial video also performed in visionOS simulator? I would like to play back the spatial video shot with the iPhone 15 Pro using the VideoPlayerComponent of RealityKit. I am concerned that if the visionOS simulator does not support the operation verification of the shot spatial video, it will take a long time to verify it because I do not have an Apple Vision Pro device.
Replies
0
Boosts
1
Views
2.1k
Activity
Sep ’23
Is there 3D stereo video sample file?
I wanted to play 3D stereo video in visionOS. but, I can't find the 3D stereo videos samples. Where is it?
Replies
1
Boosts
2
Views
1k
Activity
Sep ’23
Shooting for Immersive Video
Does anyone have any top-level recommendations for the best cameras to be using to shoot in 3D Immersive Video Format?
Replies
2
Boosts
0
Views
5.4k
Activity
Jul ’23
Using MV-HEVC Format for Stereoscopic Playback on 3D Objects in visionOS
I just watched the videos "Create a great spatial playback experience" and "Deliver video content for spatial experiences," and I have the following question: I have an idea to create a video player not on a flat surface but on a 3D object. In the video "Deliver video content for spatial experiences," it was mentioned about the MV-HEVC format capable of storing separate images for the left and right eyes. My question is: if I use such a video file as material on my geometry, will it be displayed in stereoscopic mode (where each eye sees a separate image projected onto the geometry) or will it be displayed only in 2D mode (where both eyes see the same image)?
Replies
1
Boosts
3
Views
1.8k
Activity
Jun ’23