Implementing Foveated Streaming with Apple Vision Pro

Hello,

Want to understand what's the current state for developing for Apple Vision Pro? I want to stream a video from a remote server in realtime. It is a video stream and can't download it.

I want to stream a low quality stream and high res stream. The server will only send the "box" where user is looking at. Are there any API to track where the user is looking at in the experience?

Thanks,

Hey @John-Doe,

There's no supported way for you to track where the user is looking with the APIs currently available. The system performs foveated rendering in a way to preserve privacy and doesn’t provide direct information about where people are looking.

If you'd like us to consider adding foveated streaming, please file an enhancement request using Feedback Assistant. Once you file the request, please post the FB number here.

If you're not familiar with how to file enhancement requests, take a look at Bug Reporting: How and Why?

Thanks!
Michael

Implementing Foveated Streaming with Apple Vision Pro
 
 
Q