Vision Pro & Vision SDK

I'm exploring my Vision Pro and finding it unclear whether I can even achieve things like body pose detection etc.

https://developer.apple.com/videos/play/wwdc2023/111241/

It's clear that I can apply it to self provided images, but how about to the data coming from visionOS SDKs?

All I can find is this mesh data from ARKit, https://developer.apple.com/documentation/arkit/arkit_in_visionos - am I missing something or do we not yet have good APIs for this?

Appreciate any guidance! Thanks.

Accepted Reply

Hello,

There is no API that gives you access to a visionOS camera stream, and there is no API that detects body poses in the scene for you, so I suggest that you file an enhancement request using Feedback Assistant to request API that would enable the feature you are trying to build in your app!

Replies

Hello,

There is no API that gives you access to a visionOS camera stream, and there is no API that detects body poses in the scene for you, so I suggest that you file an enhancement request using Feedback Assistant to request API that would enable the feature you are trying to build in your app!

Thank you I'll take a look at that link. In general a suite of APIs similar to https://developer.apple.com/documentation/vision/identifying_3d_human_body_poses_in_images but in real time from visionOS data