Vision Pro & Vision SDK

Question

nkarpov OP

Created Feb ’24

Replies 2

Boosts 0

Views 1.3k

Participants 2

I'm exploring my Vision Pro and finding it unclear whether I can even achieve things like body pose detection etc.

https://developer.apple.com/videos/play/wwdc2023/111241/

It's clear that I can apply it to self provided images, but how about to the data coming from visionOS SDKs?

All I can find is this mesh data from ARKit, https://developer.apple.com/documentation/arkit/arkit_in_visionos - am I missing something or do we not yet have good APIs for this?

Appreciate any guidance! Thanks.

Answered by DTS Engineer in 779439022

Hello,

There is no API that gives you access to a visionOS camera stream, and there is no API that detects body poses in the scene for you, so I suggest that you file an enhancement request using Feedback Assistant to request API that would enable the feature you are trying to build in your app!

Boost

Answer 1

DTS Engineer OP

Apple

Feb ’24

Accepted Answer

Hello,

There is no API that gives you access to a visionOS camera stream, and there is no API that detects body poses in the scene for you, so I suggest that you file an enhancement request using Feedback Assistant to request API that would enable the feature you are trying to build in your app!

0

Answer 2

nkarpov OP

Feb ’24

Thank you I'll take a look at that link. In general a suite of APIs similar to https://developer.apple.com/documentation/vision/identifying_3d_human_body_poses_in_images but in real time from visionOS data

1