Human pose detection failing on Vision Pro

Question

AMobileDeveloper OP

Created 5d

Replies 3

Boosts 0

Participants 3

Hi!

I attempted to run a sample project for detecting human pose in photos, which can be found here: https://developer.apple.com/documentation/vision/detecting-human-body-poses-in-3d-with-vision

The project works perfectly when run on my Macbook Pro M1, but it fails on Apple Vision Pro. After selecting the photo an endless loading screen is presented and the following output is produced in the console:

Failed to initialize 2D Detection Algorithm.
Failed to initialize 2D Pose Estimation Algorithm.
Failed to initialize algorithm modules
Network path is nil: (null)
Failed to initialize 2D Detection Algorithm.
Failed to initialize 2D Pose Estimation Algorithm.
Failed to initialize algorithm modules
Unable to perform the request: Error Domain=com.apple.Vision Code=9 "Async status object reported as failed but without an error" UserInfo={NSLocalizedDescription=Async status object reported as failed but without an error}.
de-activating session 70138 after timeout

It seems that VNDetectHumanBodyPose3DRequest is failing on Vision Pro for some reason. Are there any additional requirements for running Vision framework on VisionOS, that I might be missing?

Boost

Answer 1

Dude OP

5d

The sample you referenced lists iOS 17.0+, iPadOS 17.0+, and Xcode 15.0+ as the requirements for success. And, while the Mac maybe able to access the API available to iPadOS, it looks like an iPad app in visionOS or even this project with a native visionOS target may not. I’d file a feedback that this is broken.

2

Answer 2

AMobileDeveloper OP

3d

While the sample lists iOS 17.0+ and iPadOS 17.0+, the request that fails lists visionOS 1.0+ as well (https://developer.apple.com/documentation/vision/vndetecthumanbodypose3drequest). I tried using that request in a separate app and it failed on vision pro as well.

0

Answer 3

Vision Pro Engineer OP

Apple

1d

Hello, @AMobileDeveloper, you are correct to assume this should work on visionOS 1.0+ based on the API documentation page. Could you please file a bug report for this issue using Feedback Assistant? Please include as much detail as possible about your use case as possible, and then share your ticket number here. We will take a look on our end, and you'll be able to follow updates to your ticket after you make the request.

Thank you!

0