ObjectCapture and ARObjectAnchor

Question

Created Jul ’24

Replies 2

Boosts 0

Participants 2

Is it possible to both capture the images required for ObjectCapture and the scan data required to create an ARObjectAnchor (and be able to align the two to each other)?

Perhaps an extension of this WWDC 2020 example that also integrates usdz object capture (instead of just import external one)?

https://developer.apple.com/documentation/arkit/arkit_in_ios/content_anchors/scanning_and_detecting_3d_objects?changes=_2

Answered by DTS Engineer in 795483022

You can access the RoomCaptureSession's ARKit session or provide your own using APIs discussed here:

RoomCaptureSession https://developer.apple.com/documentation/roomplan/roomcapturesession

when doing so you can then acquire RGB framews during scanning using the following ARKit delegate callback:

session(_:didUpdate:) https://developer.apple.com/documentation/arkit/arsessiondelegate/2865611-session

Also note that the camera transforms from ARKit delegates are compatible with RoomPlan, meaning the pose given by ARCamera.transform is the pose of the camera in the scanned room.

Boost

Answer 1

DTS Engineer OP

Apple

Jul ’24

Recommended

You can access the RoomCaptureSession's ARKit session or provide your own using APIs discussed here:

RoomCaptureSession https://developer.apple.com/documentation/roomplan/roomcapturesession

when doing so you can then acquire RGB framews during scanning using the following ARKit delegate callback:

session(_:didUpdate:) https://developer.apple.com/documentation/arkit/arsessiondelegate/2865611-session

Also note that the camera transforms from ARKit delegates are compatible with RoomPlan, meaning the pose given by ARCamera.transform is the pose of the camera in the scanned room.

0

Answer 2

ina OP

Jul ’24

Thanks - this is helpful for capturing the environment, but for the ARObjectAnchor use case, I believe it was designed to track an object... such as a furniture item or a toy, and similarly, it seems Object Capture (Photogrammetry, stitching images into a 3d mesh) is optimized for 3d scanning an object in the scene rather than the environment?

https://developer.apple.com/augmented-reality/object-capture/

0