Recording video and using RoomPlan at the same time

Hi, from the 2023 WWDC video on RoomPlan, they mention that it should be possible to integrate photo / video with RoomPlan: https://developer.apple.com/videos/play/wwdc2023/10192/ (at ~2:30)

However, when I attempt to use AVFoundation and AVCaptureSession with RoomPlan, I get the simple error of "Cannot Record".

So I'm not sure if there is something wrong with my setup/code, or if these two libraries are actually incompatible. Are there any kinds of guides for doing things like this? Am I going in the right direction or should I try a different approach? Happy to share code if necessary. Thanks

Answered by DTS Engineer in 804692022

Hello @fordatw,

Your app cannot run an AVCaptureSession while an ARSession is running, and RoomPlan uses ARSession.

However, you can access the capturedImage of each frame in the ARSession, by setting the ARSessionDelegate on the RoomCaptureSession's underlying ARSession.

Best regards,

Greg

Accepted Answer

Hello @fordatw,

Your app cannot run an AVCaptureSession while an ARSession is running, and RoomPlan uses ARSession.

However, you can access the capturedImage of each frame in the ARSession, by setting the ARSessionDelegate on the RoomCaptureSession's underlying ARSession.

Best regards,

Greg

For anyone curious about getting this functionality, I had a lot of success just now by using ReplayKit to simply record the screen.

Recording video and using RoomPlan at the same time
 
 
Q