Using both cameras on iPhone X

Hey,


I don't have the iPhone X yet so I am trying to understand if what I want to do is possible.

In my app, I already use the rear camera to display AR content. Now, I would like to capture data about the face expressions of the user (without showing the output of the front camera). Did I explained myself clear enought? Would that be possible? It sound not trivial to do a session using both cameras.

To sum up:

I need a session for the rear camera, the rear camera is displayed on screen.

I also need a session for the front camera, I will take relevant face expression info from it but I am not displaying the front camera output on screen.


Thanks 🙂

No, apps can not capture from the front and back cameras simultaneously. You can switch from one to the other (with a short delay between) but not both at the same time.

Would not it be nice to be able to utilize both front and back camera at the same time, even if the projected image is only either one of them? Primarily the back camera.


For example, an imaginary app like Nintendo Mii World, but as Augmented Reality 3D projected character. The Front Camera is looking at user face to scan and track user's facial expressions while the back camera is tracking the back of iPhone.


Indeed can be very involved interactive experience for user, but there could be some useful experimental situations.


I guess an ideal situation is to have more than one device:

- iPhone X tracking face

- Another iPhone X to augment and stream the face AR data into first iPhone X, and then publish it


Is this a better or possible scenario?

Thanks for the answer. What about the tracking session? Let's say that I am tracking planes with the rear camera. I have objects placed in the world. Now I switch to using the front camera to capture facial expressions. Can I then come back to the rear camera and see the scanned planes and placed objects? Or will I have to scan again from start?

Thanks for the help, I didnt received my iPhone X yet so I can't check these things by myself.

Accepted Answer

Overall the same answer, sorry. As you switch from (let's say) a world tracking session to a face tracking session, the world tracking session will be interrupted. You would be starting over with a new coordinate system origin, new anchors, etc when you switch back.

I will build my UX accordingly then. Thanks for the answer 🙂

Using both cameras on iPhone X
 
 
Q