Want to make AR lenses

I want to add AR lenses and filters (like on Snapchat and Instagram) to the camera feature on my app. Is there a way to do this using ARKit? Thanks!

If by "lenses and filters" you are referring to a face-based filter, you can utilize the data provided by an ARFaceTrackingConfiguration as input to your filter. I'd recommend taking a look at the data that is available on ARFaceAnchor to determine if it is sufficient for the sort of filter you are trying to create.

As for actually rendering your filter, it depends somewhat on the exact functionality you are aiming for. If the effect is 3D, then you could use RealityKit, SceneKit, or Metal for rendering. If the effect is 2D, then you could use SpriteKit, CoreImage, or Metal for rendering.

Adding to the response above, you can also look at the face painting sample app we released this year.

Want to make AR lenses
 
 
Q