LiDAR equipped for 3D modelling?

Hi,

Is the LiDAR scanner on the new iPad pro en iPhone 12 series a good device to make a 3D scan of an object? How high res would this be? And what is de ideal object size?

And also: can the camera system and LiDAR sensor work together to achieve a 3D model with texture?

Any help is much appreciated.

Kind regards, Sybren

Replies

Hi,

thanks for your interest in ARKit.

ARKit in general it is intended for furniture-sized objects like tabletops and chairs, and not intended for narrow objects like table legs, or fine detail on small objects. Also dynamically moving objects are not supported: So it might be a good idea to advise the users of your app to not hold an object in their hands and to move it around. This would conflict with the update rate of our scene geometry.


Multiline
And also: can the camera system and LiDAR sensor work together to achieve a 3D model with texture? BlockQuote

Yes that is (partially) possible. You can project any geometry of an anchor back into the camera image to reason about the texture. However this requires multiple viewpoints and some form of higher-level logic to decide with projection to apply to which part of your geometry.

Hope this help!
Best regards


That's too bad. Was really hoping to be able to make copies of small parts for devices that haven't been sold in many, many years. For example, a particular trackball that was pretty popular among trackball users, but hasn't been made in a very long time just because trackballs themselves weren't that popular. The plastic parts are becoming brittle and breaking just from normal use now, so it would be nice to be able to scan things like that and make new ones with a 3D printer. Obviously could draw them up by hand, but it would be so much nicer to be able to scan them instead.

I have achieved what you’re thinking of, with real-time texturing of 3D objects - scene color reconstruction. It only runs on devices with LiDAR and isn’t exportable, but it could give you some ideas.

Yes that is (partially) possible. You can project any geometry of an anchor back into the camera image to reason about the texture. However this requires multiple viewpoints and some form of higher-level logic to decide with projection to apply to which part of your geometry.

I took care of that problem, although it was extremely difficult to do so.