From my understanding you capture images on an iOS device and send it to macOS which uses photogrammetry with Object Capture API to process it to a 3D model… Is it possible to exclude macOS and pull the API within the app itself so it does the processing all within the app? From scanning to processing? I see on the AppStore, there’s Scanner apps already, so I know it is possible to create 3D models on the iPhone within an app— but can this API do that? If not, any resources to point me in the right direction? (I’m working on creating a 3D food app, that scans food items and turns them into 3D models for restaurant owners… I’d like the restaurant owner to be able to scan their food item all within the app itself)

When and where can I get the Object Capture App? thanks Ralf

I donnot know how to run it

From the keynote #10076 it was mentioned at the 3:00 mark, that USDZ, USDA and OBJ is supported, but I've not been able to find details on how to make the sample command-line app export .obj files. Only .usdz. Anyone have any information on that? Or does anyone have any tips on how to convert a .usdz to .obj? It doesn't seem to be very easy to do.

I have tested Object Capture with the ios app and the command line tool on macos. I'm wondering what is the best Apple device to use to get the best quality (geometry and texture), there are several configurations that may not give the same results. I have installed ios 15 on a 11 pro max. The ios app outputs some depth data. Which cameras are used to compute the depth ? Does it use three cameras or two cameras ? If it uses only two cameras, what pair does it use ? In theory for me, if only two cameras are used, the best configuration is tele and wide. I'm afraid with configuration with only wide and ultra wide, the results will be less accurate. In short, can we get the same accuracy with an iphone 12 and with an ipad pro ? The ipad seems more ergonomic to measure an object instead of iphone. Does the lidar of the iphone 12 pro/ipad pro can also be used to improve results ?

Hi there, when I run the ObjectCapture sample project on my iPad Pro 2020, depth is always disabled. Is there a way to enable it? Thanks in advance

I have just set up the Object Capture API using the CaptureSample app provided by apple. Is there a way to zoom out the camera?

Has anyone run into limitations with an 8gb RAM M1 Mac Mini? I'm expecting there are some compromises with only 8gb, but curious about real-world results. It's impressive to see that the M1 Mac Mini is capable of running PhotogrammetrySession at all, unlike my 2020 Intel MBP. I'm planning to buy one just for this purpose. The requirements in the slide from the presentation says that any M1 will work, whereas Intel chips need 16gb RAM and a 4gb AMD video card. I'm inclined to get a Mac Mini with 16gb, but that config isn't available near me for pickup and delivery is more than a week out. If I knew that 8gb was enough to process 150 or so photos at high quality that's probably all I would need and could save $200 and get it immediately. Side note: I've been doing photogrammetry on PCs for years and would run out of memory occasionally using Agisoft on a 64gb system, which I needed to upgrade to 128gb. Those were large datasets (500+ photos) covering several hundred square meters from a drone at high resolution. My object scanning needs won't be as demanding, however 8gb just doesn't seem like much to work with. But, I suppose that even Nvidia 3070 Ti's only have 8gb of video memory and the M1's unified memory architecture might make that a better comparison than thinking about traditional system memory...

Hello, when I use Photogrammetry, I receive this error: Error creating session: cantCreateSession("Native session create failed: CPGReturn(rawValue: -11)") . My specs are listed below. I think My macBook Pro should be supported. Please let me know if I missed something or if there is a fix for the issue. Model Name: MacBook Pro (2019) Model Identifier: MacBookPro15,2 Processor Name: Quad-Core Intel Core i7 Processor Speed: 2.8 GHz Number of Processors: 1 Total Number of Cores: 4 L2 Cache (per Core): 256 KB L3 Cache: 8 MB Hyper-Threading Technology: Enabled Memory: 16 GB

Hi! In the WWDC keynote for object capture, at 17:38, they drag and edit the bounds of the object. Please can someone guide me how to do this or how to get started? Is there any kind of sample code anywhere for editing bounds? https://developer.apple.com/videos/play/wwdc2021/10076/

I am using the sample code project associated with WWDC21 session 10076: Create 3D Models with Object Capture. Is there a folder of sample photos I can use for testing this Project? Thank you.

Hey, I have run several tests with masks in the given folder upon PhotogrammetrySession init. It seems the masks are taken into account as the results differ from when I don't provide them. Unfortunately, the results aren't as good as we can expect when masks are provided. Has anyone been able to make it work? How? Example of Imagemagik conversion applied and filename: magick mogrify -monitor -format tif -depth 8 *.png: my original masks are in png format. IMG_0001_mask.TIF

The CaptureSample App creates a depth map image (.TIF) and a gravity file (.TXT). Whats the role of those files? Are they used to calculate the scale of the object ONLY? or do they contribute in other areas aswell to the algorithm?

API documentation and Demo show photogrammetrysession has property ouputs https://developer.apple.com/documentation/realitykit/photogrammetrysession But my macOS can't find the ouputs. My mac :MacBook Pro (13-inch, 2020, Four Thunderbolt 3 ports) version: macOS 12.0 Beta (21A5284e) XCode: Version 13.0 beta (13A5154h)