Create parametric 3D room scans with RoomPlan

RSS for tag

Discuss the WWDC22 Session Create parametric 3D room scans with RoomPlan

Posts under wwdc2022-10127 tag

33 Posts

Post

Replies

Boosts

Views

Activity

Extra Room tags
Let's say I am able to successfully scan a room and I am returned the dollhouse model. With this model, am I able to add customizable markers to the 3D model to denote key features of the model? Example: I want to mark a chair (for whatever reason). I scan my room, and I zoom in enough to hone in on the chair. I add a marker (colored) with the label "Antique chair", and when I zoom out, I can see the marker still on the (x,y,z) coordinate of the model where the 'chair' is. Thanks!
1
0
935
Jul ’22
RoomCapture Configuration - request for more config options
/// An object to configure the capture process     public struct Configuration {         public var isCoachingEnabled: Bool         public init()     } If I ask nicely would someone please add a few more features to this? Specifically, I would LOVE to be able to just detect a ROOM with no objects. Then I would also like to be able to pass a map of CapturedRoom.Object.Category objects to filter on or use for render. So for example I would pass into Configuration something like RoomCategory collection for the visualizer and USDZ model file. : [Category : SimpleMaterial] .sink: return SimpleMaterial(color: .systemBlue, roughness: roughness, isMetallic: false) .toilet: return SimpleMaterial(color: .systemTeal, roughness: roughness, isMetallic: false) .bathtub: return SimpleMaterial(color: .systemGreen, roughness: roughness, isMetallic: false) So the above would override the default of rending ALL known objects to just render the three above and give them the color I've laid out. While I'm at it, Beta 1 and Beta 2 changed a few things on this list. "screen" is a better name than "television". I also miss the ".unknown" category. Here is what was in Beta 1: .unknown .storage .refrigerator .stove .bed .sink .washer .toilet .bathtub .oven .dishwasher .table .sofa .chair .fireplace .screen .stairs The list above changed with Beta 2 that just shipped. So in Beta 2 .unknown was REMOVED, .washer is now .washerDryer and .screen is now .television. This API is super cool and amazing. I've really enjoyed working with it.
3
0
1.4k
Jul ’22
Initialize RoomCaptureSession with previous session data
I would like to start up a new RoomCaptureSession with data from the previous session, similar to using ARWorldTrackingConfiguration.initialWorldMap with ARSession. Is it possible to use RoomBuilder.capturedRoom(from:) to initialize RoomCaptureSession with a CapturedRoom? If not, I've tried initializing the underlying arSession with initialWorldMap, but I get an error indicating that the configuration is malformed. Would that be a reasonable work around? Ideally, I'd be able to get the existing detected objects back into the RoomCaptureSession by initializing with a CapturedRoom, but at least being able to localize the camera to the original World frame would be nice. Thank you!
1
1
1.5k
Jul ’22
can't create RoomCaptureView
hi supporter, I've downloaded sample code from link https://developer.apple.com/documentation/roomplan/create_a_3d_model_of_an_interior_room_by_guiding_the_user_through_an_ar_experience but when click to button "Start Scanning" then my App has been crash with exception as image below: can you help to resolve this problem. thanks!
1
0
1.2k
Jul ’22
CapturedRoom versus Objects question / concern
The object model is pretty clean but I have a serious concern. I think you need two Object types or a way to tag a collection subset as it stands. Let me explain. So a fireplace is a FIXED asset. It's never going to move or change without you physically changing the wall it's attached to. To put a fireplace in the 'objects' array is a problem for me. Other fixed assets due to building codes also come to mind. T o il et, Sink and Bathtub. If it's got running water it better have a drain or we've got bigger problems. Point here is that also makes it a fixed asset. Short of changing a wall/remodel those objects are never moving. washer/dryer also has physical hookups that fix it to a location. It's not like a chair, couch or table for instance gas/electric oven stove has either a special 3 phase 220 plug or a natural gas line which also means it's fixed. I would suggest an 'attached' versus 'detached' type of Category subset or something of that nature. I'm not saying this is the best answer but I do challenge you to 'walk thru that door' and see what's behind it. :-) Probably the easiest fix with your current data model and data flows are to just create: CapturedRoom.Object.Category.Attached CapturedRoom.Object.Category.Detached Regardless of your solution putting a fireplace in the same Object array as a chair might burn the whole thing to the ground. :-) Can't wait to see Beta 3. Great stuff so far.
0
0
1.1k
Jun ’22
RoomCapture Visualizer
In the WWDC video the code includes a reference to the visualizer object. var previewVisualizer: Visualizer! I'd like to create my own ViewController using RoomCaptureSession and incorporate the visualizer. This doesn't seem to be available in the RoomPlan framework, have I missed something or has this been removed from the public interface? Thanks
2
0
1.6k
Jun ’22
Exporting from Roomplan when using
When using the RoomPlan UI (RoomCaptureView), one obtains the final result using  public func captureView(didPresent processedResult: CapturedRoom, error: Error?) which then gets exported via finalResults.export(to: url) What is the best way to do this if only using RoomCaptureSession? Should I just keep track if each CapturedRoom coming back in the delegate methods and use the final one?
1
0
1.8k
Jun ’22
RoomCapture instruction view?
The RoomCaptureView seems to have a coaching controller analogous to the ARCoachingOverlayView. The content is available via public func captureSession(_ session: RoomCaptureSession, didProvide instruction: RoomCaptureSession.Instruction) Is the view that presents these instructions available if not using the RoomCaptureView?
0
0
1.4k
Jun ’22
Extra Room tags
Let's say I am able to successfully scan a room and I am returned the dollhouse model. With this model, am I able to add customizable markers to the 3D model to denote key features of the model? Example: I want to mark a chair (for whatever reason). I scan my room, and I zoom in enough to hone in on the chair. I add a marker (colored) with the label "Antique chair", and when I zoom out, I can see the marker still on the (x,y,z) coordinate of the model where the 'chair' is. Thanks!
Replies
1
Boosts
0
Views
935
Activity
Jul ’22
RoomCapture Configuration - request for more config options
/// An object to configure the capture process     public struct Configuration {         public var isCoachingEnabled: Bool         public init()     } If I ask nicely would someone please add a few more features to this? Specifically, I would LOVE to be able to just detect a ROOM with no objects. Then I would also like to be able to pass a map of CapturedRoom.Object.Category objects to filter on or use for render. So for example I would pass into Configuration something like RoomCategory collection for the visualizer and USDZ model file. : [Category : SimpleMaterial] .sink: return SimpleMaterial(color: .systemBlue, roughness: roughness, isMetallic: false) .toilet: return SimpleMaterial(color: .systemTeal, roughness: roughness, isMetallic: false) .bathtub: return SimpleMaterial(color: .systemGreen, roughness: roughness, isMetallic: false) So the above would override the default of rending ALL known objects to just render the three above and give them the color I've laid out. While I'm at it, Beta 1 and Beta 2 changed a few things on this list. "screen" is a better name than "television". I also miss the ".unknown" category. Here is what was in Beta 1: .unknown .storage .refrigerator .stove .bed .sink .washer .toilet .bathtub .oven .dishwasher .table .sofa .chair .fireplace .screen .stairs The list above changed with Beta 2 that just shipped. So in Beta 2 .unknown was REMOVED, .washer is now .washerDryer and .screen is now .television. This API is super cool and amazing. I've really enjoyed working with it.
Replies
3
Boosts
0
Views
1.4k
Activity
Jul ’22
Initialize RoomCaptureSession with previous session data
I would like to start up a new RoomCaptureSession with data from the previous session, similar to using ARWorldTrackingConfiguration.initialWorldMap with ARSession. Is it possible to use RoomBuilder.capturedRoom(from:) to initialize RoomCaptureSession with a CapturedRoom? If not, I've tried initializing the underlying arSession with initialWorldMap, but I get an error indicating that the configuration is malformed. Would that be a reasonable work around? Ideally, I'd be able to get the existing detected objects back into the RoomCaptureSession by initializing with a CapturedRoom, but at least being able to localize the camera to the original World frame would be nice. Thank you!
Replies
1
Boosts
1
Views
1.5k
Activity
Jul ’22
can't create RoomCaptureView
hi supporter, I've downloaded sample code from link https://developer.apple.com/documentation/roomplan/create_a_3d_model_of_an_interior_room_by_guiding_the_user_through_an_ar_experience but when click to button "Start Scanning" then my App has been crash with exception as image below: can you help to resolve this problem. thanks!
Replies
1
Boosts
0
Views
1.2k
Activity
Jul ’22
CapturedRoom versus Objects question / concern
The object model is pretty clean but I have a serious concern. I think you need two Object types or a way to tag a collection subset as it stands. Let me explain. So a fireplace is a FIXED asset. It's never going to move or change without you physically changing the wall it's attached to. To put a fireplace in the 'objects' array is a problem for me. Other fixed assets due to building codes also come to mind. T o il et, Sink and Bathtub. If it's got running water it better have a drain or we've got bigger problems. Point here is that also makes it a fixed asset. Short of changing a wall/remodel those objects are never moving. washer/dryer also has physical hookups that fix it to a location. It's not like a chair, couch or table for instance gas/electric oven stove has either a special 3 phase 220 plug or a natural gas line which also means it's fixed. I would suggest an 'attached' versus 'detached' type of Category subset or something of that nature. I'm not saying this is the best answer but I do challenge you to 'walk thru that door' and see what's behind it. :-) Probably the easiest fix with your current data model and data flows are to just create: CapturedRoom.Object.Category.Attached CapturedRoom.Object.Category.Detached Regardless of your solution putting a fireplace in the same Object array as a chair might burn the whole thing to the ground. :-) Can't wait to see Beta 3. Great stuff so far.
Replies
0
Boosts
0
Views
1.1k
Activity
Jun ’22
RoomCapture Visualizer
In the WWDC video the code includes a reference to the visualizer object. var previewVisualizer: Visualizer! I'd like to create my own ViewController using RoomCaptureSession and incorporate the visualizer. This doesn't seem to be available in the RoomPlan framework, have I missed something or has this been removed from the public interface? Thanks
Replies
2
Boosts
0
Views
1.6k
Activity
Jun ’22
Exporting from Roomplan when using
When using the RoomPlan UI (RoomCaptureView), one obtains the final result using  public func captureView(didPresent processedResult: CapturedRoom, error: Error?) which then gets exported via finalResults.export(to: url) What is the best way to do this if only using RoomCaptureSession? Should I just keep track if each CapturedRoom coming back in the delegate methods and use the final one?
Replies
1
Boosts
0
Views
1.8k
Activity
Jun ’22
RoomCapture instruction view?
The RoomCaptureView seems to have a coaching controller analogous to the ARCoachingOverlayView. The content is available via public func captureSession(_ session: RoomCaptureSession, didProvide instruction: RoomCaptureSession.Instruction) Is the view that presents these instructions available if not using the RoomCaptureView?
Replies
0
Boosts
0
Views
1.4k
Activity
Jun ’22