How to access MeshAnchor's classification on visionOS?

The documentation says that MeshAnchor should have a property with enum MeshAnchor.MeshClassification type to get the classification of the mesh (if it is a floor, furniture, table etc...)

Is there a way to access this property?

Up vote post of viktor2000 Down vote post of viktor2000
511 views
Posted by
viktor2000
Reply
Add a Comment

Accepted Reply

It's accessible through the geometry of the MeshAnchor.

See:

/// The classification of each face in the mesh.
var classifications: GeometrySource?

Source: https://developer.apple.com/documentation/arkit/meshanchor/geometry

Posted by
Frameworks Engineer
Up vote reply of Frameworks Engineer Down vote reply of Frameworks Engineer
Post marked as solved

  • This returns a GeometrySource. How can one access an instance of MeshAnchor.MeshClassification?

    —
    J0hn
Add a Comment

Replies

It's accessible through the geometry of the MeshAnchor.

See:

/// The classification of each face in the mesh.
var classifications: GeometrySource?

Source: https://developer.apple.com/documentation/arkit/meshanchor/geometry

Posted by
Frameworks Engineer
Up vote reply of Frameworks Engineer Down vote reply of Frameworks Engineer
Post marked as solved

  • This returns a GeometrySource. How can one access an instance of MeshAnchor.MeshClassification?

    —
    J0hn
Add a Comment

Incorporating MeshAnchor's Classification in AR Experiences

Once developers have accessed MeshAnchor's classification on visionOS, they can leverage this information to create engaging and interactive AR experiences. Here are some examples of how MeshAnchor's classification can be utilized:

Object Placement: By identifying surfaces like tables or floors, developers can accurately place virtual objects in the physical environment, ensuring realistic positioning and alignment.

Surface Detection: MeshAnchor's classification can help in detecting and tracking different surfaces, allowing AR content to adapt and interact with the environment accordingly. For example, virtual characters can walk on floors or lean against walls.

Environmental Interactions: With classification data, developers can enable realistic environmental interactions. For instance, virtual water splashes on classified surfaces like tables or virtual balls bounce off the floor.

Spatial Understanding: By analyzing the classification data of surrounding surfaces, developers can gain insights into the spatial layout of the environment. This information can assist in creating AR experiences that dynamically respond to the surroundings.

If resolve then get further step(https://https://bynext.com/2023/10/12/how-to-access-meshanchors-classification-on-visionos-a-comprehensive-guide)

Posted by
bynextdigital
Up vote reply of bynextdigital Down vote reply of bynextdigital
Add a Comment