Turn physical surface into touchscreen in VisionOS

In VisionOS is it possible to detect when a user is touching a physical surface in the real world and also to project 2D graphics on that surface? So imagine a windowless 2D app that is projected onto a surface, essentially turning a physical wall, table, etc. into a giant touchscreen?

So kinda like this:

https://appleinsider.com/articles/23/06/23/vision-pro-will-turn-any-surface-into-a-display-with-touch-control

But I want every surface in the room to be touchable and be able to display 2D graphics on the face of that surface and not floating in space. So essentially turning every physical surface in the room into a UIView.

Thanks!

Yes. surface geometry can be retrieved textures on geometries can be drawn/animated hand position can be retrieved its all possible

Turn physical surface into touchscreen in VisionOS
 
 
Q