It looks like a machine problem, I have a mbp 2019 quad core i5 and is super slow in the sample projects. Yours looks a little bit older
Maybe you can try with a new empty project to see if that works, and then proceed with the 4 projects in the documentation of visionOS
Topic:
App & System Services
SubTopic:
Core OS
Tags: