.Draggable performing terribly on the vision Pro

Hi, I'm an indie developer trying to make a 2D prototype of a simple game where I have to drag and drop items from one box to another. I have so far implemented a working prototype with the .draggable (https://developer.apple.com/documentation/swiftui/view/draggable(_:)) function which works well in the simulator, but as soon as I use my vision pro, the finger pinch action doesn't register half the time. I can only select the object around 30% of the time.

My code is as follows.

 DiskView(size: diskSize, rod: rodIndex)
                        .draggable(DiskView(size: diskSize, rod: rodIndex))
                        .hoverEffect()

I have also registered DiskView as a UTType and have it able to be transferred around.

The business logic works, just the pinch gesture does not work half the time.