Regarding real-time object tracking and real-time image recognition

  1. We used real-time object tracking, and with enterprise permissions, we can improve the smoothness to 30Hz, but there are still noticeable delays. On one hand, we want to know why this delay occurs; is it due to performance considerations? Because we found that the delay in hand tracking is actually very low.

  2. On the other hand, we consider that it may be due to the complexity of 3D objects, so I considered using image tracking. However, we found that there are even more serious delays in image tracking and QR code tracking. We hope to optimize it. Currently, the frame rate for recognizing images for tracking seems to be one frame per second, and we hope to increase it because object recognition and tracking can be very smooth on other Apple platforms, such as iOS.

  3. Additionally, can we appropriately consider interfaces for depth recognition to obtain depth data?

  4. We want to know what accuracy vision can achieve in measuring the physical world, as well as the accuracy in rendering on the screen. We wonder if this is related to hardware devices like radar. Also, what accuracy can we achieve in tracking the movement distance of objects?

Hello @YuThomas,

Quick response to the list with some follow on questions inline.

  1. hard to know for sure what is happening here without more detail. Could you run and instruments trace and file a feedback with what you find?
  • more info on instruments here
  • feedback here
  1. Image tracking is currently set to be 1fps. If you need a different rate this would be another great thing to file a feedback for.

  2. Please file a feedback with your use case.

  3. I'm not sure what you mean by 'measuring' the real world. Are you looking to get a measurement like 'that table is 1 meter deep'?

  • similar question about 'accuracy in rendering on the screen'. Is this about how closely the scene reconstruction model is to the real world?
  • tracking particular objects requires recognizing the object with technology like what I think you are asking about in the first question. If you are tracking an object like that and not seeing the accuracy you'd like please file a feedback with some details about what exactly is not working as expected.

Please redirect me if I have misunderstood any of your questions.

Regarding real-time object tracking and real-time image recognition
 
 
Q