Post not yet marked as solved
Post marked as unsolved with 3 replies, 1,534 views
Hello,
I am trying to retreive the intrinsics & extrinsics of the lidar wrt RGB on an Ipad Pro 2020.
SDK does not seem to give them.
What should I use ?
I've tried :
https://developer.apple.com/documentation/arkit/arcamera/2875730-intrinsics?language=objc
both in swift and objective-c and only the RGB seem to contain data. Using the following callbacks :
ObjC :
		simd_float3x3 mat = self.sceneView.session.currentFrame.camera.intrinsics;
		simd_float3x3 matDepth = self.sceneView.session.currentFrame.capturedDepthData.cameraCalibrationData.intrinsicMatrix ;
		float fx = mat.columns[0].x;
		float fy = mat.columns[1].y;
		float cx = mat.columns[2].x;
		float cy = mat.columns[2].y;
		float teta = mat.columns[1].x;
		NSLog(@" fx %f", fx);
		NSLog(@" fy %f", fy);
		NSLog(@" cx %f", cx);
		NSLog(@" cy %f", cy);
		NSLog(@" teta %f", teta);
		float fx2 = matDepth.columns[0].x;
		float fy2 = matDepth.columns[1].y;
		float cx2 = matDepth.columns[2].x;
		float cy2 = matDepth.columns[2].y;
		float teta2 = matDepth.columns[1].x;
		NSLog(@" fx2 %f", fx2);
		NSLog(@" fy2 %f", fy2);
		NSLog(@" cx2 %f", cx2);
		NSLog(@" cy2 %f", cy2);
		NSLog(@" teta2 %f", teta2);
Results in :
fx 1619.127563
fy 1619.127563
cx 934.813416
cy 713.917847
teta 0.000000
fx2 0.000000
fy2 0.000000
cx2 0.000000
cy2 0.000000
teta2 0.000000
In Swift :
		 print ("RGB:", self.session.currentFrame.camera.intrinsics.debugDescription)
		}
print ("Depth : " ,	self.session.currentFrame.capturedDepthData.debugDescription)
		}
results in :
RGB: simd_float3x3([[1598.34, 0.0, 0.0], [0.0, 1598.34, 0.0], [935.70917, 713.61804, 1.0]])
Depth : nil
Bonus Question :
Is there any sample project code where RGB and Lidar are aligned ?