Calibration system and method to align a 3D virtual scene and a 3D real world for a stereoscopic head-mounted display
A calibration platform may obtain measurements for aligning a real-world coordinate system and a display coordinate system. For example, the calibration platform may display, via an optical see-through head-mounted display (OST-HMD), a three-dimensional virtual object and receive, from a positional tracking device, information that relates to a current pose of a three-dimensional real-world object to be aligned with the three-dimensional virtual object. The calibration platform may record a three-dimensional position of a plurality of points on the three-dimensional real-world object based on the current pose of the three-dimensional real-world object, based on an indication that the plurality of points on the three-dimensional real-world object respectively corresponds with a plurality of points on the three-dimensional virtual object. Accordingly, based on the obtained measurements, the calibration platform may generate a transformation function to provide a mapping between three-dimensional points in the real-world coordinate system and three-dimensional points in the display coordinate system.
1. A calibration device, comprising:
a memory; and
one or more processors, communicatively coupled to the memory, to:
receive, from a positional tracking device, information that relates to a pose of a three-dimensional real-world object to be aligned with a three-dimensional virtual object;
perform a first operation to display, via an optical see-through head-mounted display device, the three-dimensional virtual object in a display coordinate system corresponding to a three-dimensional display space of the optical see-through head-mounted display device;
perform a second operation to record three-dimensional positions of multiple points on the three-dimensional real-world object in a real-world coordinate system associated with the positional tracking device based on the pose of the three-dimensional real-world object at a time when a calibration input is received;
repeat the first operation and the second operation until a recorded quantity of the three-dimensional positions satisfies a threshold value; and
generate a transformation function to provide a mapping between three-dimensional points in the real-world coordinate system and three-dimensional points in the display coordinate system corresponding to the three-dimensional display space of the optical see-through head-mounted display device based on the recorded quantity of the three-dimensional positions.
2. The calibration device of claim 1 , wherein the multiple points on the three-dimensional real-world object correspond to corners of a real cube and the multiple corresponding points on the three-dimensional virtual object correspond to corners of a virtual cube.
3. The calibration device of claim 1 , wherein the three-dimensional real-world object has multiple colored faces with fiducial markers that are tracked by the positional tracking device, and
wherein the three-dimensional virtual object has multiple colored faces that correspond to the multiple colored faces of the three-dimensional real-world object.
4. The calibration device of claim 1 , wherein the transformation function includes one or more of an affine transformation, a perspective transformation, or an isometric transformation.
5. The calibration device of claim 1 , wherein the positional tracking device is a camera coupled to the optical see-through head-mounted display device.
6. The calibration device of claim 1 , wherein the positional tracking device is positioned at a particular location external to the optical see-through head-mounted display device.
7. The calibration device of claim 1 , wherein the multiple points on the three-dimensional real-world object comprise at least three non-collinear points or non-coplanar points corresponding to at least three points on the three-dimensional virtual object.
8. A method, comprising:
receiving, by a device, and from a positional tracking device, information that relates to a pose of a three-dimensional real-world object to be aligned with a three-dimensional virtual object;
performing, by the device, a first operation to display, via an optical see-through head-mounted display device, the three-dimensional virtual object in a display coordinate system corresponding to a three-dimensional display space of the optical see-through head-mounted display device;
performing, by the device, a second operation to record three-dimensional positions of multiple points on the three-dimensional real-world object in a real-world coordinate system associated with the positional tracking device based on the pose of the three-dimensional real-world object at a time when a calibration input is received;
repeating, by the device, the first operation and the second operation until a recorded quantity of the three-dimensional positions satisfies a threshold value; and
generating, by the device, a transformation function to provide a mapping between three-dimensional points in the real-world coordinate system and three-dimensional points in the display coordinate system corresponding to the three-dimensional display space of the optical see-through head-mounted display device based on the recorded quantity of the three-dimensional positions.
9. The method of claim 8 , wherein the multiple points on the three-dimensional real-world object correspond to corners of a real cube and the multiple corresponding points on the three-dimensional virtual object correspond to corners of a virtual cube.
10. The method of claim 8 , wherein the three-dimensional real-world object has multiple colored faces with fiducial markers that are tracked by the positional tracking device, and
wherein the three-dimensional virtual object has multiple colored faces that correspond to the multiple colored faces of the three-dimensional real-world object.
11. The method of claim 8 , wherein the transformation function includes one or more of an affine transformation, a perspective transformation, or an isometric transformation.
12. The method of claim 8 , wherein the positional tracking device is a camera coupled to the optical see-through head-mounted display device.
13. The method of claim 8 , wherein the positional tracking device is positioned at a particular location external to the optical see-through head-mounted display device.
14. The method of claim 8 , wherein the multiple points on the three-dimensional real-world object comprise at least three non-collinear points or non-coplanar points corresponding to at least three points on the three-dimensional virtual object.
15. A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the device to:
receive, from a positional tracking device, information that relates to a pose of a three-dimensional real-world object to be aligned with a three-dimensional virtual object;
perform a first operation to display, via an optical see-through head-mounted display device, the three-dimensional virtual object in a display coordinate system corresponding to a three-dimensional display space of the optical see-through head-mounted display device;
perform a second operation to record three-dimensional positions of multiple points on the three-dimensional real-world object in a real-world coordinate system associated with the positional tracking device based on the pose of the three-dimensional real-world object at a time when a calibration input is received;
repeat the first operation and the second operation until a recorded quantity of the three-dimensional positions satisfies a threshold value; and
generate a transformation function to provide a mapping between three-dimensional points in the real-world coordinate system and three-dimensional points in the display coordinate system corresponding to the three-dimensional display space of the optical see-through head-mounted display device based on the recorded quantity of the three-dimensional positions.
16. The non-transitory computer-readable medium of claim 15 , wherein the three-dimensional real-world object has multiple colored faces with fiducial markers that are tracked by the positional tracking device, and
wherein the three-dimensional virtual object has multiple colored faces that correspond to the multiple colored faces of the three-dimensional real-world object.
17. The non-transitory computer-readable medium of claim 15 , wherein the transformation function includes one or more of an affine transformation, a perspective transformation, or an isometric transformation.
18. The non-transitory computer-readable medium of claim 15 , wherein the positional tracking device is a camera coupled to the optical see-through head-mounted display device.
19. The non-transitory computer-readable medium of claim 15 , wherein the positional tracking device is positioned at a particular location external to the optical see-through head-mounted display device.
20. The non-transitory computer-readable medium of claim 15 , wherein the multiple points on the three-dimensional real-world object comprise at least three non-collinear points or non-coplanar points corresponding to at least three points on the three-dimensional virtual object.