Determination of relative position of an apparatus
This application describes fixture having a body and a plurality of fiducials with at least one of the fiducials having a first state and a second state and able to move to one of the first state and the second state. The fiducials are arranged such that knowledge of the 3D positions of the fiducials in an observing coordinate system is sufficient to determine a first position and a first orientation of the body in the observing coordinate system.
1. A method performed by a processing device, comprising steps:
receiving first information from a camera module comprising a first sensor and a second sensor, the first information comprising:
a first plurality of 2D positions of images formed on the first sensor of a respective plurality of target items fixedly attached to an apparatus; and
a second plurality of 2D positions of images formed on the second sensor of the same plurality of target items;
retrieving second information from a memory, the second information comprising:
a plurality of positions and angles of the first sensor and the second sensor in a first 3D coordinate system of the camera module; and
a plurality of 3D positions of the respective plurality of target items in a second 3D coordinate system of the apparatus;
calculating a plurality of 3D positions of the respective plurality of target items in the first coordinate system; and
calculating a position and orientation of the second coordinate system in the first coordinate system.
2. The method of claim 1 , wherein the first sensor and the second sensor are fixed in the first 3D coordinate system.
3. The method of claim 1 , wherein:
at least one sensor of the first sensor and the second sensor is movable with respect to the first 3D coordinate system; and
the first information comprises a current position and a current angle of the at least one sensor in the first 3D coordinate system.
4. The method of claim 1 , wherein the plurality of target items are fixed in the second 3D coordinate system.
5. The method of claim 1 , wherein the step of calculating a plurality of 3D positions of the respective plurality of target items in the first coordinate system is accomplished by an algorithm using a portion of the first information and a portion of the second information.
6. The method of claim 1 , wherein:
the camera module further comprises a first optical axis (OA) defined with respect to the first sensor and a second OA defined with respect to the second sensor; and
the second information further comprises a plurality of positions and angles of the first OA and the second OA with respect to the first 3D coordinate system.
7. The method of claim 1 , wherein:
at least one target item of the plurality of target items has a first state and a second state;
the first and second sensors are configured to detect whether an image is associated with a target item in the second state;
the apparatus is configured to cause the at least one target item to move from the first state to the second date upon receipt of a command; and
the first information identifies images that are associated with a target in the second state.
8. The method of claim 7 , further comprising the step of:
selecting one target item from the plurality of target items; and
sending the command to the apparatus;
wherein the step of calculating a plurality of 3D positions of the respective plurality of target items in the first coordinate system comprises:
selecting the 2D positions of images formed on the first sensor and the second sensor that are associated with a target item in the second state; and
calculating the 3D position of the one target item based on the selected 2D positions.
9. The method of claim 7 , wherein the at least one target item emits light in the second state and does not emit light in the first state.
10. The method of claim 7 , wherein the at least one target item emits modulated light in the second state and emit non-modulated light in the first state.
11. A storage device storing instructions that are executable to perform operations, comprising:
receiving first information from a camera module comprising a first sensor and a second sensor, the first information comprising:
a first plurality of 2D positions of images formed on the first sensor of a respective plurality of target items fixedly attached to an apparatus; and
a second plurality of 2D positions of images formed on the second sensor of the same target items;
retrieving second information from a memory, the second information comprising:
a plurality of positions and angles of the first sensor and the second sensor in a first 3D coordinate system of the camera module; and
a plurality of 3D positions of the respective plurality of target items in a second 3D coordinate system of the apparatus;
calculating a plurality of 3D positions of the respective plurality of target items in the first coordinate system; and
calculating a position and orientation of the second coordinate system in the first coordinate system.
12. The storage device of claim 11 , wherein the plurality of positions and angles of the first sensor and the second sensor are fixed in the first 3D coordinate system.
13. The storage device of claim 11 , wherein:
at least one sensor of the first sensor and the second sensor is movable with respect to the first 3D coordinate system; and
the first information comprises a current position and a current angle of the at least one sensor in the first 3D coordinate system.
14. The storage device of claim 11 , wherein the 3D positions of the plurality of target items are fixed in the second 3D coordinate system.
15. The storage device of claim 11 , wherein the step of calculating a plurality of 3D positions of the respective plurality of target items in the first coordinate system is accomplished by an algorithm that uses a portion of the first information and a portion of the second information.
16. The storage device of claim 11 , wherein:
the camera module further comprises a first optical axis (OA) defined with respect to the first sensor and a second OA defined with respect to the second sensor; and
the second information further comprises a plurality of positions and angles of the first OA and the second OA with respect to the first 3D coordinate system.
17. The storage device of claim 11 , wherein:
at least one target item of the plurality of target items has a first state and a second state;
the first and second sensors are configured to detect whether an image is associated with a target item in the second state;
the apparatus is configured to cause the at least one target item to move from the first state to the second date upon receipt of a command; and
the first information identifies images that are associated with a target in the second state.
18. The storage device of claim 17 , further comprising the step of:
selecting one target item from the plurality of target items; and
sending the command to the apparatus;
wherein the step of calculating a plurality of 3D positions of the respective plurality of target items in the first coordinate system comprises:
selecting the 2D positions of images formed on the first sensor and the second sensor that are associated with a target item in the second state; and
calculating the 3D position of the one target item based on the selected 2D positions.
19. The storage device of claim 17 , wherein the at least one target item emits light in the second state and does not emit light in the first state.
20. The storage device of claim 17 , wherein the at least one target item emits modulated light in the second state and emit non-modulated light in the first state.