System and method for adaptive range 3D scanning
A scanner system is configured for acquiring three dimensional image information of an object. The scanner includes a projector, a camera, a graphics processing device, and a processor. The projector projects one of several pre-defined patterns upon the object. The camera captures an image from the object, which is received by the processor. The processor approximates mutual information from the object and the pattern using the graphics processing device, and selects a second pattern for projecting on the object.
1. A scanner system for acquiring three dimensional image information of an object comprising:
a projector configured to project a pattern from a plurality of pre-defined patterns upon the object;
a camera;
a graphics processing device configured to process image information from the camera; and
a processor and a memory configured to store non-transient instructions that, when executed by the processor and/or the graphics processing device, perform the steps of:
projecting with the projector a first pattern from the plurality of pre-defined patterns upon the object;
capturing, with the camera, an image from light of the first pattern reflected from the object;
receiving the image from the camera;
from the image, approximating mutual information from the object and the pattern;
based at least in part upon the mutual information, selecting a second pattern from the plurality of pre-defined patterns; and
projecting, with the projector, the second pattern on the object.
2. The system of claim 1 , further comprising a controller configured to control an operation of the projector and/or the camera.
3. The system of claim 1 , further comprising the step of:
based at least in part upon the mutual information, updating a world state estimate of a 3D environment of the object comprising a scanner system pose.
4. The system of claim 3 , wherein the world state estimate comprises at least one of the group consisting of a map, and a scanner pose.
5. The system of claim 3 , wherein a specific aspect of the world state estimate comprises at least one of the group consisting of a map, a scanner pose, and a physical aspect of the object.
6. The system of claim 1 , wherein selecting the second pattern further comprises determining mutual information based upon an identified inference task.
7. The system of claim 1 , wherein selecting the second pattern is based at least in part by an identified inference task.
8. The system of claim 1 , wherein approximating mutual information from the object and the pattern comprises determining pixel-wise mutual information.
9. The system of claim 1 , wherein the graphics processing device comprises a graphical processing unit (GPU).
10. The system of claim 1 , wherein selecting the second pattern may further be based upon information theoretic measures.
11. The system of claim 1 , wherein selecting the second pattern may further be based upon quantification of uncertainty.
12. The system of claim 11 , wherein quantification of uncertainty comprises entropy and/or renyi entropy.
13. The system of claim 1 , wherein selecting the second pattern may further be based upon quantification accuracy.
14. The system of claim 13 , wherein quantification accuracy further comprises reconstruction error and/or variance.
15. A method for acquiring three dimensional image information of an object with a scanner comprising the steps of:
projecting with a first pattern from a plurality of pre-defined patterns upon the object;
capturing an image from light of the first pattern reflected from the object;
approximating mutual information from the object and the pattern;
based at least in part upon the mutual information, selecting a second pattern from the plurality of pre-defined patterns; and
projecting the second pattern on the object.
16. The method of claim 15 , further comprising the step of based at least in part upon the mutual information, updating a world state estimate of a 3D environment of the object comprising a scanner system pose.
17. The method of claim 16 , wherein the world state estimate comprises at least one of the group consisting of a map, and a scanner pose.
18. The method of claim 15 , wherein selecting the second pattern further comprises determining mutual information based upon an identified inference task.
19. The method of claim 15 , wherein approximating mutual information from the object and the pattern comprises determining pixel-wise mutual information.
20. The method of claim 15 , wherein selecting the second pattern may further be based upon at least one of the group consisting of information theoretic measures, quantification of uncertainty, and quantification accuracy.