IP Library Granted Patent US 9,819,929
Granted Patent B2
US 9,819,929 · App. 15/251,578 · Granted Nov 14, 2017

Calibration of a three-dimensional acquisition system

Inventors: Ron Kimmel (Haifa, IL); Barak Freedman (Yokneam, IL); Alex Bronstein (Haifa, IL); Michael Bronstein (Lugano, CH); Sagi Ben Moshe (Kiryat Byalik, IL)
Assignee: Intel Corporation
H04N13/0246G06T7/521G06T7/80H04N5/2256H04N5/33H04N5/332H04N5/357H04N13/0051H04N13/025H04N13/0239H04N13/0253H04N13/0296G06T2207/10024G06T2207/10028G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,819,929
App. No.
15/251,578
Granted
Nov 14, 2017
Kind
B2
Abstract

Embodiments of the present disclosure provide techniques and configurations for an optoelectronic three-dimensional object acquisition assembly configured to correct image distortions. In one instance, the assembly may comprise a first device configured to project a light pattern on an object at a determined angle; a second device configured to capture a first image of the object illuminated with the projected light pattern; a third device configured to capture a second image of the object; and a controller coupled to the first, second, and third devices and configured to reconstruct an image of the object from geometric parameters of the object obtained from the first image, and to correct distortions in the reconstructed image caused by a variation of the determined angle of the light pattern projection, based at least in part on the first and second images of the object. Other embodiments may be described and/or claimed.

Claims (38)

1. An optoelectronic three-dimensional object acquisition assembly, comprising:

a first device to project light patterns on an object;

a second device to capture a first image of the object illuminated with the projected light patterns;

a third device to capture a second image of the object illuminated with the projected light patterns; and

a controller coupled to the first, second, and third devices, to correct distortions in a reconstructed image of the object caused by a variation of a determined angle of the light patterns projection by the first device, based at least in part on the first and second images of the object, in response to a determination that a distortion of at least one of geometric parameters obtained from the first image of the object exceeds a determined threshold, wherein the reconstructed image of the object is based at least in part on the first image of the object.

2. The assembly of claim 1 , wherein the third device comprises a digital camera having a resolution that is different than a resolution of the second device, to capture a texture image of the object in the second image.

3. The assembly of claim 2 , wherein the controller is to compare the texture image with the reconstructed image, determine a mismatch of corresponding features in the texture image and the reconstructed image, and identify at least one correction parameter to be used in the reconstructed image to compensate for the mismatch.

4. The assembly of claim 3 , wherein the corresponding features include distances between corresponding points in the texture image and the reconstructed image, wherein the distances are indicative of a degree of misalignment of the corresponding points.

5. The assembly of claim 1 , wherein the controller is to reconstruct the image of the object from the geometric parameters of the object obtained from the first image of the object, prior to the distortion correction of the image of the object.

6. The assembly of claim 1 , wherein the first device comprises a projector to project one-dimensional coded light patterns on the object.

7. The assembly of claim 6 , wherein the projector includes at least one micro-electro-mechanical systems (MEMS) mirror to reflect a laser line generated by a laser arrangement coupled with the projector, during pre-determined time intervals, to project the one-dimensional coded light patterns resulted from a tiltable reflection.

8. The assembly of claim 7 , wherein the second device comprises a digital infrared (IR) camera to capture the first image during a sensing cycle of the digital IR camera.

9. The assembly of claim 6 , wherein the projector comprises an infrared (IR) projector, the second device comprises an IR camera, and the third device comprises a multi-chromatic camera, including a red, green, and blue (RGB) camera.

10. The assembly of claim 9 , wherein the controller is further to estimate a misalignment in a texture image caused by the variation of the determined angle of the light pattern projection, compute a displacement of geometric parameters of the reconstructed image of the object caused by the misalignment, and compensate the reconstructed geometric parameters for the computed displacement.

11. The assembly of claim 1 , wherein the controller is further to correct distortions in the reconstructed image periodically.

12. An optoelectronic three-dimensional object acquisition assembly, comprising:

a first device to capture a first image of an object;

a second device to capture a second image of the object;

a third device to capture a third image of the object; and

a controller coupled to the first, second, and third devices, to correct distortions in a reconstructed image of the object caused by a variation of a determined angle of a light patterns projection on the object, based at least in part on the first and second images of the object, in response to a determination that a distortion of at least one of geometric parameters obtained from the first image of the object exceeds a determined threshold, wherein the reconstructed image of the object is based at least in part on the first image of the object.

13. The assembly of claim 12 , wherein the controller is to reconstruct the image of the object from geometric parameters of the object obtained from the first and second images.

14. The assembly of claim 12 , wherein the first and second devices comprise digital infrared (IR) cameras to capture the first and second images during respective sensing cycles of the digital IR cameras.

15. The assembly of claim 14 , wherein the third device comprises a multi-chromatic camera having a resolution that is different than a resolution of the first or second device, to capture a pre-calibrated texture image of the object in the third image.

16. The assembly of claim 12 , wherein the controller is to obtain the geometric parameters of the object using epipolar geometry techniques.

17. The assembly of claim 12 , wherein the controller is further to correct distortions in the reconstructed image of the object through alignment of the reconstructed image of the third image and determination of a mismatch of corresponding features in the reconstructed image and the third image.

18. A method for correcting distortions in a reconstructed image of an object, comprising:

obtaining, by a controller coupled with a three-dimensional object acquisition assembly, a first image of an object captured with a first camera included in the three-dimensional object acquisition assembly, the image captured during a projection of a light pattern on the object at a determined angle with a projector included in the three-dimensional object acquisition assembly;

obtaining, by the controller, a second image of the object captured with a second camera included in a three-dimensional object acquisition assembly;

determining, by the controller, that a distortion of at least one of geometric parameters obtained from the first image of the object exceeds a determined threshold; and

correcting, by the controller, distortions in a reconstructed image of the object caused by a variation of a determined angle of the light patterns projection by the projector on the object, based at least in part on the first and second images of the object, and in response to a result of determining, wherein the reconstructed image of the object is based at least in part on the first image of the object.

19. The method of claim 18 , further comprising:

obtaining, by the controller, the geometric parameters from the first image; and

reconstructing, by the controller, the image of the object from the geometric parameters of the object obtained from the first image.

20. The method of claim 18 , wherein the projector comprises an infrared (IR) projector, the first camera comprises an IR digital camera, and the second camera comprises a multi-chromatic camera, including a digital red, green, and blue (RGB) camera.

21. The method of claim 18 , wherein correcting distortions in the reconstructed image includes:

comparing, by the controller, the reconstructed image with the second image;

determining, by the controller, a mismatch of corresponding features in the reconstructed image and the second image; and

identifying, by the controller, at least one correction parameter to be used in the reconstructed image to compensate for the mismatch.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2026
From: INTEL CORPORATION
To: REALSENSE, INC.
Reel/Frame 074071/0151 →
Continuity (2)
Continuation 14104242 · Dec 12, 2013
Related Publication 20160373727A1 · Dec 22, 2016