IP Library Granted Patent US 11,356,650
Granted Patent B2
US 11,356,650 · App. 16/524,761 · Granted Jun 7, 2022

Calibration arrangement for structured light system using a tele-centric lens

Inventors: Song Zhang (West Lafayette, IN); Beiwen Li (Lafayette, IN)
Assignee: Purdue Research Foundation
H04N13/204G06T7/521G06T7/80H04N17/002G06T2207/30208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,356,650
App. No.
16/524,761
Granted
Jun 7, 2022
Kind
B2
Abstract

A vision system having a telecentric lens. The vision system includes a projector having a non-telecentric pin-hole lens, a camera having a telecentric lens positioned a distance away from the projector, and a processor. The processor controls the camera and the projector and is configured to calibrate the camera and projector.

Claims (49)

1. A vision system having a telecentric lens, comprising:

a projector having a non-telecentric pin-hole lens;

a camera having a telecentric lens positioned a distance away from the projector; and a processor, wherein the processor is configured to control the camera and the projector according to a system architecture encoded on a non-transitory computer readable medium.

2. The vision system of claim 1 , wherein the system architecture comprises:

a first protocol, wherein the first protocol is configured to control the camera to capture one or more images from a calibration target including one or more feature points with known world X-Y coordinates placed on a surface (Cal-Image);

a second protocol, wherein the second protocol is configure to identify feature points in the Cal-Image generating one or more set of coordinates;

a third protocol, wherein the third protocol is configured to control the projector to project at least one set of orthogonal fringe pattern onto the calibration target while commanding the camera to capture one image of the fringe pattern crossing the calibration target (Fringe-Image);

a fourth protocol, wherein the fourth protocol is configured to analyze the Fringe-Image to calculate the absolute phase of the at least one projected orthogonal fringe pattern;

a fifth protocol, wherein the fifth protocol is configured to analyze the absolute phase to establish a translation relationship between the X-Y coordinates of the camera to the X-Y coordinates of the projector;

a sixth protocol, wherein the sixth protocol is configured to calibrate the projector by calculating intrinsic and extrinsic matrices and calculate position of the calibration target in world XYZ coordinates, and

a seventh protocol, wherein the seventh protocol is configured to establish a calibration a matrix for the camera to thereby calibrate the camera.

3. The vision system of claim 2 , the calibration target is a 9×9 circle board.

4. The vision system of claim 3 , the feature points are circle centers.

5. The vision system of claim 2 , the at least one set of orthogonal fringe pattern includes orthogonal sinusoidal pattern.

6. The vision system of claim 2 , the transformation relationship between the X-Y-Z target coordinate to world X-Y-Z coordinate is analyzed by an iterative Levenberg-Marquardt optimization method.

7. The vision system of claim 2 , the calibration matrix for the camera is computed by a least square method.

8. A vision system having a telecentric lens, comprising:

a projector having a non-telecentric pin-hole lens;

a camera having a telecentric lens positioned a distance away from the projector; and

a processor, wherein the processor is configured to control the camera and the projector according to a system architecture encoded on a non-transitory computer readable medium, wherein the system architecture comprises:

a first protocol, wherein the first protocol is configured to control the camera to capture one or more images from a calibration target including one or more feature points with known world X-Y coordinates placed on a surface (Cal-Image);

a second protocol, wherein the second protocol is configure to identify feature points in the Cal-Image generating one or more set of coordinates;

a third protocol, wherein the third protocol is configured to control the projector to project at least one set of orthogonal fringe pattern onto the calibration target while commanding the camera to capture one image of the fringe pattern crossing the calibration target (Fringe-Image);

a fourth protocol, wherein the fourth protocol is configured to analyze the Fringe-Image to calculate the absolute phase of the at least one projected orthogonal fringe pattern;

a fifth protocol, wherein the fifth protocol is configured to analyze the absolute phase to establish a translation relationship between the X-Y coordinates of the camera to the X-Y coordinates of the projector;

a sixth protocol, wherein the sixth protocol is configured to calibrate the projector by calculating intrinsic and extrinsic matrices and calculate position of the calibration target in world XYZ coordinates, and

a seventh protocol, wherein the seventh protocol is configured to establish a calibration a matrix for the camera to thereby calibrate the camera.

9. The vision system of claim 8 , the calibration target is a 9×9 circle board.

10. The vision system of claim 9 , the feature points are circle centers.

11. The vision system of claim 8 , the at least one set of orthogonal fringe pattern includes orthogonal sinusoidal pattern.

12. The vision system of claim 8 , the transformation relationship between the X-Y-Z target coordinate to world X-Y-Z coordinate is analyzed by an iterative Levenberg-Marquardt optimization method.

13. The vision system of claim 8 , the calibration matrix for the camera is computed by a least square method.

14. A vision system comprising:

a projector having a non-telecentric pin-hole lens;

a camera having a telecentric lens positioned a distance away from the projector; and

a processor, wherein the processor is configured to control the camera and the projector according to a system architecture encoded on a non-transitory computer readable medium.

15. The vision system of claim 14 , wherein the system architecture comprises:

a first protocol, wherein the first protocol is configured to control the camera to capture one or more images from a calibration target including one or more feature points with known world X-Y coordinates placed on a surface (Cal-Image);

a second protocol, wherein the second protocol is configure to identify feature points in the Cal-Image generating one or more set of coordinates;

a third protocol, wherein the third protocol is configured to control the projector to project at least one set of orthogonal fringe pattern onto the calibration target while commanding the camera to capture one image of the fringe pattern crossing the calibration target (Fringe-Image);

a fourth protocol, wherein the fourth protocol is configured to analyze the Fringe-Image to calculate the absolute phase of the at least one projected orthogonal fringe pattern;

a fifth protocol, wherein the fifth protocol is configured to analyze the absolute phase to establish a translation relationship between the X-Y coordinates of the camera to the X-Y coordinates of the projector;

a sixth protocol, wherein the sixth protocol is configured to calibrate the projector by calculating intrinsic and extrinsic matrices and calculate position of the calibration target in world XYZ coordinates, and

a seventh protocol, wherein the seventh protocol is configured to establish a calibration a matrix for the camera to thereby calibrate the camera.

16. The vision system of claim 15 , the calibration target is a 9×9 circle board.

17. The vision system of claim 16 , the feature points are circle centers.

18. The vision system of claim 15 , the at least one set of orthogonal fringe pattern includes orthogonal sinusoidal pattern.

19. The vision system of claim 15 , the transformation relationship between the X-Y-Z target coordinate to world X-Y-Z coordinate is analyzed by an iterative Levenberg-Marquardt optimization method.

20. The vision system of claim 15 , the calibration matrix for the camera is computed by a least square method.

Assignments (1)
CONFIRMATORY LICENSE Recorded Oct 2, 2019
From: PURDUE UNIVERSITY
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 050611/0764 →
Continuity (3)
Continuation 15273463 · Sep 22, 2016
Provisional Application 62221699 · Sep 22, 2015
Related Publication 20200099915A1 · Mar 26, 2020