IP Library › Granted Patent US 11,528,410
Granted Patent B2
US 11,528,410 · App. 17/110,082 · Granted Dec 13, 2022

Calibration operation support device for industrial camera

Inventors: Keiji Okuhara (Chita-gun, JP); Tsuyoshi Ueyama (Chita-gun, JP)
Assignee: DENSO WAVE INCORPORATED
H04N5/23222G06T7/80H04N5/272H04N17/002G06T2207/30108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,528,410
App. No.
17/110,082
Granted
Dec 13, 2022
Kind
B2
Abstract

A calibration operation support device is applied to a system including an industrial camera and a display device displaying a predetermined image that is an image of a predetermined area being captured by the industrial camera, and includes a processing device configured to perform a calibration of the industrial camera based on captured images that are obtained by capturing a calibration pattern by the industrial camera. The processing device is further configured to instruct the display device to display positions of the calibration patterns in the captured images acquired as images to be used for the calibration in a manner superimposed on the predetermined image.

Claims (22)

1. A calibration operation support device configured to be used with a system including an industrial camera configured to capture a predetermined area and a display device configured to display a predetermined image that is an image of the predetermined area captured by the industrial camera, the calibration operation support device comprising:

a processor configured to:

perform a calibration of the industrial camera based on a plurality of captured images of a calibration pattern, the calibration pattern includes a plurality of feature points, the plurality of captured images captured by the industrial camera, and

instruct the display device to display a distribution of an effect based on the calibration patterns in the captured images, the displayed distribution being obtained by superimposing total values obtained by summing predetermined values accordingly to distances from the features points at each position, the displayed distribution being configured to improve an accuracy of the calibration in the predetermined area by displaying the distribution of the effect superimposed on the predetermined image.

2. The calibration operation support device according to claim 1 , wherein

a position of each of the feature points is set as a vertex, the predetermined values are each a value that becomes smaller as a distance from the vertex increases.

3. The calibration operation support device according to claim 2 , wherein each predetermined value is a value based on a normal distribution with the position of each of the feature points as the vertex.

4. The calibration operation support device according to claim 3 , wherein each predetermined value is a value larger than 0 in the entire predetermined area.

5. The calibration operation support device according to claim 3 , wherein the processor is further configured to instruct the display device to display a position of the calibration pattern at which a sum of the total values is smallest in a region corresponding to the calibration pattern in the predetermined area as a position at which the calibration pattern is to be arranged superimposed in the predetermined image.

6. The calibration operation support device according to claim 3 , wherein the processor is further configured to:

set the predetermined area as a two-dimensional plane, and

set the position of each of the feature points as a position on the two-dimensional plane.

7. The calibration operation support device according to claim 6 , wherein the processor is further configured to instruct the display device to display a position where the calibration pattern is to be arranged in the predetermined area as the two-dimensional plane superimposed on the predetermined image.

8. The calibration operation support device according to claim 7 , wherein the processor is further configured to:

after executing the calibration, set the predetermined area as a three-dimensional space by using parameters related to the industrial camera acquired by the calibration, and

set the position of each of the feature points as a position in the three-dimensional space.

9. The calibration operation support device according to claim 8 , wherein the processor is further configured to instruct the display device to display a position where the calibration pattern is to be arranged in the predetermined area as the three-dimensional space superimposed on the predetermined image.

10. The calibration operation support device according to claim 3 , wherein the processor is further configured to instruct the display device to display a position of the calibration pattern at which a sum of the total values in a point cloud coordinate is smallest in a region corresponding to the calibration pattern in the predetermined area as a position at which the calibration pattern is to be arranged superimposed in the predetermined image.

11. The calibration operation support device according to claim 3 , wherein the processor is further configured to instruct the display device to display a position of the calibration pattern at which a sum of a distribution created from a point cloud coordinate and the total values is largest in a region corresponding to the calibration pattern in the predetermined area as a position where the calibration pattern is to be arranged superimposed on the predetermined image.

12. The calibration operation support device according to claim 2 , wherein the processor includes a central processing unit (CPU) and a non-transitory computer-readable recording medium storing a program that, when executed, causes the CPU to:

perform the calibration of the industrial camera; and

instruct the display device to display the distribution of the effect.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2020
From: OKUHARA, KEIJI; UEYAMA, TSUYOSHI
To: DENSO WAVE INCORPORATED
Reel/Frame 054576/0917 →
Priority Claims (2)
JP JP2019-220075 · Dec 5, 2019 · national
JP JP2020-184029 · Nov 3, 2020 · national
Continuity (1)
Related Publication 20210176394A1 · Jun 10, 2021
Cited By (2)
US 12,307,715 US 12,657,772