IP Library › Granted Patent US 11,004,229
Granted Patent B2
US 11,004,229 · App. 16/138,136 · Granted May 11, 2021

Image measurement device, image measurement method, imaging device

Inventor: Takuya Ishibashi (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
G06T7/62G06T7/593H04N13/111H04N13/239H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,004,229
App. No.
16/138,136
Granted
May 11, 2021
Kind
B2
Abstract

An image measurement device is provided that includes at least one processor and at least one memory functioning as: a first acquisition unit that acquires a plurality of image data captured at a plurality of focus positions and at different viewpoints; a second acquisition unit that acquires distance information corresponding to each of the plurality of image data on the basis of the image data at different viewpoints at each focus position; a designation unit that designates a ranging point; a determination unit that determines reliability corresponding to the ranging point in each of the plurality of image data; and a selection unit that selects the distance information used as the distance information of the ranging point from the distance information acquired by the second acquisition unit on the basis of the reliability determined by the determination unit.

Claims (41)

1. An image measurement device comprising:

at least one processor and at least one memory functioning as:

a first acquisition unit that acquires a plurality of image data captured at a plurality of focus positions and at different viewpoints;

a second acquisition unit that acquires distance information corresponding to each of the plurality of image data on the basis of the image data at different viewpoints at each focus position;

a designation unit that designates a ranging point;

a determination unit that determines reliability corresponding to the ranging point in each of the plurality of image data;

a selection unit that selects the distance information used as the distance information of the ranging point from the distance information acquired by the second acquisition unit on the basis of the reliability determined by the determination unit, and

a calculation unit that calculates a length between two ranging points in a three-dimensional space including a depth direction of the image from the distance information selected by the selection unit at two ranging points specified by the designation unit.

2. The image measurement device according to claim 1 , wherein the designation unit designates the two ranging points on the basis of an instruction from an operating unit operated by a user or by detecting a feature point of the image.

3. The image measurement device according to claim 1 , wherein the determination unit determines the reliability on the basis of the distance information of the two ranging points in each of the plurality of images and an effective ranging range in each image.

4. The image measurement device according to claim 3 , wherein the determination unit sets the reliability to be higher than that when the distance information of the two ranging points are not in the effective ranging range when the distance information of the two ranging points in each of the plurality of images are both in the effective ranging range in the image.

5. The image measurement device according to claim 1 , wherein the determination unit determines the reliability at the ranging point according to the amount of image shift or the amount of defocus calculated at the two ranging points in each of the plurality of image data.

6. The image measurement device according to claim 5 , wherein the determination unit sets the reliability to be lower than that when the amount of image shift or the amount of defocus is a second value smaller than the first value when the amount of image shift or the amount of defocus calculated at the two ranging points in each of the plurality of image data is a first value.

7. The image measurement device according to claim 1 , wherein the determination unit determines the reliability at the ranging point according to a luminance value calculated at the two ranging points in the plurality of image data.

8. The image measurement device according to claim 7 , wherein the determination unit sets the reliability to be lower than that when the luminance value is a second value that is a value that is separated from the first value by a predetermined value when the luminance value calculated at the two ranging points in the plurality of image data is a first value.

9. The image measurement device according to claim 1 , wherein the determination unit determines the reliability at the ranging point according to a dispersion value of the pixel calculated at the two ranging points in the plurality of image data.

10. The image measurement device according to claim 1 , wherein the determination unit sets the reliability to be lower than that when the luminance value is a second value that is greater than the first value when a dispersion value of the pixel calculated at the two ranging points in the plurality of image data is a first value.

11. The image measurement device according to claim 1 , wherein the second acquisition unit acquires distance information of the subject through laser ranging.

12. The image measurement device according to claim 1 , wherein the second acquisition unit acquires the distance information of the subject calculated using a ratio of a focal length and a lateral magnification of an imaging optical system.

13. The image measurement device according to claim 1 , comprising a display unit configured to display a length between the ranging points calculated by the calculation unit.

14. The image measurement device according to claim 1 , wherein the selection unit selects the distance information corresponding to higher reliability among the plurality of image data.

15. An image measurement device comprising:

at least one processor and at least one memory functioning as:

a first acquisition unit that acquires a plurality of image data captured at a plurality of focus positions and at different viewpoints;

a second acquisition unit that acquires distance information corresponding to each of the plurality of image data on the basis of the image data at different viewpoints at each focus position;

a determination unit that determines reliability corresponding to a ranging point in each of the plurality of image data;

a selection unit that selects the distance information used as the distance information of each ranging point from the distance information acquired by the second acquisition unit on the basis of the reliability determined by the determination unit, and

wherein the determination unit determines the reliability at the ranging point according to the amount of image shift or the amount of defocus calculated at the ranging point in each of the plurality of image data.

16. The image measurement device according to claim 15 , wherein the selection unit selects the distance information corresponding to higher reliability among the plurality of image data.

17. An image measurement device comprising:

at least one processor and at least one memory functioning as:

a first acquisition unit that acquires a plurality of image data captured at a plurality of focus positions and at different viewpoints;

a second acquisition unit that acquires distance information corresponding to each of the plurality of image data on the basis of the image data at different viewpoints at each focus position;

a determination unit that determines reliability corresponding to a ranging point in each of the plurality of image data;

a selection unit that selects the distance information used as the distance information of each ranging point from the distance information acquired by the second acquisition unit on the basis of the reliability determined by the determination unit, and

wherein the second acquisition unit acquires the distance information of the subject calculated using a ratio of a focal length and a lateral magnification of an imaging optical system.

18. An image measurement device comprising:

at least one processor and at least one memory functioning as:

a first acquisition unit that acquires a plurality of image data captured at a plurality of focus positions and at different viewpoints;

a second acquisition unit that acquires distance information corresponding to each of the plurality of image data on the basis of the image data at different viewpoints at each focus position; and

a selection unit that selects the distance information used as the distance information of each ranging point from the distance information acquired by the second acquisition unit on the basis of an amount of image shift or an amount of defocus calculated at the ranging point in each of the plurality of image data, wherein the selection unit selects the distance information corresponding to higher reliability among the plurality of image data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2018
From: ISHIBASHI, TAKUYA
To: CANON KABUSHIKI KAISHA
Reel/Frame 047741/0955 →
Priority Claims (2)
JP JP2017-188390 · Sep 28, 2017 · national
JP JP2017-253584 · Dec 28, 2017 · national
Continuity (1)
Related Publication 20190096079A1 · Mar 28, 2019