IP Library › Granted Patent US 11,308,580
Granted Patent B2
US 11,308,580 · App. 16/893,231 · Granted Apr 19, 2022

Image processing apparatus, image processing method, and recording medium

Inventor: Tohru Ishibashi (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
G06T3/4038G06T5/007G06T5/20G06T5/50G06T2207/20224
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,308,580
App. No.
16/893,231
Granted
Apr 19, 2022
Kind
B2
Abstract

An image processing apparatus includes an acquisition unit configured to acquire a plurality of continuous images, an extraction unit configured to extract a difference between two images among the plurality of continuous images, a first image processing unit configured to acquire a third image by removing a difference between portions smaller than a predetermined size from the difference extracted by the extraction unit, and a first combining unit configured to combine the two images by using the third image acquired by the first image processing unit. The image processing apparatus may implement the aforementioned units using a processor(s) that execute(s) a program of instructions stored in memory.

Claims (47)

1. An image processing apparatus comprising:

at least one memory that stores a program of instructions; and

at least one processor that executes the program of instructions to cause the image processing apparatus to implement:

an acquisition unit configured to acquire a plurality of continuous images;

an extraction unit configured to extract a difference between two images among the plurality of continuous images;

a first image processing unit configured to acquire a third image by removing a difference between portions smaller than a predetermined size from the difference extracted by the extraction unit, and the predetermined size is determined based on imaging information obtained when the plurality of continuous images is acquired, wherein the imaging information includes information on a focal length of an imaging lens or a pixel pitch of an imaging element, the acquired images being display on a display unit; and

a first combining unit configured to combine the two images by using the third image acquired by the first image processing unit.

2. The image processing apparatus according to claim 1 ,

wherein the at least one processor executes the program of instructions to cause the image processing apparatus to implement a second combining unit configured to select and combine brighter portions of a plurality of images, and

wherein the second combining unit combines an image combined by the first combining unit with one of the plurality of continuous images or an image already combined by the second combining unit.

3. The image processing apparatus according to claim 2 ,

wherein the at least one processor executes the program of instructions to cause the image processing apparatus to implement a determination unit configured to determine whether the first combining unit combines the two images based on an extraction result of the extraction unit, and

wherein, in a case where the determination unit determines that the first combining unit combines the two images, the first combining unit combines the two images by using the third image acquired by the first image processing unit.

4. The image processing apparatus according to claim 3 ,

wherein the extraction unit extracts the difference by comparing integration results obtained by integrating brightness for each region in the two images, and

wherein the determination unit determines that the first combining unit combines the two images in a case where there is a region where the difference between the integration results is equal to or greater than a predetermined value.

5. The image processing apparatus according to claim 1 , wherein the first image processing unit performs a minimum-value filtering process and a maximum-value filtering process to acquire an image obtained by removing a difference between portions smaller than the predetermined size.

6. The image processing apparatus according to claim 1 , wherein the two images are temporally continuous images.

7. The image processing apparatus according to claim 1 ,

wherein the at least one processor executes the program of instructions to cause the image processing apparatus to implement a second image processing unit configured to perform gamma correction on the third image acquired by the first image processing unit, and

wherein the first combining unit combines the two images by using the image subjected to the gamma correction.

8. An image processing method comprising:

acquiring a plurality of continuous images;

extracting a difference between two images among the plurality of continuous images;

performing image processing to acquire a third image by removing a difference between portions smaller than a predetermined size from the difference extracted in the extracting, and the predetermined size is determined based on imaging information obtained when the plurality of continuous images is acquired, wherein the imaging information includes information on a focal length of an imaging lens or a pixel pitch of an imaging element, the acquired images being display on a display unit; and

first combining the two images by using the third image acquired in the image processing.

9. The image processing method according to claim 8 , further comprising second combining,

wherein the second combining includes:

selecting and combining brighter portions of a plurality of images, and

combining combines an image combined by the first combining with one of the plurality of continuous images or an image already combined by the second combining.

10. The image processing method according to claim 8 , further comprising performing a minimum-value filtering process and a maximum-value filtering process to acquire an image obtained by removing a difference between portions smaller than the predetermined size.

11. The image processing method according to claim 8 , wherein the two images are temporally continuous images.

12. The image processing method according to claim 8 , further comprising performing gamma correction on the acquired third image,

wherein the first combining combines the two images by using the image subjected to the gamma correction.

13. A non-transitory computer-readable storage medium storing a program for causing a computer to execute an image processing method, the method comprising:

acquiring a plurality of continuous images;

extracting a difference between two images among the plurality of continuous images;

performing image processing to acquire a third image by removing a difference between portions smaller than a predetermined size from the difference extracted in the extracting, and the predetermined size is determined based on imaging information obtained when the plurality of continuous images is acquired, wherein the imaging information includes information on a focal length of an imaging lens or a pixel pitch of an imaging element, the acquired images being display on a display unit; and

first combining the two images by using the third image acquired in the image processing.

14. The non-transitory computer-readable storage medium according to claim 13 , further comprising second combining,

wherein the second combining includes:

selecting and combining brighter portions of a plurality of images, and

combining combines an image combined by the first combining with one of the plurality of continuous images or an image already combined by the second combining.

15. The non-transitory computer-readable storage medium according to claim 13 , further comprising performing a minimum-value filtering process and a maximum-value filtering process to acquire an image obtained by removing a difference between portions smaller than the predetermined size.

16. The non-transitory computer-readable storage medium according to claim 13 , wherein the two images are temporally continuous images.

17. The non-transitory computer-readable storage medium according to claim 13 , further comprising performing gamma correction on the acquired third image,

wherein the first combining combines the two images by using the image subjected to the gamma correction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2020
From: ISHIBASHI, TOHRU
To: CANON KABUSHIKI KAISHA
Reel/Frame 053691/0561 →
Priority Claims (1)
JP JP2019-106979 · Jun 7, 2019 · national
Continuity (1)
Related Publication 20200388006A1 · Dec 10, 2020
Cited By (1)
US 12,493,930