IP Library › Granted Patent US 11,521,330
Granted Patent B2
US 11,521,330 · App. 17/099,491 · Granted Dec 6, 2022

Image processing apparatus, image processing method, and storage medium

Inventor: Ryo Maeda (Kanagawa, JP)
Assignee: Canon Kabushiki Kaisha
G06T7/55G06K9/6256G06T7/60G06T7/73G06T2207/30232G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,521,330
App. No.
17/099,491
Granted
Dec 6, 2022
Kind
B2
Abstract

An image processing apparatus includes a detection unit that executes detection processing for detecting a particular object in an image, a holding unit that holds object information indicating a position and a size of the particular object on the image, a determination unit that determines whether a number of times a particular object is detected in the detection processing on one or more images reaches a predetermined value, a first setting unit that, when the number of times a particular object is detected in the detection processing on the one or more images is determined to reach the value, sets estimation areas on an image based on the object information obtained by the detection processing on the one or more images, and an estimation unit that executes estimation processing for estimating a number of the particular objects in the estimation areas.

Claims (46)

1. An image processing apparatus comprising:

a processor; and

a memory storing executable instructions which, when executed by the processor, cause the image processing apparatus to perform operations including:

executing detection processing for detecting a particular object in one or more images captured by an imaging unit;

storing object information indicating a position and a size, on the one or more images, of the particular object detected in the detection processing;

determining whether a number of times the particular object is detected in the detection processing on the one or more images reaches a predetermined value;

setting, in a case that the number of times the particular object is detected in the detection processing on the one or more images reaches the predetermined value, a plurality of estimation areas on an image captured by the imaging unit, based on the stored object information obtained by the detection processing on the one or more images; and

executing estimation processing for estimating a number of particular objects in the plurality of estimation areas.

2. The image processing apparatus according to claim 1 ,

wherein every time the particular object is detected in the one or more images, the object information regarding the particular object is stored, and

wherein in a case that the number of times the particular object is detected in the detection processing on the one or more images reaches the predetermined value, the plurality of estimation areas is set based on the stored object information.

3. The image processing apparatus according to claim 1 , wherein executing the executable instructions causes the information processing apparatus to perform further operations including: setting a plurality of divided areas into which an image captured by the imaging unit is divided.

4. The image processing apparatus according to claim 3 ,

wherein it is determined whether the number of times the particular object reaches the predetermined value in each of the plurality of divided areas, and

wherein in a case that the number of times the particular object is detected over the one or more images in the detection processing reaches the predetermined value in each of the plurality of divided areas, the plurality of estimation areas are set based on the stored object information obtained by the detection processing on the one or more images.

5. The image processing apparatus according to claim 3 ,

wherein it is determined whether the number of times the particular object is detected over the one or more images in the detection processing reaches the predetermined value in each of a predetermined number of divided areas among the plurality of divided areas, and

wherein in a case that the number of times the particular object is detected over the one or more images in the detection processing reaches the predetermined value in each of the predetermined number of divided areas among the plurality of divided areas, the plurality of estimation areas are set based on the stored object information obtained by the detection processing on the one or more images.

6. The image processing apparatus according to claim 4 , wherein the detection processing is not executed on a divided area where the number of times the particular object is detected reaches the predetermined value, among the plurality of divided areas.

7. The image processing apparatus according to claim 1 , wherein the number of the particular object is estimated included in the estimation areas, using a trained model regarding the particular object.

8. The image processing apparatus according to claim 1 , wherein the particular object is a person.

9. An image processing method comprising:

executing detection processing for detecting a particular object in one or more images captured by an imaging unit;

storing object information indicating a position and a size, on the one or more images, of the particular object detected in the detection processing;

determining whether a number of times the particular object is detected in the detection processing on the one or more images reaches a predetermined value;

setting, in a case that the number of times the particular object is detected in the detection processing on the one or more images reaches the predetermined value, a plurality of estimation areas on an image captured by the imaging unit, based on the stored object information obtained by the detection processing on the one or more images; and

executing estimation processing for estimating a number of particular objects in the plurality of estimation areas.

10. The image processing method according to claim 9 ,

wherein every time the particular object is detected in the one or more images, the object information regarding the particular object is stored, and

wherein in a case that the number of times the particular object is detected in the detection processing on the one or more images reaches the predetermined value, the plurality of estimation areas is set based on the stored object information.

11. The image processing method according to claim 9 , further comprising setting a plurality of divided areas into which an image captured by the imaging unit is divided.

12. The image processing method according to claim 11 ,

wherein it is determined whether the number of times the particular object reaches the predetermined value in each of the plurality of divided areas, and

wherein in a case that the number of times the particular object is detected over the one or more images in the detection processing reaches the predetermined value in each of the plurality of divided areas, the plurality of estimation areas are set based on the stored object information obtained by the detection processing on the one or more images.

13. The image processing method according to claim 11 ,

wherein it is determined whether the number of times the particular object is detected over the one or more images in the detection processing reaches the predetermined value in each of a predetermined number of divided areas among the plurality of divided areas, and

wherein in a case that the number of times the particular object is detected over the one or more images in the detection processing reaches the predetermined value in each of the predetermined number of divided areas among the plurality of divided areas, the plurality of estimation areas are set based on the stored object information obtained by the detection processing on the one or more images.

14. The image processing method according to claim 12 , wherein the detection processing is not executed on a divided area where the number of times the particular object is detected reaches the predetermined value, among the plurality of divided areas.

15. The image processing method according to claim 9 , wherein the number of the particular object is estimated included in the estimation areas is estimated using a trained model regarding the particular object.

16. The image processing method according to claim 9 , wherein the particular object is a person.

17. A non-transitory computer readable medium storing a computer-executable program for causing a computer to perform an image processing method, the method comprising:

executing detection processing for detecting a particular object in one or more images captured by an imaging unit;

storing object information indicating a position and a size, on the one or more images, of the particular object detected in the detection processing;

determining whether a number of times the particular object is detected in the detection processing on the one or more images reaches a predetermined value;

in a case that the number of times the particular object is detected in the detection processing on the one or more images reaches the predetermined value, set a plurality of estimation areas on an image captured by the imaging unit, based on the stored object information obtained by the detection processing on the one or more images; and

executing estimation processing for estimating a number of particular objects in the plurality of estimation areas.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2021
From: MAEDA, RYO
To: CANON KABUSHIKI KAISHA
Reel/Frame 057127/0158 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2021
From: MAEDA, RYO
To: CANON KABUSHIKI KAISHA
Reel/Frame 056754/0824 →
Priority Claims (1)
JP JP2019-214784 · Nov 27, 2019 · national
Continuity (1)
Related Publication 20210158555A1 · May 27, 2021
Cited By (2)
US 12,488,560 US 12,511,774