IP Library Granted Patent US 12,118,824
Granted Patent B2
US 12,118,824 · App. 17/169,937 · Granted Oct 15, 2024

Face detection method and server

Inventors: Takashi Kamio (Tokyo, JP); Eisaku Miyata (Fukuoka, JP)
Assignee: I-PRO CO., LTD.
G06V40/173G06V20/40G06V40/161G06V40/166G06V40/172G07C9/257G08B13/19613G06V10/22G06V10/25G06V20/52G06V40/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,118,824
App. No.
17/169,937
Granted
Oct 15, 2024
Kind
B2
Abstract

A face detection method to be implemented by a camera and a server that are communicably connected to each other includes the steps of: acquiring a captured video captured by the camera; detecting a face of one or more persons based on the captured video; generating one or more face cut-out images by cutting out a region of the detected face; counting a number of detection times that a person who is the same as or similar to a person in the face cut-out image is detected in a predetermined detection period; determining a category of the person based on the number of detection times; and outputting the face cut-out image corresponding to the person, the number of detection times corresponding to the person, and the category corresponding to the person in association with each other.

Claims (73)

1. A face detection method to be implemented by a camera and a server that are communicably connected to each other, the face detection method comprising:

acquiring a captured video captured by the camera;

detecting a face of one or more persons based on the captured video;

generating one or more face cut-out images by cutting out a region of the detected face;

determining whether the detected face corresponds to a first detection condition or a second detection condition based on at least one detection item, the detection item not including a detection period or a number of times of detection;

determining, in response to the detected face corresponding to the first detection condition, whether a person who is same as or similar to a person in the face cut-out image is stored in a first database, and: counting a first number of detection times that the person who is the same as or similar to the person in the face cut-out image and stored in the first database is detected in a predetermined detection period; and storing the detected face in the first database in association with the first number of detection times, with each of detected faces being stored in the first database in association with a corresponding one of first numbers of detection times in response to the detected faces corresponding to the first detection condition;

determining, in response to the detected face corresponding to the second detection condition, whether the person who is the same as or similar to the person in the face cut-out image is stored in a second database, and: counting a second number of detection times that the person who is the same as or similar to the person in the face cut-out image and stored in the second database is detected in the predetermined detection period; and storing the detected face in the second database in association with the second number of detection times, with each of detected faces being stored in the second database in association with a corresponding one of second numbers of detection times in response to the detected faces corresponding to the second detection condition;

determining a category of the person based on one of the first number of detection times or the second number of detection times; and

outputting the face cut-out image corresponding to the person, the one of the first number of detection times or the second number of detection times corresponding to the person, and the category corresponding to the person in association,

wherein the face detection method further comprises:

registering persons in the first database based on face cut-out images from captured images, the persons registered in the first database being suspicious persons; and

registering persons in the second database based on printed images of the persons, the persons registered in the second database being registered customers.

2. The face detection method according to claim 1 , further comprising:

acquiring the first detection condition; and

counting the first number of detection times of the person in the face cut-out image when the person in the face cut-out image is a detection target satisfying the first detection condition; and

determining the category of the person to be a suspicious person when the first number of detection times is a predetermined number of times or more.

3. The face detection method according to claim 2 , wherein

the first detection condition is for detecting a person having the category of a suspicious person.

4. The face detection method according to claim 2 , further comprising:

registering the face cut-out image of the person having the category of the suspicious person as a blacklist face image on each of a plurality of blacklist face images registered in advance by a user.

5. The face detection method according to claim 4 , wherein

each of the plurality of blacklist face images is matched with the face cut-out image to determine whether the blacklist face image that is same as or similar to the person in the face cut-out image is registered in the first database, and

when the face cut-out image that is the same as or similar to the blacklist face image is registered in the first database, an alert notification screen is generated and output.

6. The face detection method according to claim 1 , further comprising:

acquiring the first detection condition;

counting the first number of detection times of the person in the face cut-out image when the person in the face cut-out image is not a detection target satisfying the first detection condition; and

determining the category of the person to be a loyal customer when the first number of detection times is a predetermined number of times or more.

7. The face detection method according to claim 6 , further comprising:

registering the face cut-out image of the person having the category of the loyal customer as an important person face image on each of a plurality of important person face images registered in advance by a user.

8. The face detection method according to claim 7 , wherein

each of the plurality of important person face images is matched with the face cut-out image to determine whether the important person face image that is same as or similar to the face cut-out image is registered in the second database, and

when the face cut-out image that is the same as or similar to the important person face image is registered in the second database, an alert notification screen is generated and output.

9. The face detection method according to claim 1 , further comprising:

acquiring the second detection condition;

counting the second number of detection times of the person in the face cut-out image when the person in the face cut-out image is a detection target satisfying the second detection condition; and

determining the category of the person to be a loyal customer when the second number of detection times is a predetermined number of times or more.

10. The face detection method according to claim 9 , wherein

the second detection condition is for detecting a person having the category of a loyal customer.

11. The face detection method according to claim 9 , further comprising:

registering the face cut-out image of the person having the category of the loyal customer as an important person face image on each of a plurality of important person face images registered in advance by a user.

12. The face detection method according to claim 11 , wherein

each of the plurality of important person face images is matched with the face cut-out image to determine whether the important person face image that is the same as or similar to the face cut-out image is registered in the second database, and

when the face cut-out image that is the same as or similar to the important person face image is registered in the second database, an alert notification screen is generated and output.

13. The face detection method according to claim 1 , wherein

each of a plurality of non-detected face images registered in advance by a user is matched with the face cut-out image to determine whether a non-detected face image that is same as or similar to the face cut-out image is registered, and

when the face cut-out image that is the same as or similar to the non-detected face image is registered, generation of an alert notification screen is omitted.

14. The face detection method according to claim 1 , wherein

when the person in the face cut-out image is re-detected within the detection period, a detection period of the person in the face cut-out image is extended by the detection period from a timing of the re-detection.

15. A computer readable non-transitory storage medium on which a face detection program executed by a server communicably connected to a camera is stored, the face detection program causing the server to execute a process including:

acquiring a captured video captured by the camera;

detecting a face of one or more persons based on the captured video;

generating one or more face cut-out images by cutting out a region of the detected face;

determining whether the detected face corresponds to a first detection condition or a second detection condition based on at least one detection item, the detection item not including a detection period or a number of times of detection;

determining, in response to the detected face corresponding to the first detection condition, whether a person who is same as or similar to a person in the face cut-out image is stored in a first database, and; counting a first number of detection times that the person who is the same as or similar to the person in the face cut-out image and stored in the first database is detected in a predetermined detection period; and storing the detected face in the first database in association with the first number of detection times, with each of detected faces being stored in the first database in association with a corresponding one of first numbers of detection times in response to the detected faces corresponding to the first detection condition;

determining, in response to the detected face corresponding to the second detection condition, whether the person who is the same as or similar to the person in the face cut-out image is stored in a second database, and: counting a second number of detection times that the person who is the same as or similar to the person in the face cut-out image and stored in the second database is detected in the predetermined detection period; and storing the detected face in the second database in association with the second number of detection times, with each of detected faces being stored in the second database in association with a corresponding one of second numbers of detection times in response to the detected faces corresponding to the second detection condition;

determining a category of the person based on one of the first number of detection times or the second number of detection times; and

outputting the face cut-out image corresponding to the person, the one of the number of first detection times or the second number of detection times corresponding to the person, and the category corresponding to the person in association,

wherein the process further includes:

registering persons in the first database based on face cut-out images from captured images, the persons registered in the first database being suspicious persons; and

registering persons in the second database based on printed images of the persons, the persons registered in the second database being registered customers.

16. A server communicably connected to a camera, the server comprising:

an interface that acquires a captured video captured by the camera;

a processor that

detects a face of one or more persons based on the captured video acquired by the interface,

generates one or more face cut-out images by cutting out a region of the detected face,

determines whether the detected face corresponds to a first detection condition or a second detection condition based on at least one detection item, the detection item not including a detection period or a number of times of detection,

determines, in response to the detected face corresponding to the first detection condition, whether a person who is same as or similar to a person in the face cut-out image is stored in a first database, and; counts a first number of detection times that the person who is the same as or similar to the person in the face cut-out image and stored in the first database is detected in a predetermined detection period; and stores the detected face in the first database in association with the first number of detection times, with each of detected faces being stored in the first database in association with a corresponding one of first numbers of detection times in response to the detected faces corresponding to the first detection condition,

determines, in response to the detected face corresponding to the second detection condition, whether the person who is the same as or similar to the person in the face cut-out image is stored in a second database, and; counts a second number of detection times that the person who is the same as or similar to the person in the face cut-out image and stored in the second database is detected in the predetermined detection period; and stores the detected face in the second database in association with the second number of detection times, with each of detected faces being stored in the second database in association with a corresponding one of second numbers of detection times in response to the detected faces corresponding to the second detection condition, and

determines a category of the person based on one of the first number of detection times or the second number of detection times; and

an output that outputs the face cut-out image corresponding to the person, the one of the first number of detection times or the second number of detection times corresponding to the person, and the category corresponding to the person in association,

wherein the processor further:

registers persons in the first database based on face cut-out images from captured images, the persons registered in the first database being suspicious persons; and

registers persons in the second database based on printed images of the persons, the persons registered in the second database being registered customers.

Assignments (3)
ADDRESS CHANGE Recorded Nov 1, 2022
From: I-PRO CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 061828/0350 →
CHANGE OF NAME Recorded Oct 31, 2022
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 061824/0261 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2021
From: KAMIO, TAKASHI; MIYATA, EISAKU
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 055181/0846 →
Cited By (1)
US 12,444,260