IP Library Granted Patent US 10,592,731
Granted Patent B2
US 10,592,731 · App. 15/578,920 · Granted Mar 17, 2020

Facial recognition system, facial recognition server, and facial recognition method

Inventors: Masashige Tsuneno (Fukuoka, JP); Kaoru Tsurumi (Fukuoka, JP); Norio Saitou (Kanagawa, JP)
Assignee: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
G06K9/00288G06K9/00281G06K9/00778H04N7/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,592,731
App. No.
15/578,920
Granted
Mar 17, 2020
Kind
B2
Abstract

A statistical processing is performed without performing complicated determination, so as not to repetitively include the same person. A facial feature extractor ( 32 ) in a facial recognition server ( 30 ) extracts features of facial image data including a face which is shown in an image obtained by a camera device ( 10 ) imaging an imaging area. A preservation unit ( 35 ) preserves features of facial image data including a face which has passed through the imaging area, in a pre-passing comparative original facial feature data memory ( 41 ). A statistics unit ( 37 ) performs statistical processing on the features of the facial image data, which are extracted by the facial feature extractor ( 32 ), in a case where feature having high similarity which is obtained by comparison with the features (extracted by the facial feature extractor ( 32 )) of the facial image data imaged by the camera device ( 10 ) and is equal to or greater than a predetermined value are not preserved in the pre-passing comparative original facial feature data memory ( 41 ) until a predetermined time from an imaging time point by the camera device ( 10 ).

Claims (28)

1. A facial recognition system comprising:

a camera device which in operation produces video image data by imaging an imaging area; and

a facial recognition server, which is connected to the camera device,

the facial recognition server comprising:

a feature extractor, which in operation, extracts features of facial image data including a face of a person shown in the video image data,

a preservation unit, which in operation, preserves the features of the facial image data extracted by the feature extractor in a facial feature memory, and

a statistical processing unit, which in operation:

performs statistical processing by using the features of the facial image data extracted by the feature extractor, in a case where: the features of facial image data extracted by the feature extractor have a similarity that is equal to or greater than a predetermined value to features of facial image data that are present in the facial feature memory, and a predetermined time has elapsed from an imaging time point by the camera device of the video image data that includes the facial image data,

wherein the facial recognition server discards the features of the facial image data extracted by the feature extractor, in a case where: the features of facial image data extracted by the feature extractor have a similarity that is equal to or greater than a predetermined value to features of facial image data that are present in the facial feature memory, the predetermined time has not elapsed from an imaging time point by the camera device of the video image data that includes the facial image data, and without satisfying one of preservation conditions: the facial image data is from the first captured facial image of the person, and an orientation of a face included in the facial image data is largely shown front face.

2. The facial recognition system of claim 1 ,

wherein the facial recognition server, in operation, preserves the features of the facial image data extracted by the feature extractor, in the facial feature memory, in a case where the facial image data corresponding to the video image data satisfies a predetermined preservation condition.

3. The facial recognition system of claim 1 ,

wherein the facial recognition server, in operation, performs the statistical processing by using the features of the facial image data extracted by the feature extractor, in a case where the features of the facial image data extracted by the feature extractor similarity are not similar to features of facial image data preserved in the facial feature memory.

4. The facial recognition system of claim 1 ,

wherein the predetermined time is randomly set in accordance with an environment around the imaging area.

5. The facial recognition system of claim 1 ,

wherein the facial recognition server, in operation, searches for the features of the facial image data that are subjected to the statistical processing by the statistical processing unit, in accordance with a searching request from a terminal device, and transmits a searching result which corresponds to the searching request, to the terminal device.

6. A facial recognition server which is connected to a camera device, the server comprising:

a feature extractor, which in operation, extracts features of facial image data including a face of a person shown in video image data, based on the video image data from the camera device;

a preservation unit, which in operation, preserves the features of the facial image data extracted by the feature extractor, in a facial feature memory; and

a statistical processing unit, which in operation:

performs statistical processing by using the features of the facial image data extracted by the feature extractor, in a case where: the features of facial image data extracted by the feature extractor have a similarity that is equal to or greater than a predetermined value to features of facial image data that are present in the facial feature memory, and a predetermined time has elapsed from an imaging time point by the camera device of the video image data that includes the facial image data,

wherein the facial recognition server discards the features of the facial image data extracted by the feature extractor, in a case where: the features of facial image data extracted by the feature extractor have a similarity that is equal to or greater than a predetermined value to features of facial image data that are present in the facial feature memory, the predetermined time has not elapsed from an imaging time point by the camera device of the video image data that includes the facial image data, and without satisfying one of preservation conditions: the facial image data is from the first captured facial image of the person, and an orientation of a face included in the facial image data is largely shown front face.

7. A facial recognition method in a facial recognition system in which a camera device and a facial recognition server are connected to each other, the method comprising executing at least in part using a processor, at least the following processing:

processing of extracting features of facial image data including the face of a person shown in video image data, based on the video image data obtained by the camera device imaging an imaging area;

preserving the extracted features of the facial image data in a facial feature memory;

performing statistical processing by using the extracted features of the facial image data in a case where: the extracted features of facial image data have a similarity that is equal to or greater than a predetermined value to features of stored facial image data that are present in the facial feature memory, and a predetermined time has elapsed from an imaging time point of the video image data that includes the facial image data; and

discarding the extracted features of the facial image data in a case where: the extracted features of facial image data have a similarity that is equal to or greater than a predetermined value to stored features of facial image data that are present in the facial feature memory, the predetermined time has not elapsed from an imaging time point of the video image data that includes the facial image data, and without satisfying one of preservation conditions: the facial image data is from the first captured facial image of the person, and an orientation of a face included in the facial image data is largely shown front face.

Assignments (7)
CHANGE OF NAME Recorded Mar 16, 2023
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 063101/0966 →
CHANGE OF ADDRESS Recorded Mar 16, 2023
From: I-PRO CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 063102/0075 →
CHANGE OF ADDRESS Recorded Dec 31, 2020
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 054883/0248 →
CHANGE OF NAME Recorded Dec 31, 2020
From: PSP HOLDINGS CO., LTD
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 054883/0234 →
MERGER Recorded Dec 31, 2020
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: PSP HOLDINGS CO., LTD
Reel/Frame 054883/0201 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2019
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 051357/0432 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2018
From: TSUNENO, MASASHIGE; TSURUMI, KAORU; SAITOU, NORIO
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 044861/0156 →
Priority Claims (1)
JP 2015-120455 · Jun 15, 2015 · national
Continuity (1)
Related Publication 20180157898A1 · Jun 7, 2018