IP Library Granted Patent US 11,776,308
Granted Patent B2
US 11,776,308 · App. 16/753,571 · Granted Oct 3, 2023

Frictionless access control system embodying satellite cameras for facial recognition

Inventors: Peter Alexander Ainsworth (Oxfordshire, GB); Ian C. Westmacott (Tewksbury, MA); Martin J. Donaghy (Antrim, GB); John McKenna (Maghera, GB); Derek Boyes (Armagh, GB); Terry Neill (Antrim, GB); Frederick Michael McBride (Antrim, GB); Walter A. Martin (Ballymena, GB)
Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
G06V40/161G06F18/22G06V10/993G06V40/171G06V40/172G07C9/00182G07C9/00563G06V40/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,776,308
App. No.
16/753,571
Granted
Oct 3, 2023
Kind
B2
Abstract

A frictionless access control system and method embodying satellite cameras for facial recognition are disclosed. The cameras capture image data of individuals at an access point such as a door. Preferably, two or more cameras are placed on opposite sides of the access point to increase the likelihood that the individuals are captured in the image data. A facial cropper module extracts facial patches from the image data, and a facial signature module computes facial signatures from the facial patches. A facial recognition module receives the computed facial signatures from the facial signature module, matches the computed facial signatures to stored facial signatures, and sends user identity information of individuals corresponding to the stored facial signatures to the facial signature module when the computed facial signatures match the stored facial signatures.

Claims (49)

1. An access control system, comprising:

one or more surveillance cameras at an access point that capture image data;

a first device comprising:

a first memory storing instructions thereon; and

at least one first processor coupled with the first memory and configured by the first instructions to:

extract facial patches from the image data;

rank the facial patches above a predefined threshold by comparing a plurality of machine learning trained image quality factors to a plurality of detected features of a candidate facial patch of the facial patches to determine acceptable facial patches for individuals; and

compute facial signatures from the acceptable facial patches; and

a second device comprising:

a second memory storing second instructions thereon; and

at least one second processor coupled with the second memory and configured by the second instructions to:

receive the facial signatures from the first device;

match the facial signatures to stored facial signatures; and

send user identity information of individuals corresponding to the stored facial signatures to the first device when the facial signatures match the stored facial signatures.

2. The access control system of claim 1 , wherein the at least one first processor is further configured by the first instructions to determine a highest ranked acceptable facial patch for each of the individuals, and compute a facial signature for each of the individuals from the highest ranked acceptable facial patch for each of the individuals.

3. The access control system of claim 1 , wherein the at least one first processor is further configured by the first instructions to compare each of the facial patches against one another to determine whether the facial patches are associated with same individuals or different individuals.

4. The access control system of claim 1 , wherein the one or more surveillance cameras include the first device.

5. The access control system of claim 1 , wherein the first device is located at the access point.

6. The access control system of claim 1 , wherein the second device is located at the access point.

7. The access control system of claim 6 , wherein the second device comprises a cache of the stored facial signatures, and the at least one second processor is further configured by the second instructions to match the facial signatures to respective ones of the cache of the stored facial signatures.

8. The access control system of claim 1 , wherein the second device is remote to the access point.

9. The access control system of claim 1 , wherein the second device includes a facial recognition database that includes the stored facial signatures and the user identity information of individuals corresponding to the stored facial signatures.

10. The access control system of claim 1 , wherein the at least one second processor is further configured by the second instructions to determine whether the individuals are authorized based on the user identity information.

11. The access control system of claim 10 , further comprising:

a door lock system at the access point, wherein the at least one first processor is further configured by the first instructions to send a signal to unlock the door lock system when the second device determines that the individuals are authorized users.

12. A method for controlling access to an access control system, comprising:

capturing image data by one or more surveillance cameras at an access point;

extracting facial patches from the image data;

ranking the facial patches above a predefined threshold by comparing a plurality of machine learning trained image quality factors to a plurality of detected features of a candidate facial patch of the facial patches to determine acceptable facial patches for individuals;

computing facial signatures from the acceptable facial patches;

matching the facial signatures to stored facial signatures; and

using user identity information of individuals corresponding to the stored facial signatures when the facial signatures match the stored facial signatures.

13. The method of claim 12 , further comprising determining a highest ranked acceptable facial patch for each of the individuals, and computing a facial signature for each of the individuals from the highest ranked acceptable facial patch for each of the individuals.

14. The method of claim 12 , further comprising comparing each of the facial patches against one another to determine whether the facial patches are associated with same individuals or different individuals.

15. The method of claim 12 , wherein extracting the facial patches from the image data comprises extracting, by the one or more surveillance cameras, the facial patches from the image data, and wherein computing facial signatures from the acceptable facial patches comprises computing, by the one or more surveillance cameras, the facial signatures from the acceptable facial patches.

16. The method of claim 12 , wherein extracting the facial patches from the image data comprises extracting, by a device at the access point, the facial patches from the image data, and wherein matching the facial signatures to the stored facial signatures comprises matching by the device at the access point, the facial signatures to the stored facial signatures.

17. The method of claim 12 , wherein matching the facial signatures to the stored facial signatures comprises matching, by a device at the access point, the facial signatures to the stored facial signatures.

18. The method of claim 12 , wherein matching the facial signatures to the stored facial signatures comprises matching, by a device remote to the access point, the facial signatures to the stored facial signatures.

19. The method of claim 12 , wherein a connected services system includes a facial recognition database that includes the stored facial signatures and user identity information of individuals corresponding to the stored facial signatures.

20. The method of claim 19 , further comprising:

determining whether the individuals are authorized based on the user identity information;

and transmitting, to a door lock system, a signal to unlock the door lock system when a facial recognition module determines that the individuals are authorized users.

21. A non-transitory computer-readable medium having instructions thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising:

capturing image data by one or more surveillance cameras at an access point;

extracting facial patches from the image data;

ranking the facial patches above a predefined threshold by comparing a plurality of machine learning trained image quality factors to a plurality of detected features of a candidate facial patch of the facial patches to determine acceptable facial patches for individuals;

computing facial signatures from the acceptable facial patches;

matching the facial signatures to stored facial signatures; and

using user identity information of individuals corresponding to the stored facial signatures when the facial signatures match the stored facial signatures.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2024
From: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
To: TYCO FIRE & SECURITY GMBH
Reel/Frame 068494/0384 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: JOHNSON CONTROLS US HOLDINGS LLC
To: JOHNSON CONTROLS, INC.
Reel/Frame 058955/0394 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: JOHNSON CONTROLS, INC.
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 058955/0472 →
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: SENSORMATIC ELECTRONICS, LLC
To: JOHNSON CONTROLS US HOLDINGS LLC
Reel/Frame 058957/0138 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: SENSORMATIC ELECTRONICS LLC
To: JOHNSON CONTROLS US HOLDINGS LLC
Reel/Frame 058600/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: JOHNSON CONTROLS US HOLDINGS LLC
To: JOHNSON CONTROLS INC
Reel/Frame 058600/0080 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: JOHNSON CONTROLS INC
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 058600/0126 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2021
From: WESTMACOTT, IAN C.; MCBRIDE, FREDERICK MICHAEL; MARTIN, WALTER A.
To: SENSORMATIC ELECTRONICS, LLC
Reel/Frame 056132/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2021
From: AINSWORTH, PETER ALEXANDER; DONAGHY, MARTIN J.; MCKENNA, JOHN; BOYES, DEREK; NEILL, TERRY
To: SENSORMATIC ELECTRONICS, LLC
Reel/Frame 055483/0350 →