IP Library Granted Patent US 9,652,915
Granted Patent B2
US 9,652,915 · App. 14/581,431 · Granted May 16, 2017

System and method having biometric identification intrusion and access control

Inventors: Steven J Howe (Massapequa, NY); Kwong Wing Au (Bloomington, MN); Sharath Venkatesha (Minnetonka, MN); Ryan Andrew Lloyd (Burnsville, MN); Kenneth L. Addy (Massapequa, NY)
Assignee: HONEYWELL INTERNATIONAL INC.
G07C9/00158G08B25/008G07C2209/02G07C2209/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,652,915
App. No.
14/581,431
Granted
May 16, 2017
Kind
B2
Abstract

An apparatus and method are provided that include biometric identification intrusion and access control. The apparatus features a monitoring system, a visual input device, and an audible input device. The visual and audible input devices are coupled to control circuits of the monitoring system, which can implement an authentication process responsive to both visual and audile inputs.

Claims (46)

1. An apparatus comprising:

a monitoring system that includes control circuits;

a visual input device coupled to the control circuits; and

an audible input device coupled to the control circuits,

wherein the control circuits (1) enroll a plurality of authorized subjects, (2) generate a template of facial features and voice elements for each of the plurality of authorized subjects, (3) assign a facial score to an image captured by the visual input device based on facial recognition, (4) assign a vocal score to audio captured by the audible input device based on voice pattern recognition, (5) compute a facial trustworthiness score and a vocal trustworthiness score based on the facial score and the vocal score, (6) normalize the facial score and the vocal score based on minimum and maximum scores, (7) select a fusion weight from a quality and trustfulness matrix and compute a fused score, (8) compare the fused score against the template, (9) disarm the monitoring system when a template match is detected, and (10) deny access when the template match is not detected.

2. The apparatus as in claim 1 wherein electrical signals from the visual input device are combined with the electrical signals from the audible input device to provide a multi-faceted authentication indicator.

3. The apparatus as in claim 2 wherein the control circuits determine actionable commands based on comparisons of the multi-faceted authentication indicator to a set of decision rules.

4. The apparatus as in claim 1 further comprising a manually operable input member to arm or disarm the monitoring system.

5. The apparatus as in claim 4 further comprising additional circuits coupled to the control circuits to evaluate audible or visual instructions to arm or disarm the monitoring system.

6. The apparatus as in claim 1 wherein the control circuits progressively update the template of the facial features and the voice elements for each of the plurality of authorized subjects to account for physical changes of the plurality of authorized subjects and background changes.

7. The apparatus as in claim 1 wherein the control circuits receive the image and a voice command from one of the plurality of authorized subjects.

8. The apparatus as in claim 7 wherein the control circuits recognize facial elements of the facial features and the voice elements of the voice command of the one of the plurality of authorized subjects.

9. The apparatus as in claim 8 wherein the control circuits characterize qualities of the facial elements of the facial features in the image and the voice elements of the voice command based on the facial score and the vocal score.

10. A process of authenticating a subject comprising:

enrolling the subject;

generating a template of facial features and voice elements for the subject;

initiating operation of a user authenticating process in response to one of recognizing a predetermined type of image or receiving an audio trigger;

obtaining a sequence of images of the subject from a face viewing region;

using the sequence of images to assign a facial score based on facial recognition;

obtaining an audible input from the subject;

processing the audible input to assign a vocal score based on voice pattern recognition;

computing a facial trustworthiness score and a vocal trustworthiness score based on the facial score and the vocal score;

normalizing the facial score and the vocal score based on minimum and maximum scores;

selecting a fusion weight from a quality and trustfulness matrix and computing a fused score;

comparing the fused score against the template;

disarming a monitoring system when a template match is detected; and

denying access when the template match is not detected.

11. The process as in claim 10 further comprising comparing the fused score to a predetermined set of rules.

12. The process as in claim 11 wherein, responsive to results of comparing the fused score to the predetermined set of rules, determining if the access should be provided, further credentials from the subject should be requested, or an alarm should be initiated.

13. The process as in claim 10 wherein disarming includes receiving a visual input or the audible input and generating a disarm command.

14. The process as in claim 13 further comprising receiving a manually operable input for generating the disarm command.

15. The process as in claim 10 further comprising characterizing qualities of facial elements of the facial features in the sequence of images and the voice elements in a voice command based on the facial score and the vocal score.

16. A method of using biometric identification for disarming an alarm system comprising:

providing a detector/sensor unit having a camera for capturing images and text-dependent voice recognition;

enrolling a plurality of authorized subjects;

generating a template of facial features and voice elements for each of the plurality of authorized subjects;

progressively enhancing the template to account for physical changes of the plurality of authorized subjects and background changes;

capturing a visual image of facial features and a voice command from an individual;

recognizing face and voice elements of the facial features and the voice command of the individual;

establishing face and voice scores and trustfulness for the face and voice elements of the facial features and the voice command;

normalizing the face and voice scores based on minimum and maximum scores;

characterizing qualities of the face and voice elements of the facial features and the voice command based on the face and voice scores;

selecting a fusion weight from a quality and trustfulness matrix and computing a fused score;

comparing the fused score against the template;

disarming the alarm system when a template match is detected; and

denying access when the template match is not detected.

Assignments (5)
CHANGE OF NAME Recorded Jun 12, 2025
From: ADEMCO INC.
To: RESIDEO LLC
Reel/Frame 071546/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PREVIOUS RECORDING BY NULLIFICATION. THE INCORRECTLY RECORDED PATENT NUMBERS 8545483, 8612538 AND 6402691 PREVIOUSLY RECORDED AT REEL: 047909 FRAME: 0425. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 12, 2019
From: HONEYWELL INTERNATIONAL INC.
To: ADEMCO INC.
Reel/Frame 050431/0053 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2018
From: HONEYWELL INTERNATIONAL INC.
To: ADEMCO INC.
Reel/Frame 047909/0425 →
SECURITY INTEREST Recorded Oct 26, 2018
From: ADEMCO INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047337/0577 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2015
From: HOWE, STEVEN J; AU, KWONG WING; VENKATESHA, SHARATH; LLOYD, RYAN ANDREW; ADDY, KENNETH L
To: HONEYWELL INTERNATIONAL INC.
Reel/Frame 034900/0300 →
Continuity (2)
Provisional Application 61946283 · Feb 28, 2014
Related Publication 20150248798A1 · Sep 3, 2015