IP Library Granted Patent US 10,068,445
Granted Patent B2
US 10,068,445 · App. 14/748,589 · Granted Sep 4, 2018

Systems and methods of home-specific sound event detection

Inventors: Rajeev Conrad Nongpiur (Palo Alto, CA); Michael Dixon (Sunnyvale, CA)
Assignee: Google LLC
G08B13/1672G08B25/008G08B13/08G08B29/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,068,445
App. No.
14/748,589
Filed
Jun 24, 2015
Granted
Sep 4, 2018
Kind
B2
Art Unit
2687
USPC
340/541
Abstract

Systems and methods of a security system are provided, including detecting, by a sensor, a sound event, and selecting, by a processor coupled to the sensor, at least a portion of sound data captured by the sensor that corresponds to at least one sound feature of the detected sound event. The systems and methods include classifying the at least one sound feature into one or more sound categories, and determining, by a processor, based upon a database of home-specific sound data, whether the at least one sound feature is a human-generated sound. A notification can be transmitted to a computing device according to the sound event.

Claims (48)

1. A method comprising:

detecting, by a sensor of a home security system, a sound event;

selecting, by a processor of the home security system that is coupled to the sensor, at least a portion of sound data captured by the sensor that corresponds to at least one sound feature of the detected sound event;

classifying, by the processor, the at least one sound feature into one or more sound categories;

determining, by the processor, based upon a database that includes home-specific sound data of the home security system including information regarding at least one of a room size, reverberation, and a distance between the sensor a source of the sound data captured by the sensor, and including a history of learned sounds and sound event data from one or more other home security systems, whether the at least one sound feature correlates to an unauthorized entry, and a degree of confidence that the classified at least one sound feature correlates to the unauthorized entry; and

transmitting, by a communications interface coupled to the processor, a notification to a computing device based on the determined degree of confidence that the classified at least one sound feature correlates to the unauthorized entry.

2. The method of claim 1 , wherein the classifying is performed by a first classifier of the processor.

3. The method of claim 2 , wherein the determining comprises:

determining whether the at least one sound feature is a human-generated sound; and

determining, with a second classifier of the processor, a degree of confidence that the sound data is from a sound event that is human-generated.

4. The method of claim 3 , further comprising:

determining, with the second classifier, a degree of confidence that the sound data is from a sound event that is pet-generated.

5. The method of claim 3 , wherein the second classifier is unique to a particular home.

6. The method of claim 1 , wherein the classifying the sound data comprises:

assigning, by the processor, the at least one sound feature to the one or more sound categories based on probability estimates of the at least one sound feature.

7. The method of claim 1 , wherein the at least one sound feature includes human-generated sounds having phonemes.

8. The method of claim 1 , wherein the classifying is according to at least one from the group consisting of: cepstrum of the sound data, and a spectrogram of the sound data.

9. The method of claim 1 , wherein the classifying is performed by the processor according to at least one from the group consisting of: a deep neural network, and a Gaussian mixture model.

10. The method of claim 1 , further comprising:

deriving the categories to which the at least one sound feature is categorized by:

using a dataset of sound events collected from homes;

extracting the probability estimates of the at least one sound feature; and

using the probability estimates to derive at least one model for a predetermined number of categories.

11. The method of claim 10 , wherein the models are derived using at least one of the group consisting of: an unsupervised algorithm and a mixture of Gaussians.

12. The method of claim 1 , further comprising:

transmitting the notification to at least one from the group consisting of: a law enforcement provider system, a home security provider system, a medical provider system, and a fire department provider system.

13. A home security system comprising:

a sensor to detect a sound event;

a processor coupled to the sensor to:

select at least a portion of sound data captured by the sensor that corresponds to at least one sound feature of the detected sound event;

classify the at least one sound feature into one or more sound categories;

determine, based upon a database including home-specific sound data of the home security system that includes information regarding at least one of a room size, reverberation, and a distance between the sensor a source of the sound data captured by the sensor, and includes a history of learned sounds and sound event data from one or more other home security systems, whether the at least one sound feature correlates to an unauthorized entry and determine a degree of confidence that the classified at least one sound feature correlates to the unauthorized entry; and

a communications interface, coupled to the processor, to transmit a notification to a computing device based on the determined degree of confidence that the classified at least one sound feature correlates to the unauthorized entry.

14. The system of claim 13 , wherein the processor comprises:

a first classifier to classify the sound data of the sound event into the one or more sound categories.

15. The system of claim 14 , wherein the processor further comprises:

a second classifier determines a degree of confidence that the sound data is from a sound event that is human-generated.

16. The system of claim 15 , wherein the second classifier determines a degree of confidence that the sound data is from a sound event that is pet-generated.

17. The system of claim 15 , wherein the second classifier is unique to a particular home.

18. The system of claim 13 , wherein the processor assigns the at least one sound feature to the one or more sound categories based on probability estimates of the at least one sound feature.

19. The system of claim 13 , wherein the at least one sound feature includes human-generated sounds having phonemes.

20. The system of claim 13 , wherein the processor classifies the at least one sound feature into the sound category according to at least one from the group consisting of: cepstrum of the sound data, and a spectrogram of the sound data.

21. The system of claim 13 , wherein the processor classifies the at least one sound feature into the one or more sound categories according to at least one from the group consisting of: a deep neural network, and a Gaussian mixture model.

22. The system of claim 13 , wherein the processor derives the categories to which the at least one sound feature is categorized by using a dataset of sound events collected from homes, and the processor extracts the probability estimates of the at least one sound feature, and uses the probability estimates to derive at least one model for a predetermined number of categories.

23. The system of claim 22 , wherein the models are derived using at least one of group consisting of: an unsupervised algorithm, and a mixture of Gaussians.

24. The system of claim 13 , wherein the communications interface transmits a notification to at least one of the group consisting of: a law enforcement provider system, a home security provider system, a medical provider system, and a fire department provider system.

25. The method of claim 1 , wherein the determining the degree of confidence comprises:

determining, using at least one other sensor, a co-occurrence of the detected sound event using data generated by the at least one other sensor.

Assignments (2)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2015
From: NONGPIUR, RAJEEV CONRAD; DIXON, MICHAEL
To: GOOGLE INC.
Reel/Frame 035926/0329 →
Continuity (1)
Related Publication 20160379456A1 · Dec 29, 2016
Cited By (1)
US 12,406,563