IP Library Granted Patent US 11,860,038
Granted Patent B2
US 11,860,038 · App. 17/496,266 · Granted Jan 2, 2024

Method, apparatus and system for passive infrared sensor framework

Inventors: Yash Modi (San Mateo, CA); Mark Rajan Malhotra (San Mateo, CA); Gwendolyn van der Linden (Redwood City, CA); Dongeek Shin (Mountain View, CA); Michael Dixon (Sunnyvale, CA)
Assignee: Google LLC
G01J5/0025G01J5/025G01J5/10G06V20/52G08B13/191G08B13/193G08B13/19602G08B29/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,860,038
App. No.
17/496,266
Granted
Jan 2, 2024
Kind
B2
Abstract

A method includes detecting, with a passive infrared sensor (PIR), a level of infrared radiation in a field of view (FOV) of the PIR, generating a signal based on detected levels over a period of time, the signal having values that exhibit a change in the detected levels, extracting a local feature from a sample of the signal, wherein the local feature indicates a probability that a human in the FOV caused the change in the detected levels, extracting a global feature from the sample of the signal, wherein the global feature indicates a probability that an environmental radiation source caused the change in the detected levels, determining a score based on the local feature and the global feature, and determining that a human motion has been detected in the FOV based on the score.

Claims (60)

1. A method comprising:

detecting, with a passive infrared sensor (PIR), levels of infrared radiation in a field of view (FOV) of the PIR;

generating a signal based on the levels of infrared radiation detected with the PIR, the signal having values used to detect a change in the levels of infrared radiation as detected with the PIR;

extracting a local feature from a sample of the signal by tracking an absolute deviation of the sample of the signal relative to a threshold predetermined to approximate a non-environmental radiation source, wherein:

the local feature indicates a first probability that the non-environmental radiation source in the FOV caused the change in the detected levels of infrared radiation; and

the non-environmental radiation source corresponds to human motion;

extracting a global feature from the sample of the signal by a product of a feature parameter determined through training on a dataset to achieve a slow total variation and a rolling average value updated after every frame of the PIR, wherein the global feature indicates a second probability that an environmental radiation source caused the change in the detected levels of infrared radiation;

determining a score based on the local feature and the global feature; and

determining that the non-environmental radiation source has been detected in the FOV based on the score.

2. The method of claim 1 , wherein the local feature (c local ) of a k th sample of the signal (x) is determined by the function:

C local ( x k )=| x k |.

3. The method of claim 1 , wherein the local feature (C local ) of a k th sample of the signal (x) is determined by the function:

C local ( x k )= Ax k +b,

where A and b are learned parameters determined, through training on a dataset of prior PIR values, to achieve linear dimensionality reduction.

4. The method of claim 1 , wherein the global feature (C global ) of a k th sample of the signal (x) is determined by the function:

C global ( x k )=(1− E ) x′+ε|x k −x k-1 |,

where ε is a learned parameter determined through training on a dataset of prior PIR values, and where x′ is a rolling average that is updated after every frame.

5. The method of claim 1 , wherein the global feature (C global ) of a k th of the signal (x) is determined by the function:

C global ( x k )=(1−ε) x′+ε|x k |,

where ε is a learned parameter determined through training on a dataset of prior PIR values, and where x′ is a rolling average that is updated after every frame.

6. The method of claim 1 , wherein a number of elementary operations executed per sample of the signal to detect the non-environmental radiation source is less than 10.

7. The method of claim 1 , wherein a number of instructions per signal sample is less than 7.

8. The method of claim 1 , further comprising transmitting a notification indicating that the FOV of the PIR is not optimal for non-environmental radiation source detection when the global feature remains above a threshold value for a predetermined length of time.

9. A passive infrared (PIR) sensor device, comprising:

a plurality of radiation sensitive elements that detect radiation levels in a field of view (FOV) and generate charges based on the radiation levels;

a circuit that receives the generated charges and generates a single output signal based on the charges; and

a processor that receives the signal and extracts a local feature from a sample of the signal by tracking an absolute deviation of the sample of the signal relative to a threshold predetermined to approximate a non-environmental radiation source and a global feature from the sample of the signal by a product of a feature parameter determined through training on a dataset to achieve a slow total variation and a rolling average value updated after every frame of the PIR, the local feature indicating a first probability that the non-environmental radiation source in the FOV caused a change in the detected radiation levels and the global feature indicating a second probability that an environmental radiation source in the FOV caused the change in the detected radiation levels, wherein the non-environmental radiation source corresponds to human motion;

wherein the processor is configured:

to determine a score based on the global feature and the local feature, and

to determine that the non-environmental radiation source has been detected in the FOV based on the score.

10. The PIR sensor device of claim 9 , wherein the processer extracts the local feature (c local ) of a k th sample of the signal (x) by executing the function:

C local ( x k )=| x k |.

11. The method of claim 9 , wherein the local feature (C local ) of a k th sample of the signal (x) is determined by the function:

C local ( x k )= Ax k +b,

where A and b are learned parameters determined, through training on a dataset of prior PIR values, to achieve linear dimensionality reduction.

12. The method of claim 9 , wherein the global feature (C global ) of a k th sample of the signal (x) is determined by the function:

C global ( x k )=(1−ε) x′+ε|x k −x k-1 |,

where ε is a learned parameter determined through training on a dataset of prior PIR values, and where x′ is a rolling average that is updated after every frame.

13. The method of claim 9 , wherein the global feature (C global ) of a k th of the signal (x) is determined by the function:

C global ( x k )=(1−ε) x′+ε|x k |,

where ε is a learned parameter determined through training on a dataset of prior PIR values, and where x′ is a rolling average that is updated after every frame.

14. The PIR sensor device of claim 9 , wherein a number of elementary operations executed by the processor per sample of the signal to detect the non-environmental radiation source is less than 10.

15. The PIR sensor device of claim 9 , wherein a number of instructions executed by the processor per signal sample is less than 7.

16. The PIR sensor device of claim 9 , further comprising:

a communication interface configured to transmit a notification indicating that the environment within the FOV is not optimal for non-environmental radiation source detection when the processor determines that the global feature remains above a threshold value for a predetermined length of time.

17. A system, comprising:

a network;

a controller configured to transmit and receive data through the network; and

at least one passive infrared (PIR) sensor device configured to transmit data to the controller through the network, the PIR sensor device comprising:

a plurality of radiation sensitive elements that detect radiation levels in a field of view (FOV) and generate charges based on the detected radiation levels;

a circuit that receives the generated charges and generates a single output signal based on the charges; and

a processor that receives the signal and extracts a local feature from a sample of the signal by tracking an absolute deviation of the sample of the signal relative to a threshold predetermined to approximate a non-environmental radiation source and a global feature from the sample of the signal by a product of a feature parameter determined through training on a dataset to achieve a slow total variation and a rolling average value updated after every frame of the PIR, the local feature indicating a first probability that the non-environmental radiation source in the FOV caused the change in the detected radiation levels and the global feature indicating a second probability that an environmental radiation source caused the change in the detected radiation levels, the non-environmental radiation source corresponds to human motion;

wherein the processor is configured:

to determine a score based on the global feature and the local feature; and

to determine that the non-environmental radiation source has been detected in the FOV based on the score.

18. The system of claim 17 , wherein the processer extracts the local feature (c local ) of a k th sample of the signal (x) by executing the function:

c local ( x k )=| x k |.

19. The method of claim 17 , wherein the global feature (C global ) of a k th sample of the signal (x) is determined by the function:

C global ( x k )=(1−ε) x′+ε|x k −x k-1 |,

where ε is a learned parameter determined through training on a dataset of prior PIR values, and where x′ is a rolling average that is updated after every frame.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2021
From: MODI, YASH; MALHOTRA, MARK RAJAN; VAN DER LINDEN, GWENDOLYN; SHIN, DONGEEK; DIXON, MICHAEL
To: GOOGLE INC.
Reel/Frame 057740/0515 →
CHANGE OF NAME Recorded Oct 8, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 057758/0789 →
Continuity (3)
Continuation 16894047 · Jun 5, 2020
Continuation 15430256 · Feb 10, 2017
Related Publication 20220026277A1 · Jan 27, 2022