IP Library Granted Patent US 11,102,492
Granted Patent B2
US 11,102,492 · App. 16/000,743 · Granted Aug 24, 2021

Multi-sensor motion detection

Inventors: Peiman Amini (Mountain View, CA); Joseph Amalan Arul Emmanuel (Cupertino, CA)
Assignee: ARLO TECHNOLOGIES, INC.
H04N19/166G06F9/542G06K9/00771G06T7/20G07C9/37G08B3/10G08B3/1016G08B5/223G08B13/191G08B13/193G08B13/1966G08B13/19656G08B13/19669G08B13/19695G08B21/182G08B27/006G08B29/183H04B17/318H04B17/391H04L1/0003H04L1/0009H04L1/0017H04L1/0033H04L5/0053H04L43/0858H04L43/12H04L43/16H04L65/4084H04L65/608H04L65/80H04L67/1093H04N5/23206H04N5/23227H04N5/23254H04N5/247H04N7/12H04N7/183H04N17/002H04N19/103H04N19/124H04N19/156H04N19/184H04N19/40H04N19/42H04W24/08H04W24/10H04W28/021H04W36/0011H04W36/30H04W52/0245H04W52/0261H04W72/042H04W72/0453H05B47/105H05B47/19G06T2207/30232G06T2207/30241H04N7/147H04N7/181H04N19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,102,492
App. No.
16/000,743
Granted
Aug 24, 2021
Kind
B2
Abstract

Use of multiple sensors to determine whether motion of an object is occurring in an area is described. In one aspect, an infrared (IR) sensor can be supplemented with a radar sensor to determine whether the determined motion of an object is not a false positive.

Claims (61)

1. A method comprising:

determining, by a processor, a first indication of a motion of a first object in an area based on an infrared (IR) sensor that is responsive to wavelengths in a first, non-visible light region of an electromagnetic spectrum;

receiving first video data depicting the motion of the first object in the area as recorded by an image sensor that is responsive to wavelengths in a visible light portion of the electromagnetic spectrum, wherein the IR sensor and the image sensor are part of a camera having a field of view including the area;

determining, by the processor, a second indication of the motion of the first object in the area based on a second sensor that is responsive to wavelengths in a second, non-visible light region of the electromagnetic spectrum, wherein the IR sensor, the image sensor, and the second sensor provide data or information to a cloud server;

determining, by the processor, with both of the first indication of the motion and the second indication of the motion that the motion of the object is not a false positive determination of motion in the area;

providing the first video data to the cloud server for viewing the motion of the first object in the area based on the determination that the motion is not a false positive;

determining, by the cloud server, to provide feedback to update motion detection thresholds of any of the IR sensor, the image sensor, or the second sensor, said feedback, changing characteristics of the motion that are used to determine whether motion is occurring within a field of vision in said area; and

adjusting motion detection thresholds used by the camera to determine motion of objects in the area, the motion detection thresholds related to characteristics of the motion that are considered in a determination that motion is occurring in the area.

2. The method of claim 1 , further comprising:

determining, by the processor, a second indication of motion of a second object in the area based on the IR sensor;

receiving second video data depicting the motion of the second object in the area;

determining, by the processor, that the second sensor did not provide an indication of the second object in the area;

determining, by the processor, that the second indication of the motion of the second object is a false positive determination of motion based on the second sensor not providing the indication of the motion of the second object in the area; and

refraining from providing the second video data to the cloud server based on the determination of the motion of the second object being a false positive determination of motion.

3. The method of claim 2 , further comprising:

adjusting motion detection thresholds related to the IR sensor to change sensitivity of the IR sensor to motion occurring in the area.

4. The method of claim 3 , wherein adjusting motion detection thresholds includes adjusting characteristics of motion that are considered when motion of an object in the area results in a determination of motion occurring in the area.

5. The method of claim 1 , wherein the second sensor is a radar sensor.

6. The method of claim 5 , further comprising:

powering on the radar sensor to determine the second indication of the motion based on the IR sensor determining the first indication of the motion of the first object.

7. An electronic device, comprising:

one or more processors; and

memory storing instructions, wherein the processor is configured to execute the instructions such that the processor and memory are configured to:

determine a first indication of a motion of a first object in an area based on an infrared (IR) sensor that is responsive to wavelengths in a first, non-visible light region of an electromagnetic spectrum;

receive first video data depicting the motion of the first object in the area as recorded by an image sensor that is responsive to wavelengths in a visible light portion of the electromagnetic spectrum, wherein the IR sensor and the image sensor are part of a camera having a field of view including the area;

determine a second indication of the motion of the first object in the area based on a second sensor that is responsive to wavelengths in a second, non-visible light region of the electromagnetic spectrum, wherein the IR sensor, the image sensor, and the second sensor provide data or information to a cloud server;

determine with both of the first indication of the motion and the second indication of the motion that the motion of the object is not a false positive determination of motion in the area;

provide the first video data to the cloud server for viewing the motion of the first object in the area based on the determination that the motion is not a false positive;

determine, by the cloud server, to provide feedback to update motion detection thresholds of any of the IR sensor, the image sensor, or the second sensor based on the feedback, said feedback, changing characteristics of the motion that are used to determine whether motion is occurring within a field of vision in said area; and

adjust motion detection thresholds used by the camera to determine motion of objects in the area, the motion detection thresholds related to characteristics of the motion that are considered in a determination that motion is occurring in the area.

8. The electronic device of claim 7 , wherein the processor is configured to execute the instructions such that the processor and memory are configured to:

determine a second indication of motion of a second object in the area based on the IR sensor;

receive second video data depicting the motion of the second object in the area;

determine that the second sensor did not provide an indication of the second object in the area;

determine that the second indication of the motion of the second object is a false positive determination of motion based on the second sensor not providing the indication of the motion of the second object in the area; and

refrain from providing the second video data to the cloud server based on the determination of the motion of the second object being a false positive determination of motion.

9. The electronic device of claim 8 , wherein the processor is configured to execute the instructions such that the processor and memory are configured to:

adjust motion detection thresholds related to the IR sensor to change sensitivity of the IR sensor to motion occurring in the area.

10. The electronic device of claim 9 , wherein adjusting motion detection thresholds includes adjusting characteristics of motion that are considered when motion of an object in the area results in a determination of motion occurring in the area.

11. The electronic device of claim 7 , wherein the second sensor is a radar sensor.

12. The electronic device of claim 7 , wherein the processor is configured to execute the instructions such that the processor and memory are configured to:

power on a radar sensor to determine the second indication of the motion based on the IR sensor determining the first indication of the motion of the first object.

13. A computer program product including one or more non-transitory computer-readable media storing computer program instructions, execution of which by a processing system causes the processing system to:

determine a first indication of a motion of a first object in an area based on an infrared (IR) sensor that is responsive to wavelengths in infrared first, non-visible light region of an electromagnetic spectrum;

receive first video data depicting the motion of the first object in the area as recorded by an image sensor that is responsive to wavelengths in a visible light portion of the electromagnetic spectrum, wherein the IR sensor and the image sensor are part of a camera having a field of view including the area;

determine a second indication of the motion of the first object in the area based on a second sensor that is responsive to wavelengths in a second, non-visible light region of the electromagnetic spectrum, wherein the IR sensor, the image sensor, and the second sensor provide data or information to a cloud server;

determine with both of the first indication of the motion and the second indication of the motion that the motion of the object is not a false positive determination of motion in the area;

provide the first video data to a cloud server for viewing the motion of the first object in the area based on the determination that the motion is not a false positive;

determine, by the cloud server, to provide feedback to update motion detection thresholds of any of the IR sensor, the image sensor, or the second sensor based on the feedback, said feedback, changing characteristics of the motion that are used to determine whether motion is occurring within a field of vision in said area; and

adjust motion detection thresholds used by the camera to determine motion of objects in the area, the motion detection thresholds related to characteristics of the motion that are considered in a determination that motion is occurring in the area.

14. The computer program product of claim 13 , wherein the execution of the computer program instructions causes the processing system to perform operations comprising:

determine a second indication of motion of a second object in the area based on the IR sensor;

receive second video data depicting the motion of the second object in the area;

determine that the second sensor did not provide an indication of the second object in the area;

determine that the second indication of the motion of the second object is a false positive determination of motion based on the second sensor not providing the indication of the motion of the second object in the area; and

refrain from providing the second video data to the cloud server based on the determination of the motion of the second object being a false positive determination of motion.

15. The computer program product of claim 14 , wherein the execution of the computer program instructions causes the processing system to perform operations comprising:

adjust motion detection thresholds related to the IR sensor to change sensitivity of the IR sensor to motion occurring in the area.

16. The computer program product of claim 15 , wherein adjusting motion detection thresholds includes adjusting characteristics of motion that are considered when motion of an object in the area results in a determination of motion occurring in the area.

17. The computer program product of claim 13 , wherein the execution of the computer program instructions causes the processing system to perform operations comprising:

power on a radar sensor to determine the second indication of the motion based on the IR sensor determining the first indication of the motion of the first object.

Assignments (3)
SECURITY INTEREST Recorded Dec 13, 2024
From: ARLO TECHNOLOGIES, INC.
To: HSBC BANK USA, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 069631/0443 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2020
From: NETGEAR, INC.
To: ARLO TECHNOLOGIES, INC.
Reel/Frame 053040/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2018
From: AMINI, PEIMAN; EMMANUEL, JOSEPH AMALAN ARUL
To: NETGEAR, INC.
Reel/Frame 047836/0963 →
Continuity (2)
Provisional Application 62633017 · Feb 20, 2018
Related Publication 20190259270A1 · Aug 22, 2019
Cited By (1)
US 12,556,714