IP Library Granted Patent US 11,922,642
Granted Patent B1
US 11,922,642 · App. 18/348,008 · Granted Mar 5, 2024

Methods and apparatus for detecting unrecognized moving objects

Inventors: Nicholas Setzer (Boston, MA); Shekhar Bangalore Sastry (Arlington, MA)
Assignee: SimpliSafe, Inc.
G06T7/248G01J5/0025G06T7/277H04N7/183H04N7/188G06T2207/10016G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,642
App. No.
18/348,008
Granted
Mar 5, 2024
Kind
B1
Abstract

Security methods and apparatus. In one example, a method includes detecting a motion event in a scene using a motion detector, based on detecting the motion event, acquiring a plurality of images of the scene using an image capture device, applying a motion detection process to the plurality of images to detect motion in the scene, applying an object detection process to at least one of the images to detect an object in the scene, pairing the motion with the object to locate a moving object, identifying the moving object as an unrecognized object, and based at least in part on identifying the moving object as an unrecognized object, triggering a video recording of the scene using the image capture device.

Claims (65)

1. A method comprising:

detecting a motion event in a scene using a motion detector;

based on detecting the motion event, acquiring a plurality of images of the scene using an image capture device;

applying a motion detection process to the plurality of images to detect motion in the scene;

applying an object detection process to at least one image of the plurality of images to detect an object in the scene;

pairing the motion with the object to locate a moving object; identifying the moving object as an unrecognized object; and

based at least in part on identifying the moving object as an unrecognized object, triggering a video recording of the scene using the image capture device;

wherein applying the motion detection process includes producing a first bounding box identifying a location of the motion in the at least one image;

wherein applying the object detection process includes producing a second bounding box identifying a location of the object in the at least one image; and

wherein pairing the motion with the object includes determining that the first bounding box and the second bounding box at least partially overlap.

2. The method of claim 1 , further comprising:

after completing the video recording, deactivating the image capture device.

3. The method of claim 1 , wherein applying the motion detection process to the plurality of images to detect the motion includes processing multiple consecutive image frames.

4. The method of claim 3 , wherein processing the multiple consecutive image frames includes applying a Kalman filter to the multiple consecutive image frames.

5. The method of claim 3 , wherein processing the multiple consecutive image frames includes:

converting each image frame of the multiple consecutive image frames to greyscale to produce multiple consecutive greyscale image frames;

comparing pixel intensities between the multiple consecutive greyscale image frames; and

detecting the motion based on differences in at least some of the pixel intensities between the multiple consecutive greyscale image frames exceeding a predetermined threshold value.

6. The method of claim 1 , further comprising:

transmitting the video recording to a remote monitoring location.

7. The method of claim 1 , wherein detecting the motion event includes detecting the motion event using a passive infrared sensor.

8. A method comprising:

detecting a motion event using a motion detector;

based on detecting the motion event, activating an image capture device;

acquiring a first set of images with the image capture device;

processing the first set of images to detect a moving object;

identifying the moving object as an unrecognized object;

based on identifying the moving object as an unrecognized object,

acquiring a second set of images of the scene with the image capture device;

processing the second set of images to confirm detection of the moving object;

based on processing the second set of images, confirming identification of the moving object as an unrecognized object; and

based on confirming the identification of the moving object as an unrecognized object, controlling the image capture device to record a video sequence of the scene;

wherein processing the first set of images to detect the moving object includes:

applying a motion detection process to a plurality of images in the first set of images to detect motion in the scene;

applying an object detection process to at least one image of the plurality of images to detect an object in the scene; and

pairing the motion with the object to locate the moving object;

wherein applying the motion detection process includes producing a first bounding box identifying a location of the motion in the at least one image;

wherein applying the object detection process includes producing a second bounding box identifying a location of the object in the at least one image; and

wherein pairing the motion with the object includes determining that the first bounding box and the second bounding box at least partially overlap.

9. The method of claim 8 , wherein applying the motion detection process and applying the object detection process each includes applying a Kalman filter to the first set of images.

10. The method of claim 8 , wherein detecting the motion event includes detecting the motion event using a passive infrared sensor.

11. A sensor comprising:

a motion detector configured to detect motion events;

an image capture device;

at least one processor; and

a data storage device storing instructions that when executed by the at least one processor cause the sensor to

detect a motion event using the motion detector,

based on detecting the motion detector, activating the image capture device,

acquire a plurality of image frames using the image capture device,

apply a motion detection process to the plurality of image frames to detect motion in the scene,

apply an object detection process to at least one image frame of the plurality of image frames to detect an object in the scene,

pair the motion with the object to locate a moving object,

identify the moving object as an unrecognized object, and

based at least in part on identifying the moving object as an unrecognized object, cause the image capture device to record a video sequence of the scene;

wherein applying the motion detection process includes producing a first bounding box identifying a location of the motion in the at least one image;

wherein applying the object detection process includes producing a second bounding box identifying a location of the object in the at least one image; and

wherein pairing the motion with the object includes determining that the first bounding box and the second bounding box at least partially overlap.

12. The sensor of claim 11 , wherein the data storage device further includes instructions that when executed by the at least one processor cause the sensor to:

operate in a low power mode of operation in which the image capture device is deactivated;

detect the motion event while operating in the low power mode of operation; and

based on detecting the motion event, operate in a normal mode of operation in which the image capture device is activated.

13. The sensor of claim 11 , further comprising:

a battery coupled to the motion detector, the image capture device, the data storage device, and the at least one processor.

14. The sensor of claim 11 , wherein the motion detector is a passive infrared sensor.

15. The sensor of claim 11 , further comprising a transmitter configured to transmit the video sequence to a remote monitoring center.

Assignments (2)
SECURITY INTEREST Recorded Nov 12, 2025
From: SIMPLISAFE, INC.
To: CAPITAL ONE, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 073579/0854 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2023
From: SETZER, NICHOLAS; SASTRY, SHEKHAR BANGALORE
To: SIMPLISAFE, INC.
Reel/Frame 064771/0850 →
Continuity (1)
Provisional Application 63482218 · Jan 30, 2023
Cited By (4)
US 12,211,283 US 12,244,973 US 12,450,756 US 12,594,959