IP Library Granted Patent US 10,679,476
Granted Patent B2
US 10,679,476 · App. 16/552,769 · Granted Jun 9, 2020

Method of using a camera to detect direction of motion

Inventors: Eric C. Bretschneider (Corinth, TX); James J. Fitzgibbon (Batavia, IL)
Assignee: The Chamberlain Group, Inc.
G08B13/19608G01B11/026G01B11/14G06T7/254H04N5/2253H04N5/23212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,679,476
App. No.
16/552,769
Granted
Jun 9, 2020
Kind
B2
Abstract

A motion detector camera is configured to differentiate between an object or objects passing through the field of view of the camera and an object or objects approaching the sensor. In one example, motion is detected with a camera configured to identify and selectively filter specific directions of motion. The motion detector compares pixel changes, corresponding to the basic area or size of the object, from frame to frame, and detects the amount of increase in change or decrease in change. An increasing change in the area or size of an object indicates that an object is approaching, and a decreasing change in the area or size of an object indicates that an object that is receding.

Claims (90)

1. A method performed by a camera to detect direction of movement, the method comprising:

detecting a first size for an object in a field of view for a first frame captured by the camera, wherein the detecting includes:

comparing pixel brightness for a set of pixels from a prior frame captured by the camera prior to a corresponding set of pixels from the first frame; and

defining the object as a set of pixels in the field of view of the first frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by a pixel brightness threshold;

detecting a second size for the object in the field of view for a second frame captured by the camera, the second frame being captured later in time than the first frame;

comparing the first size for the object to the second size for the object;

determining, based on the comparing of the first size for the object to the second size for the object, that the second size is larger than the first size by more than a first threshold; and

in response to the second size being larger than the first size by more than the first threshold, automatically effecting execution of a first action by a device in communication with the camera.

2. The method of claim 1 wherein detecting the first size for the object in the field of view for the first frame further comprises:

determining an average pixel brightness for at least two frames captured by the camera;

comparing the average pixel brightness to a pixel brightness value for individual pixels in the field of view of the first frame; and

wherein defining the object as the set of pixels in the field of view of the first frame includes defining the object as a set of pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by a brightness threshold.

3. The method of claim 2 wherein the detecting the first size for the object in the field of view for the first frame further comprises defining the first size of the object as a first frame total number of pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold.

4. The method of claim 3 wherein the comparing the first size for the object to the second size for the object comprises comparing the first frame total number of pixels in the field of view of the first frame to a second frame total number of pixels in the field of view of the second frame having a brightness value different from the average pixel brightness for at least two frames captured by the camera by the brightness threshold.

5. The method of claim 2 wherein the detecting the first size for the object in the field of view for the first frame further comprises defining the first size of the object as one or both of: a) a maximum or average width of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold; or b) a maximum or average height of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold.

6. The method of claim 5 wherein the comparing the first size for the object to the second size for the object comprises one or both of:

comparing the maximum or average width of contiguous pixels in the field of view of the first frame to a second frame maximum or average width of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold;

comparing the maximum or average height of contiguous pixels in the field of view of the first frame to a second frame maximum or average height of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold.

7. The method of claim 2 further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the series of sizes for the object comprises defining a size of the object in a given frame of the series of frames as a total number of pixels in the field of view of the given frame having a brightness value different from the average pixel brightness by the brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a rate of change of the sizes of the object over the series of frames exceeds a rate threshold.

8. The method of claim 2 further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the sizes for the object comprises defining a size of the object in a given frame of the series of frames as a total number of pixels in the field of view of the given frame having a brightness value different from the average pixel brightness by the brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a percentage of change of the sizes of the object over the series of frames exceeds a percentage threshold.

9. The method of claim 1 wherein the detecting the first size for the object in the field of view for the first frame further comprises defining the first size of the object as a first frame total number of pixels in the field of view of the first frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by the pixel brightness threshold.

10. The method of claim 9 wherein the comparing the first size to the second size for the object comprises comparing the first frame total number of pixels to a second frame total number of pixels in the field of view of the second frame having a pixel brightness value different from pixel brightness for corresponding pixels from a prior frame captured by the camera by a pixel brightness threshold.

11. The method of claim 1 wherein the detecting the first size for the object comprises defining the first size of the object as one or both of a maximum or average width of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold or a maximum or average height of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold.

12. The method of claim 11 wherein the comparing the first size to the second size for the object comprises one or both of:

comparing the maximum or average width of contiguous pixels in the field of view of the first frame to a second frame maximum or average width of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold;

comparing the maximum or average height of contiguous pixels in the field of view of the first frame to a second frame maximum or average height of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold.

13. The method of claim 1 further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the sizes for the object comprises defining a size of the object in a given frame of the series of frames as a frame total number of pixels in the field of view of the given frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by the pixel brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a rate of change of the sizes of the object over the series of frames exceeds a rate threshold.

14. The method of claim 1 further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the sizes for the object comprises defining a size of the object in a given frame of the series of frames as a frame total number of pixels in the field of view of the given frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by the pixel brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a percentage of change of the sizes of the object over the series of frames exceeds a percentage threshold.

15. The method of claim 1 wherein the automatically effecting execution of the first action by the device in communication with the camera further comprises turning on a light that directs illumination into the field of view for the camera.

16. A method performed by a camera to detect direction of movement, the method comprising:

capturing a first frame, a second frame, and a third frame at different times by the camera;

comparing pixel brightness for a set of pixels from the first frame to a corresponding set of pixels from the second frame to remove a background and to define a first pixel set having a brightness difference greater than a pixel brightness threshold;

comparing pixel brightness for a set of pixels from the second frame to a corresponding set of pixels from the third frame to remove a background and to define a second pixel set having a brightness difference greater than a pixel brightness threshold;

comparing the size of the first pixel set to the size of the second pixel set,

determining that the size of the second pixel set is larger than the size of the first pixel set by more than a first threshold;

in response to the size of the second pixel set being larger than the size of the first pixel set by more than the first threshold, automatically effecting execution of a first action by a device in communication with the camera.

17. The method of claim 16 wherein the automatically effecting execution of the first action by the device in communication with the camera further comprises turning on a light that directs illumination into the field of view for the camera.

18. A non-transitory computer readable medium storing instructions thereon that, when executed by a processor, cause the processor to perform operations comprising:

detecting a first size for an object in a field of view of a camera for a first frame captured by the camera, wherein the detecting includes:

comparing pixel brightness for a set of pixels from a prior frame captured by the camera prior to a corresponding set of pixels from the first frame; and

defining the object as a set of pixels in the field of view of the first frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by a pixel brightness threshold;

detecting a second size for the object in the field of view for a second frame captured by the camera, the second frame being captured later in time than the first frame;

comparing the first size for the object to the second size for the object;

determining, based on the comparing of the first size for the object to the second size for the ojbect, that the second size is larger than the first size by more than a first threshold; and

in response to the second size being larger than the first size by more than the first threshold, automatically effecting execution of a first action by a device in communication with the camera.

19. The non-transitory computer readable medium of claim 18 wherein detecting the first size for the object in the field of view for the first frame comprises:

determining an average pixel brightness for at least two frames captured by the camera;

comparing the average pixel brightness to a pixel brightness value for individual pixels in the field of view of the first frame; and

wherein defining the object as the set of pixels in the field of view of the first frame includes defining the object as a set of pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by a brightness threshold.

20. The non-transitory computer readable medium of claim 19 wherein the detecting the first size for the object in the field of view for the first frame further comprises defining the first size of the object as a first frame total number of pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold.

21. The non-transitory computer readable medium of claim 20 wherein the comparing the first size for the object to the second size for the object comprises comparing the first frame total number of pixels in the field of view of the first frame to a second frame total number of pixels in the field of view of the second frame having a brightness value different from the average pixel brightness for at least two frames captured by the camera by the brightness threshold.

22. The non-transitory computer readable medium of claim 19 wherein the detecting the first size for the object in the field of view for the first frame further comprises defining the first size of the object as one or both of: a) a maximum or average width of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold; or b) a maximum or average height of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold.

23. The non-transitory computer readable medium of claim 22 wherein the comparing the first size for the object to the second size for the object comprises one or both of:

comparing the maximum or average width of contiguous pixels in the field of view of the first frame to a second frame maximum or average width of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold;

comparing the maximum or average height of contiguous pixels in the field of view of the first frame to a second frame maximum or average height of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold.

24. The non-transitory computer readable medium of claim 19 , the operations further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the series of sizes for the object comprises defining a size of the object in a given frame of the series of frames as a total number of pixels in the field of view of the given frame having a brightness value different from the average pixel brightness by the brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a rate of change of the sizes of the object over the series of frames exceeds a rate threshold.

25. The non-transitory computer readable medium of claim 19 , the operations further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the sizes for the object comprises defining a size of the object in a given frame of the series of frames as a total number of pixels in the field of view of the given frame having a brightness value different from the average pixel brightness by the brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a percentage of change of the sizes of the object over the series of frames exceeds a percentage threshold.

26. The non-transitory computer readable medium of claim 18 wherein the detecting the first size for the object in the field of view for the first frame further comprises defining the first size of the object as a first frame total number of pixels in the field of view of the first frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by the pixel brightness threshold.

27. The non-transitory computer readable medium of claim 26 wherein the comparing the first size to the second size for the object comprises comparing the first frame total number of pixels to a second frame total number of pixels in the field of view of the second frame having a pixel brightness value different from pixel brightness for corresponding pixels from a prior frame captured by the camera by a pixel brightness threshold.

28. The non-transitory computer readable medium of claim 18 wherein the detecting the first size for the object comprises defining the first size of the object as one or both of a maximum or average width of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold or a maximum or average height of contiguous pixels in the field of view of the first frame having a brightness value different from the average pixel brightness by the brightness threshold.

29. The non-transitory computer readable medium of claim 28 wherein the comparing the first size to the second size for the object comprises one or both of:

comparing the maximum or average width of contiguous pixels in the field of view of the first frame to a second frame maximum or average width of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold;

comparing the maximum or average height of contiguous pixels in the field of view of the first frame to a second frame maximum or average height of contiguous pixels in the field of view of the second frame having a brightness value different from an average pixel brightness for at least two frames captured by the camera by the brightness threshold.

30. The non-transitory computer readable medium of claim 18 , the operations further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the sizes for the object comprises defining a size of the object in a given frame of the series of frames as a frame total number of pixels in the field of view of the given frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by the pixel brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a rate of change of the sizes of the object over the series of frames exceeds a rate threshold.

31. The non-transitory computer readable medium of claim 18 , the operations further comprising detecting a series of sizes for the object over a series of frames captured by the camera between capturing the first frame and the second frame;

wherein the detecting the sizes for the object comprises defining a size of the object in a given frame of the series of frames as a frame total number of pixels in the field of view of the given frame having a brightness value different from the pixel brightness for corresponding pixels from the prior frame by the pixel brightness threshold;

wherein the determining that the second size is larger than the first size by more than the first threshold comprises determining that the sizes of the object are increasing over the series of frames and that a percentage of change of the sizes of the object over the series of frames exceeds a percentage threshold.

32. The non-transitory computer readable medium of claim 18 wherein the automatically effecting execution of the first action by the device in communication with the camera further comprises turning on a light that directs illumination into the field of view for the camera.

33. A non-transitory computer readable medium storing instructions thereon that, when executed by a processor, cause the processor to perform operations comprising:

capturing a first frame, a second frame, and a third frame at different times by a camera;

comparing pixel brightness for a set of pixels from the first frame to a corresponding set of pixels from the second frame to remove a background and to define a first pixel set having a brightness difference greater than a pixel brightness threshold;

comparing pixel brightness for a set of pixels from the second frame to a corresponding set of pixels from the third frame to remove a background and to define a second pixel set having a brightness difference greater than a pixel brightness threshold;

comparing the size of the first pixel set to the size of the second pixel set,

determining that the size of the second pixel set is larger than the size of the first pixel set by more than a first threshold;

in response to the size of the second pixel set being larger than the size of the first pixel set by more than the first threshold, automatically effecting execution of a first action by a device in communication with the camera.

34. The non-transitory computer readable medium of claim 33 wherein the automatically effecting execution of the first action by the device in communication with the camera further comprises turning on a light that directs illumination into the field of view for the camera.

Assignments (10)
CHANGE OF NAME Recorded Nov 5, 2025
From: THE CHAMBERLAIN GROUP, INC.
To: THE CHAMBERLAIN GROUP, LLC
Reel/Frame 073485/0722 →
NOTICE OF TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 26, 2024
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: THE CHAMBERLAIN GROUP LLC; SYSTEMS, LLC
Reel/Frame 066374/0749 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Nov 3, 2021
From: THE CHAMBERLAIN GROUP LLC; SYSTEMS, LLC
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 058014/0931 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Nov 3, 2021
From: THE CHAMBERLAIN GROUP LLC; SYSTEMS, LLC
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 058015/0001 →
MERGER Recorded Sep 30, 2019
From: THE DUCHOSSOIS GROUP, INC.
To: DD66 LLC
Reel/Frame 050563/0312 →
CHANGE OF NAME Recorded Sep 30, 2019
From: DUCHOSSOIS INDUSTRIES, INC.
To: THE DUCHOSSOIS GROUP, INC.
Reel/Frame 050583/0069 →
EMPLOYMENT AGREEMENT CONCERNING INTELLECTUAL PROPERTY Recorded Sep 30, 2019
From: BRETSCHNEIDER, ERIC
To: DUCHOSSOIS INDUSTRIES, INC.
Reel/Frame 050583/0100 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2019
From: THE DUCHOSSOIS GROUP, INC.
To: THE CHAMBERLAIN GROUP, INC.
Reel/Frame 050561/0738 →
MERGER Recorded Sep 30, 2019
From: DD66 LLC
To: THE DUCHOSSOIS GROUP, INC.
Reel/Frame 050562/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2019
From: FITZGIBBON, JAMES J.
To: THE CHAMBERLAIN GROUP, INC.
Reel/Frame 050248/0861 →
Cited By (1)
US 12,469,293