IP Library Granted Patent US 11,352,812
Granted Patent B2
US 11,352,812 · App. 15/881,776 · Granted Jun 7, 2022

Door lock system coupled to an image capture device

Inventor: Jason Johnson (San Francisco, CA)
Assignee: August Home, Inc.
E05B47/0012E05B45/06E05B47/00E05B47/0001E05B47/026E05B55/12G06V40/16G06V40/174G07C9/00174G07C9/00309G07C9/00563G07C9/00904G07C9/00944G08B13/19695G08B17/10G08B25/10G08B29/185H04N7/186E05B2045/069E05B2047/002E05B2047/0022E05B2047/0048E05B2047/0058E05B2047/0072E05B2047/0091E05B2047/0095E05C1/004G07C2209/62Y10T292/1021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,352,812
App. No.
15/881,776
Granted
Jun 7, 2022
Kind
B2
Abstract

A wireless access system at a building is provided. A door lock system includes: a lock status device configured to be coupled to the drive shaft of a lock device, the lock status device assisting in locking and unlocking a lock of a lock device. A processor is coupled to the door lock system. An image capture device at the building is configured to be in communication with the door lock system and capture an image of an object in the vicinity of the building. A light source assembly is in communication with the image capture device.

Claims (68)

1. A wireless access system at a building, comprising:

a door lock system including a lock status device configured to be coupled to a drive shaft that is coupled to a lock;

an image capture device and a light source assembly at the building; and

at least one processor configured to:

detect, at a first time, that a first person has entered the building,

trigger the image capture device to capture images of the first person at the first time,

analyze a time sequence of images of the first person to detect at least one facial or body expression of the first person depicted in the time sequence, the time sequence of images comprising a plurality of images,

determine an identity of the first person based at least in part on the analysis of the time sequence of images of the first person,

trigger control of one or more devices within the building in accordance with one or more first preferences associated with the first person,

detect, at a second time, that a second person has entered the building, the second time being later than the first time and later than a triggering of control of the one or more devices in accordance with the one or more first preferences,

determine an identity of the second person based at least in part on an analysis of a time sequence of images of the second person captured by the image capture device at the second time,

determine whether to update the control of the one or more devices within the building, wherein determining whether to update the control comprises evaluating one or more second preferences associated with the second person and evaluating whether to control in accordance with the one or more second preferences associated with the second person or to maintain control in accordance with the one or more first preferences associated with the first person, and

in response to a determination to update the control of the one or more devices, trigger an update to the control of the one or more devices within the building in accordance with the one or more second preferences associated with the second person.

2. The system of claim 1 , wherein the at least one processor is configured to activate the light source assembly.

3. The system of claim 1 , wherein the light source assembly is activated to illuminate the first person or the second person.

4. The system of claim 1 , wherein the image capture device is a camera.

5. The system of claim 1 , wherein the image capture device is configured to acquire a constant stream of images of the first person and the analyzing is performed for the constant stream of images.

6. The system of claim 1 , wherein the at least one processor is further configured to:

analyze the time sequence of images of the first person to detect a facial expression of the first person depicted in the time sequence, wherein the facial expression is different from a body expression of the first person.

7. The system of claim 1 , wherein the at least one processor is further configured to:

trigger an action to be performed based on the detected at least one facial or body expression of the first person.

8. The system of claim 1 , wherein analyzing the time sequence of images of the first person comprises:

for a first image of the plurality of images, assigning a confidence parameter associated with a first facial or body expression to at least one facial or body motion of the first person depicted in the first image; and

for each other image of the first person of the plurality of images of the time sequence:

analyzing one or more regions in the image, the one or more regions being associated with the at least one facial or body motion of the first person, and

updating the confidence parameter associated with the first facial or body expression assigned to the at least one facial or body motion of the first person, and

determining, following the analyzing and the updating for the plurality of images of the time sequence and based on the updated confidence parameter, whether the at least one facial or body motion of the first person is indicative of the first facial or body expression of the first person.

9. The system of claim 8 , wherein analyzing the time sequence of images further comprises:

detecting the at least one facial or body expression based on an analysis of the one or more regions in one or more cropped versions of one or more of the plurality of images.

10. The system of claim 8 , further comprising:

at least one data store coupled to the door lock system, the at least one data store including the at least one facial or body motion of the first person.

11. The system of claim 8 , wherein the at least one facial or body motion of the first person is used to process previously acquired images of the first person.

12. The system of claim 1 , wherein the at least one processor is further configured to:

calculate a first feature vector associated with the at least one facial or body expression detected in a first set of images of the first person;

calculate a distance vector between the first feature vector and a second feature vector calculated for a second set of images of the first person; and

determine whether the distance vector exceeds a threshold.

13. The system of claim 1 , wherein

the at least one processor is configured to:

refrain from triggering the update to the control of the one or more devices within the building in accordance with the one or more second preferences associated with the second person in response to a determination not to update the control of the one or more devices.

14. The system of claim 13 , wherein the at least one processor is configured to:

maintain control of the one or more devices within the building in accordance with the one or more first preferences of the first person in response to a determination not to update the control of the one or more devices.

15. A method of determining an intent of a person exiting or entering a building, the method comprising:

detecting, at a first time, that a first person has entered the building;

analyzing images captured by an image capture device at the building at the first time, wherein analyzing images captured by the image capture device comprises:

analyzing a time sequence of images of the first person to detect at least one facial or body expression of the first person depicted in the time sequence, the time sequence of images comprising a plurality of images;

determining an identity of the first person based at least in part on the analysis of the time sequence of images of the first person;

triggering control of one or more devices within the building in accordance with one or more first preferences associated with the first person;

detecting, at a second time, that a second person has entered the building, the second time being later than the first time and later than a triggering of control of the one or more devices in accordance with the one or more first preferences;

determining an identity of the second person based at least in part on an analysis of a time sequence of images of the second person captured by the image capture device at the second time;

determining whether to update the control of the one or more devices within the building, wherein determining whether to update the control comprises evaluating one or more second preferences associated with the second person and evaluating whether to control in accordance with the one or more second preferences associated with the second person or to maintain control in accordance with the one or more first preferences associated with the first person; and

in response to a determination to update the control of the one or more devices, triggering an update to the control of the one or more devices within the building in accordance with the one or more second preferences associated with the second person.

16. The method of claim 15 , wherein analyzing the time sequence of images of the first person comprises:

for a first image of the plurality of images, assigning a confidence parameter associated with a first facial or body expression to at least one facial or body motion of the first person depicted in the first image; and

for each other image of the first person of the plurality of images of the time sequence:

analyzing one or more regions in the image, the one or more regions being associated with the at least one facial or body motion of the first person, and

updating the confidence parameter associated with the first facial or body expression assigned to the at least one facial or body motion of the first person, and

determining, following the analyzing and the updating for the plurality of images of the time sequence and based on the updated confidence parameter, whether the at least one facial or body motion of the first person is indicative of the first facial body expression of the first person.

17. The method of claim 15 , further comprising:

calculating a first feature vector associated with the at least one facial or body expression detected in a first set of images of the first person;

calculating a distance vector between the first feature vector and a second feature vector calculated for a second set of images of the first person; and

determining whether the distance vector exceeds a threshold.

18. The method of claim 15 , wherein the method further comprises:

analyzing the time sequence of images of the first person to detect a facial expression of the first person depicted in the time sequence, wherein the facial expression is different from a body expression of the first person.

19. The method of claim 15 , wherein:

the method further comprises:

refrain from triggering the update to the control of the one or more devices within the building in accordance with the one or more second preferences associated with the second person in response to a determination not to update the control of the one or more devices.

20. The method of claim 19 , further comprising:

maintaining control of the one or more devices within the building in accordance with the one or more first preferences of the first person in response to a determination not to update the control of the one or more devices.

Assignments (2)
MERGER Recorded Mar 26, 2025
From: AUGUST HOME, INC.
To: MASTER LOCK COMPANY LLC
Reel/Frame 070646/0243 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2021
From: JOHNSON, JASON
To: AUGUST HOME, INC.
Reel/Frame 055622/0953 →
Continuity (24)
Continuation 15867992 · Jan 11, 2018
Continuation In Part 15867773 · Jan 11, 2018
Continuation In Part 15798425 · Oct 31, 2017
Continuation In Part 15497383 · Apr 26, 2017
Continuation In Part 15497327 · Apr 26, 2017
Continuation In Part 15463022 · Mar 20, 2017
Continuation In Part 15410845 · Jan 20, 2017
Continuation 15066210 · Mar 10, 2016
Continuation 14205608 · Mar 12, 2014
Continuation 14205973 · Mar 12, 2014
Continuation 14206536 · Mar 12, 2014
Continuation 14206619 · Mar 12, 2014
Continuation 14207833 · Mar 13, 2014
Continuation 14207882 · Mar 13, 2014
Continuation 14208947 · Mar 13, 2014
Continuation 14208182 · Mar 13, 2014
Continuation 14212569 · Mar 14, 2014
Continuation In Part 14321260 · Jul 1, 2014
Continuation In Part 14321000 · Jul 1, 2014
Provisional Application 62481797 · Apr 5, 2017
Provisional Application 61800937 · Mar 15, 2013
Provisional Application 61801335 · Mar 15, 2013
Provisional Application 61801294 · Mar 15, 2013
Related Publication 20180179786A1 · Jun 28, 2018
Cited By (13)
US 12,189,738 US 12,236,734 US 12,312,852 US 12,352,094 US 12,400,507 US 12,442,217 US 12,442,238 US 12,492,591 US 12,500,445 US 12,504,183 US 12,516,561 US 12,560,019 US 12,624,592