IP Library Granted Patent US 12,353,178
Granted Patent B2
US 12,353,178 · App. 16/742,494 · Granted Jul 8, 2025

Selecting a level of autonomy

Inventors: Rongbin Lanny Lin (Orem, UT); Brandon Bunker (Highland, UT)
Assignee: Vivint LLC
G05B15/02G06N5/04G05B2219/2642
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,353,178
App. No.
16/742,494
Granted
Jul 8, 2025
Kind
B2
Abstract

Methods and systems are described for selecting a level of autonomy. According to at least one embodiment, a method for selecting a level of autonomy includes determining a first likely condition of a first user of a task and/or building system, selecting a first autonomy level from multiple levels based at least in part on the first likely condition, and making a first decision in the task and/or the building system based on the first autonomy level.

Claims (51)

1. A method for selecting a level of autonomy for a building system, comprising:

determining, by a control unit of the building system, a first user condition associated with a first user of the building system, based at least in part on observations of behavior of the first user by one or more sensors of the building system;

selecting, by the control unit, a first autonomy level from a plurality of autonomy levels based at least in part on the first user condition and a user preference indicated in user input received from the first user prior to determining the first user condition and selecting the first autonomy level, wherein the first autonomy level comprises a level of interaction between the first user and the building system and a first decision;

determining, by the control unit, that an alarm status of one or more devices of the building system is triggered in response to an emergency event;

updating, in response to determining the alarm status of the one or more devices of the building system is triggered, the first user condition to an updated first user condition, the update to the updated first user condition causing the control unit to select an updated first autonomy level without receiving additional input from the first user, wherein the updated first autonomy level comprises an updated level of interaction between the first user and the building system and updated first decision that are different from at least one of the level of interaction between the first user and the building system and/or the first decision;

making, by the control unit and in response to the updated first autonomy level, the updated first decision in the building system based at least in part on the updated first autonomy level;

determining, by the control unit, a second user condition associated with a second user of the building system based at least in part on observations of behavior of the second user by at least one sensor of the one or more sensors of the building system;

selecting, by the control unit, a second autonomy level from the plurality of autonomy levels based at least in part on the second user condition, wherein the second autonomy level comprises a level of interaction between the second user and the building system;

making, by the control unit, a second decision in the building system based at least in part on the second autonomy level, the second decision being different from the first decision; and causing, by the control unit, a task associated with the second decision to be performed by the building system.

2. The method of claim 1 , wherein determining the first user condition comprises:

analyzing one or more satisfaction ratings from the first user about one or more autonomous actions taken by the building system.

3. The method of claim 1 , wherein determining the first user condition comprises:

analyzing a failure of the first user to respond to a recommendation made by the building system.

4. The method of claim 1 , wherein the first decision, the updated first decision, or the second decision comprises activating an alarm, adjusting a climate control setting, opening or closing a window, locking or unlocking a door, adjusting a security parameter, adjusting an energy consumption parameter, checking a status of a door, locating a person or an item, adjusting one or more lighting parameters, adjusting one or more cameras, receiving one or more notifications regarding a current status or anomaly associated with the building system, or any combination thereof.

5. The method of claim 1 , further comprising sending a notification of the second decision to the first user by transmitting the notification to a mobile device of the first user, announcing the notification audibly over a speaker in a vicinity of the first user, presenting the notification on a display of the building system, or any combination thereof.

6. The method of claim 1 , further comprising updating the first user condition based at least in part on an input from the first user, a change in a location of the first user, a detected visitor, one or more recorded observations, or any combination thereof.

7. The method of claim 1 , wherein the building system comprises a climate control system, a lighting system, a security system, a watering system, a door system, or any combination thereof.

8. The method of claim 1 , wherein the first user condition, the updated first user condition, or the second user condition comprises at least one of a user age, a user health, a user medical condition, a user in a detected alarm condition, or any combination thereof.

9. The method of claim 1 , wherein determining the first user condition comprises analyzing historical behavior of the first user to determine a predictive schedule describing occupancy of the building system, the historical behavior comprising a history of user-initiated actions.

10. The method of claim 1 , wherein determining the first user condition, the updated first user condition, or the second user condition is based on an observation about a security preference of one or more other users having at least one similar characteristic with the first or second users.

11. An apparatus for selecting a level of autonomy for a building system, comprising:

a processor;

memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by the processor to:

determine, by a control unit of the building system, a first user condition associated with a first user of the building system, based at least in part on observations of behavior of the first user by one or more sensors of the building system;

select, by the control unit, a first autonomy level from a plurality of autonomy levels based at least in part on the first user condition and a user preference indicated in user input received from the first user prior to determining the first user condition and selecting the first autonomy level, wherein the first autonomy level comprises a level of interaction between the first user and the system and a first decision;

determine, by the control unit, that an alarm status of one or more devices of the building system is triggered in response to an emergency event;

update, in response to determining the alarm status of the one or more devices of the building system is triggered, the first user condition to an updated first user condition, the updating to the updated first user condition causing the control unit to select an updated first autonomy level without receiving additional input from the user, wherein the updated first autonomy level comprises an updated level of interaction between the first user and the building system and updated first decision that are different from at least one of the level of interaction between the first user and the building system and/or the first decision;

make, by the control unit and in response to the updated first autonomy level, the updated first decision in the building system based at least in part on the updated first autonomy level;

determine, by the control unit, a second user condition associated with a second user of the building system based at least in part on observations of behavior of the second user by at least one sensor of the one or more sensors of the building system;

select, by the control unit, a second autonomy level from the plurality of autonomy levels based at least in part on the second user condition, wherein the second user autonomy level comprises a level of interaction between the second user and the building system;

make, by the control unit, a second decision in the building system based at least in part on the second autonomy level, the second being different from the first; and

cause, by the control unit, a task associated with the second decision to be performed by the building system.

12. The apparatus of claim 11 , wherein the first decision, the updated first decision, or the second decision comprises activating an alarm, adjusting a climate control setting, opening or closing a window, locking or unlocking a door, adjusting a security parameter, adjusting an energy consumption parameter, checking a status of a door, locating a person or an item, adjusting one or more lighting parameters, adjusting one or more cameras, receiving one or more notifications regarding a current status or anomaly associated with the building system, or any combination thereof.

13. The apparatus of claim 11 , further comprising sending a notification of the second decision to the first user by transmitting the notification to a mobile device of the first user, announcing the notification audibly over a speaker in a vicinity of the first user, presenting the notification on a display of the building system, or any combination thereof.

14. The apparatus of claim 11 , further comprising updating the first user condition based at least in part on an input from the first user, a change in a location of the first user, a detected visitor, one or more recorded observations, or any combination thereof.

15. The apparatus of claim 11 , wherein the building system comprises a climate control system, a lighting system, a security system, a watering system, a door system, or any combination thereof.

16. The apparatus of claim 11 , wherein the first user condition, the updated first user condition, or the second user condition comprises at least one of a user age, a user health, a user medical condition, a user in a detected alarm condition, or any combination thereof.

17. A non-transitory computer-readable medium storing computer-executable code, the code comprising instructions executable by a processor of a building system of a building to:

determine, by a control unit of the building system, a first user condition associated with a first user of the building system, based at least in part on observations of behavior of the first user by one or more sensors of the building;

select, by the control unit, a first autonomy level from a plurality of autonomy levels based at least in part on the first user condition and a user preference indicated in user input received from the first user prior to determining the first user condition and selecting the first autonomy level, wherein the first autonomy level comprises a level of interaction between the first user and the building system and a first decision;

determine, by the control unit, that an alarm status of one or more devices of the building system is triggered in response to an emergency event;

update, in response to determining the alarm status of the one or more devices is triggered, the first user condition to an updated first user condition, the update to the updated first user condition causing the control unit to select an updated first autonomy level without receiving additional input from the first user, wherein the updated first autonomy level comprises an updated level of interaction between the first user and the building system and updated first decision that are different from at least one of the level of interaction between the first user and the building system and/or the first decision;

make, by the control unit and in response to the updated first autonomy level, the updated first decision in the building system based at least in part on the updated first autonomy level;

determine, by the control unit, a second user condition associated with a second user of the building system based at least in part on observations of behavior of the second user by at least one sensor of the one or more sensors of the building system;

select, by the control unit, a second autonomy level from the plurality of autonomy levels based at least in part on the second user condition, wherein the second autonomy level comprises a level of interaction between the second user and the building system;

make, by the control unit, a second decision in the building system based at least in part on the second autonomy level, the second decision being different from the first decision; and

cause, by the control unit, a task associated with the second decision to be performed by the building system.

18. The non-transitory computer-readable medium of claim 17 , wherein the first decision, the updated first decision, or the second decision comprises activating an alarm, adjusting a climate control setting, opening or closing a window, locking or unlocking a door, adjusting a security parameter, adjusting an energy consumption parameter, checking a status of a door, locating a person or an item, adjusting one or more lighting parameters, adjusting one or more cameras, receiving one or more notifications regarding a current status or anomaly associated with the building system, or any combination thereof.

19. The non-transitory computer-readable medium of claim 17 , further comprising updating the first user condition based at least in part on an input from the first user, a change in a location of the first user, a detected visitor, one or more recorded observations, or any combination thereof.

20. The non-transitory computer-readable medium of claim 17 , wherein the building system comprises a climate control system, a lighting system, a security system, a watering system, a door system, or any combination thereof.

Assignments (6)
AFTER-ACQUIRED INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Feb 27, 2025
From: VIVINT LLC; SMART HOME PROS, INC.; VIVINT AMIGO, INC.
To: DEUTSCHE BANK TRUST COMPANY AMERICAS, AS PRIORITY COLLATERAL TRUSTEE
Reel/Frame 070349/0816 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 067456, FRAME 0729 Recorded Nov 11, 2024
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: VIVINT, INC.
Reel/Frame 069334/0165 →
RELEASE (REEL 057434 / FRAME 0591) Recorded Nov 1, 2024
From: BANK OF AMERICA, N.A.
To: VIVINT LLC (F/K/A VIVINT, INC.)
Reel/Frame 069289/0529 →
PATENT SECURITY AGREEMENT Recorded May 17, 2024
From: VIVINT, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 067456/0729 →
SECURITY AGREEMENT SUPPLEMENT NO. 2 Recorded Jul 12, 2021
From: VIVINT, INC.
To: BANK OF AMERICA, N.A.
Reel/Frame 057434/0591 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2020
From: LIN, RONGBIN LANNY; BUNKER, BRANDON
To: VIVINT, INC.
Reel/Frame 051512/0045 →
Continuity (2)
Continuation 14304678 · Jun 13, 2014
Related Publication 20200225624A1 · Jul 16, 2020
References Cited (84)
US 6654732B1 · Naito · 2003 [cited by examiner]
US 6748343B2 · Alexander et al. · 2004 [cited by applicant]
US 7193644B2 · Carter · 2007 [cited by applicant]
US 7956739B2 · Hong et al. · 2011 [cited by applicant]
US 8139095B2 · Carter · 2012 [cited by applicant]
US 8144183B2 · Carter · 2012 [cited by applicant]
US 8144184B2 · Carter · 2012 [cited by applicant]
US 8154581B2 · Carter · 2012 [cited by applicant]
US 8164614B2 · Carter · 2012 [cited by applicant]
US 9414030B2 · Carter · 2016 [cited by applicant]
US 9432638B2 · Carter · 2016 [cited by applicant]
US 9485478B2 · Carter · 2016 [cited by applicant]
US 9516284B2 · Carter · 2016 [cited by applicant]
US 9648290B2 · Carter · 2017 [cited by applicant]
US 9653323B2 · Chew et al. · 2017 [cited by applicant]
US 10674120B2 · Carter · 2020 [cited by applicant]
US 10986717B1 · Fu et al. · 2021 [cited by applicant]
US 11195398B1 · Fu et al. · 2021 [cited by applicant]
US 11581099B1 · Rufo et al. · 2023 [cited by applicant]
US 20020070859A1 · Gutta et al. · 2002 [cited by applicant]
US 20020086660A1 · Sullivan et al. · 2002 [cited by applicant]
US 20030117280A1 · Prehn · 2003 [cited by applicant]
US 20030118216A1 · Goldberg · 2003 [cited by applicant]
US 20050171645A1 · Oswald et al. · 2005 [cited by applicant]
US 20050176400A1 · Mullet et al. · 2005 [cited by applicant]
US 20050192915A1 · Ahmed et al. · 2005 [cited by applicant]
US 20050281435A1 · Aggarwal · 2005 [cited by applicant]
US 20060041500A1 · Diana et al. · 2006 [cited by applicant]
US 20090048859A1 · McCarthy et al. · 2009 [cited by applicant]
US 20090299825A1 · Olawski et al. · 2009 [cited by applicant]
US 20090299854A1 · Olawski et al. · 2009 [cited by applicant]
US 20100082174A1 · Weaver · 2010 [cited by examiner]
US 20100289643A1 · Trundle · 2010 [cited by examiner]
US 20110054689A1 · Nielsen et al. · 2011 [cited by applicant]
US 20110054973A1 · Deich et al. · 2011 [cited by applicant]
US 20110125329A1 · Oswald · 2011 [cited by applicant]
US 20120023145A1 · Brannon et al. · 2012 [cited by applicant]
US 20120205920A1 · Gold et al. · 2012 [cited by applicant]
US 20120284777A1 · Eugenio et al. · 2012 [cited by applicant]
US 20120316690A1 · Li · 2012 [cited by examiner]
US 20120319597A1 · Park et al. · 2012 [cited by applicant]
US 20130100268A1 · Mihailidis · 2013 [cited by examiner]
US 20140015981A1 · Dietl · 2014 [cited by applicant]
US 20140148952A1 · Paz Lopez et al. · 2014 [cited by applicant]
US 20140266681A1 · Small · 2014 [cited by applicant]
US 20140278028A1 · Nye et al. · 2014 [cited by applicant]
US 20140282048A1 · Shapiro et al. · 2014 [cited by applicant]
US 20140324192A1 · Baskaran · 2014 [cited by examiner]
US 20150039105A1 · Lee · 2015 [cited by examiner]
US 20150088329A1 · Thiruvengada · 2015 [cited by examiner]
US 20150108901A1 · Greene et al. · 2015 [cited by applicant]
US 20150228419A1 · Fadell et al. · 2015 [cited by applicant]
US 20150356859A1 · Hwang · 2015 [cited by examiner]
US 20160142407A1 · Chun et al. · 2016 [cited by applicant]
US 20160261425A1 · Horton et al. · 2016 [cited by applicant]
US 20160274230A1 · Wu et al. · 2016 [cited by applicant]
US 20160350654A1 · Lee et al. · 2016 [cited by applicant]
US 20170262706A1 · Sun et al. · 2017 [cited by applicant]
US 20180035901A1 · Cronin et al. · 2018 [cited by applicant]
US 20180047274A1 · Miwa · 2018 [cited by applicant]
US 20180114420A1 · Siminoff et al. · 2018 [cited by applicant]
US 20180165933A1 · Siminoff · 2018 [cited by applicant]
US 20180189913A1 · Knopp et al. · 2018 [cited by applicant]
US 20180240454A1 · Raj et al. · 2018 [cited by applicant]
US 20180294047A1 · Hosseini et al. · 2018 [cited by applicant]
US 20180341835A1 · Siminoff · 2018 [cited by applicant]
US 20190087646A1 · Goulden et al. · 2019 [cited by applicant]
US 20190108404A1 · Xu · 2019 [cited by applicant]
US 20190156601A1 · Sinha et al. · 2019 [cited by applicant]
US 20190327448A1 · Fu et al. · 2019 [cited by applicant]
US 20200180506A1 · Nakayama et al. · 2020 [cited by applicant]
US 20210056184A1 · Modani et al. · 2021 [cited by applicant]
US 20220165036A1 · Daley et al. · 2022 [cited by applicant]
EP 1006419A1 · 2000 [cited by applicant]
Hossain et al., Adaptive interaction support in ambient-aware environments based on quality of context information Multimed Tools Appl (2013) 67: pp. 409-432 (Year: 2013). [cited by examiner]
Parasuraman et al., “A Model for Types and Levels of Human Interaction with Automation” IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, vol. 30, No. 3, May 2000, pp. 286-297 (Year: 2000). [cited by examiner]
International Search Report for International Application No. PCT/US2015/034067, mailed Oct. 15, 2015, (4 pp.). [cited by applicant]
Supplementary European Search Report for EP Application No. 15806711.6, mailed Dec. 19, 2017 (8 pp.). [cited by applicant]
Desai, M. et al., “Sliding Scale Autonomy and Trust in Human-Robot Interaction”, University of Massachusetts, Lowell, (http://robotics.cs.uml.edu/fileadmin/content/publications/2007/), Mar. 13, 2014, pp. 1-73. [cited by applicant]
Dragoicea et al., “Integrating Agents and Services for Control and Monitoring: Managing Emergencies in Smart Buildings”, University of Politehnica of Bucharest, Department of Automatic Control and Systems (http://www.ac… [cited by applicant]
Parasuraman et al., “A Model for Types and Levels of Human Interaction with Automation”, IEEE Transactions on Systems, Man, and Cybernetics—Part A: Sytems and Humans, vol. 30, No. 3, May 2000, pp. 286-297. [cited by applicant]
Urdiales et al., “A new multi-criteria optimization strategy for shared control in wheelchair assisted navigation” Autonomous Robots, Issue20,2011, pp. 179-197(Year: 2011). [cited by applicant]
Hossain et al., “Adaptive Interaction Support in Ambient-Aware Environments Based on Quality of Context Information” in Multimed tools Appl (2013) 67: pp. 409-432 (Year: 2013). [cited by applicant]
Unboxing The Ring Video Dorrbell is it Worth it video. [cited by applicant]