Smart home management system for generating augmented reality scene of potentially hazardous condition
Systems and methods are described for identifying, using a sensor, a location of an object in an environment, and determining a classification of the object. A human may be identified in proximity with the object, an identity of the human may be determined, and a determination may be made that a hazardous condition may occur, based on a combination of the location of the object, the classification of the object, and the identity of the human in proximity with the object. In response to determining that the hazardous condition may occur, an augmented reality scene associated with the potentially hazardous condition associated with the object may be generated for presentation, at a user device.
1 . A method comprising:
identifying, using a wearable sensor being worn by a human, an object in an indoor environment, wherein the object is not the human;
determining that a hazardous condition for the human may occur based at least in part on the object being in the indoor environment; and
based at least in part on determining that the hazardous condition for the human may occur:
identifying a physical mitigating object that is not present in the indoor environment by determining that the physical mitigating object, if present in the indoor environment, would decrease a risk of the hazardous condition occurring for the human; and
generating for presentation, at a user device associated with the human, an augmented reality (AR) scene that comprises an AR overlay, over the indoor environment, of:
an indication of the hazardous condition; and
a recommendation for use of the physical mitigating object to decrease the risk of the hazardous condition occurring for the human, wherein the recommendation comprises (a) an identification of the physical mitigating object, and (b) instructions on how the physical mitigating object is to be physically positioned to decrease the risk of the hazardous condition occurring for the human.
2 . The method of claim 1 , wherein:
the human is a first person; and
the AR scene is generated for presentation to a second person.
3 . The method of claim 2 , wherein:
the indoor environment comprises a first room and a second room that is distinct from the first room;
determining that the hazardous condition may occur is further based on the object and the first person being in the first room; and
the AR scene is generated for presentation, at the user device, to the second person in the second room.
4 . The method of claim 1 , further comprising:
determining whether the human is a vulnerable user; and
determining that the hazardous condition may occur is further based on determining the human is a vulnerable user.
5 . The method of claim 1 , wherein determining that the hazardous condition may occur further comprises:
determining that the object is in proximity to an additional object; and
determining that a database stores an indication that the object being in proximity to the additional object is indicative that the hazardous condition may occur, wherein neither the object nor the additional object is a human.
6 . The method of claim 1 , further comprising:
receiving input to mark an object as being associated with a potentially hazardous condition; and
causing a database to store an indication that the marked object is associated with the potentially hazardous condition.
7 . The method of claim 1 , further comprising:
generating a plurality of user profiles, wherein a user profile of the plurality of the user profiles is associated with the user device;
determining a current location in the indoor environment of the user device, wherein the user profile is associated with the human; and
determining that the current location in the indoor environment of the user device is proximate to the object in the indoor environment.
8 . The method of claim 7 , wherein generating for presentation, at the user device, the AR scene further comprises:
activating a camera of the user device based at least in part on determining that the current location in the indoor environment of the user device is proximate to the object in the indoor environment; and
capturing, using the camera, an image of the object, and enhancing the image of the object with an augmented reality effect to generate the AR scene.
9 . The method of claim 1 , wherein:
the object in the indoor environment is intended to be (i) in the indoor environment and (ii) interacted with by the human; and
determining that the hazardous condition for the human may occur is further based on the object being intended to be interacted with by the human.
10 . The method of claim 1 , wherein the AR scene further comprises at least one of installation instructions for the mitigating object or purchase information for the mitigating object.
11 . The method of claim 1 , wherein the mitigating object is configured to decrease the risk of the hazardous condition occurring by contacting and supporting at least a portion of the body of the human when the human is interacting with the object.
12 . The method of claim 1 , wherein the mitigating object is configured to decrease the risk of the hazardous condition occurring by attaching to the object in the indoor environment.
13 . The method of claim 1 , wherein the instructions comprise textual directions on how to physically position the mitigating object.
14 . The method of claim 1 , wherein the AR overlay further comprises an AR scene depicting a potential occurrence of the hazardous condition in the physical mitigating object is not physically placed in the indoor environment according to the recommendation.
15 . The method of claim 1 , wherein the recommendation further comprises an option to purchase the physical mitigating object.
16 . The method of claim 1 , wherein the instructions further comprise a depiction of how to physically position the physical mitigating object, the depiction comprising at least one of an image or a video.
17 . A system comprising:
a wearable sensor; and
control circuitry configured to:
identify, using the wearable sensor, being worn by a human, an object in an indoor environment, wherein the object is not the human;
determine that a hazardous condition for the human may occur based at least in part on the object being in the indoor environment; and
based at least in part on determining that the hazardous condition for the human may occur:
identify a physical mitigating object that is not present in the indoor environment by determining that the physical mitigating object, if present in the indoor environment, would decrease a risk of the hazardous condition occurring for the human; and
generate for presentation, at a user device associated with the human, an augmented reality (AR) scene that comprises an AR overlay, over the indoor environment, of:
as indication of the hazardous condition; and
a recommendation for use of the physical mitigating object to decrease the risk of the hazardous condition occurring for the human, wherein the recommendation comprises (a) an identification of the physical mitigating object, and (b) instructions on how the physical mitigating object is to be physically positioned to decrease the risk of the hazardous condition occurring for the human.
18 . The system of claim 17 , wherein:
the human is a first person;
the AR scene is generated for presentation to a second person;
the indoor environment comprises a first room and a second room that is distinct from the first room;
determining that the hazardous condition may occur is further based on the object and the first person being in the first room; and
the AR scene is generated for presentation, at the user device, to the second person in the second room.
19 . The system of claim 17 , wherein the control circuitry is configured to determine that the hazardous condition may occur by:
determining that the object is in proximity to an additional object; and
determining that a database stores an indication that the object being in proximity to the additional object is indicative that the hazardous condition may occur, wherein neither the object nor the additional object is a human.
20 . The system of claim 17 , wherein the control circuitry is configured to:
receive input to mark an object as being associated with a potentially hazardous condition; and
cause a database to store an indication that the marked object is associated with the potentially hazardous condition.