Artificial reality triggered by physical object
This disclosure describes an artificial reality system that presents artificial reality content or artificial reality effects based on, or in response to, interactions with one or more physical objects within a physical environment. In one example, this disclosure describes a method that includes determining that a user has performed a trigger action on a trigger object; responsive to determining that the user has performed the trigger action, generating artificial reality content; presenting the artificial reality content on a display associated with a head-mounted display; determining that the user has performed a de-trigger action; and responsive to determining that the user has performed the de-trigger action, discontinuing presentation of the artificial reality content.
1. A system comprising:
an image capture system configured to capture image data representative of a physical environment having a plurality of physical objects including a trigger object, the trigger object being capable of supporting a user in a sitting position;
a head-mounted display (HMD) worn by the user;
a mapping engine configured to determine, based on the image data, a map of the physical environment including the trigger object; and
an application engine configured to:
determine that the user has sat down on the trigger object, and
responsive to determining that the user has sat down on the trigger object, present an artificial reality environment on a display associated with the HMD, wherein to present the artificial reality environment, the application engine is further configured to identify the user and generate artificial reality content based on information about the user.
2. The system of claim 1 , wherein the application engine is further configured to:
recognize a gesture made by the user designating one of the plurality of physical objects as the trigger object; and
store map data associated with the trigger object.
3. The system of claim 1 , wherein the trigger object is a first trigger object, wherein the artificial reality environment is a first artificial reality environment, and wherein the application engine is further configured to:
determine that the user is performing a sitting motion on a second trigger object, and
responsive to determining that the user is performing a sitting motion on the second trigger object, present a second artificial reality environment on a display associated with the HMD.
4. The system of claim 1 , wherein to identify the user, the application engine is further configured to:
identify the user based on biometric information detected by the HMD.
5. The system of claim 1 , wherein to identify the user, the application engine is further configured to:
identify the user based on input detected by the HMD in response to a prompt presented by the HMD.
6. The system of claim 1 , wherein the information about the user includes:
profile information associated with the user.
7. The system of claim 1 , wherein the information about the user includes:
information based on an object possessed by the user.
8. The system of claim 1 , wherein the information about the user includes:
information derived from a calendar maintained by the user.
9. The system of claim 1 , wherein the application engine is further configured to:
determine that the user is no longer sitting on the trigger object; and
cease presentation of the artificial reality environment in response to determining that the user is no longer sitting on the trigger object.
10. The system of claim 1 , wherein to present the artificial reality environment, the application engine is further configured to:
overlay artificial reality content on an image of the physical environment.
11. A method comprising:
capturing, by an artificial reality system, image data representative of a physical environment having a plurality of physical objects including a trigger object, the trigger object being capable of supporting a user in a sitting position;
determining, by the artificial reality system and based on the image data, a map of the physical environment including position information about the trigger object;
determining, by the artificial reality system, that the user is performing a sitting motion on the trigger object, and
responsive to determining that the user is performing a sitting motion on the trigger object, presenting, by the artificial reality system, an artificial reality environment on a display associated with a head-mounted display (HMD), wherein presenting the artificial reality environment includes identifying the user and generating artificial reality content based on information about the user.
12. The method of claim 11 , further comprising:
recognizing, by the artificial reality system, a gesture made by the user designating one of the plurality of physical objects as the trigger object; and
storing, by the artificial reality system, map data associated with the trigger object.
13. The method of claim 11 , wherein the trigger object is a first trigger object, wherein the artificial reality environment is a first artificial reality environment, and wherein the method further comprises:
determining, by the artificial reality system, that the user is performing a sitting motion on a second trigger object, and
responsive to determining that the user is performing a sitting motion on the second trigger object, presenting, by the artificial reality system, a second artificial reality environment on a display associated with the HMD.
14. The method of claim 11 , wherein identifying the user includes:
identifying the user based on biometric information detected by the HMD.
15. The method of claim 11 , wherein identifying the user includes:
identifying the user based on input detected by the HMD in response to a prompt presented by the HMD.
16. The method of claim 11 , wherein the information about the user includes:
profile information associated with the user.
17. The method of claim 11 , wherein the information about the user includes:
information based on an object possessed by the user.
18. A non-transitory computer-readable medium comprising instructions for causing processing circuitry of an artificial reality system to perform operations comprising:
capturing image data representative of a physical environment having a plurality of physical objects including a trigger object, the trigger object being capable of supporting a user in a sitting position;
determining, based on the image data, a map of the physical environment including position information about the trigger object;
determining that the user is performing a sitting motion on the trigger object, and
responsive to determining that the user is performing a sitting motion on the trigger object, presenting an artificial reality environment on a display associated with a head-mounted display, wherein presenting the artificial reality environment includes identifying the user and generating artificial reality content based on information about the user.