Context-based application placement
In some implementations, representations of applications are identified, positioned, and configured in a computer generated reality (CGR) environment based on context. The location at which the representation of the application is positioned may be based on the context of the CGR environment. The context may be determined based on non-image data that is separate from image data of the physical environment being captured for the CGR environment. As examples, the non-image data may relate to the user, a user preferences, a user attribute, a user gesture, motion, activity, or interaction, semantics related to user input or an external source of information, the current time, date, or time period, information from another device involved in the CGR, etc.
1. A method comprising:
on a computing device having a processor, memory, and a camera:
obtaining, using the camera, image data of a physical environment;
determining a location on a surface of an object in the physical environment on which to position a representation of an application by:
identifying the object in the physical environment;
determining an object type of the object;
determining that the user is proximate to the object in the physical environment;
identifying a user preference for using the application while the user is proximate to objects of the object type; and
based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference, determining the location to position the representation of the application in accordance with the user preference; and
presenting a computer generated reality (CGR) environment using the image data, wherein the representation of the application is positioned at the location in the CGR environment.
2. The method of claim 1 further comprising selecting the application for inclusion in the CGR environment based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference.
3. The method of claim 1 , wherein the location is further determined based on a user attribute.
4. The method of claim 1 , wherein the location is further determined based on a user gesture, motion, activity, or interaction.
5. The method of claim 1 , wherein the location is further determined based on semantics identified from user input or an external source.
6. The method of claim 1 , wherein the location is further determined based on a current time, current date, or current time period.
7. The method of claim 1 , wherein the the location is further determined based on information from another device involved in the CGR environment at the physical environment.
8. The method of claim 1 , further comprising determining an attribute of the representation of the application based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference.
9. The method of claim 8 , wherein the attribute is a size of the representation, whether the representation is two dimensional or three dimensional, or whether to display an icon or specific content from the application.
10. A system comprising:
a non-transitory computer-readable storage medium; and
one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:
obtaining, using the camera, image data of a physical environment;
determining a location on a surface of an object in the physical environment on which to position a representation of an application by:
identifying the object in the physical environment
determining an object type of the object;
determining that the user is proximate to the object in the physical environment
identifying a user preference for using the application while the user is proximate to objects of the object type; and
based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference, determining the location to position the representation of the application in accordance with the user preference; and
presenting a computer generated reality (CGR) environment using the image data, wherein the representation of the application is positioned at the location in the CGR environment.
11. The system of claim 10 , wherein the operations further comprise selecting the application for inclusion in the CGR environment based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference.
12. The system of claim 10 , wherein the location is further determined based on:
a user preference;
a user attribute;
a user gesture;
a user motion;
a user activity;
or a user interaction with the CGR environment.
13. The system of claim 10 , wherein the location is further determined based on semantics identified from user input or an external source or a current time, current date, or current time period.
14. The system of claim 10 , wherein the location is further determined based on information from another device involved in the CGR environment at the physical environment.
15. The system of claim 10 , wherein the operations further comprise determining an attribute of the representation of the application based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference, wherein the attribute is a size of the representation, whether the representation is two dimensional or three dimensional, or whether to display an icon or specific content from the application.
16. A non-transitory computer-readable storage medium, storing program instructions computer-executable on a computer to perform operations comprising:
a non-transitory computer-readable storage medium; and
one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:
obtaining, using the camera, image data of a physical environment;
determining a location on a surface of an obj ect in the physical environment on which to position a representation of an application by:
identifying the object in the physical environment
determining an object type of the object;
determining that the user is proximate to the object in the physical environment
identifying a user preference for using the application while the user is proximate to objects of the object type; and
based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference, determining the location to position the representation of the application in accordance with the user preference; and
presenting a computer generated reality (CGR) environment using the image data, wherein the representation of the application is positioned at the location in the CGR environment.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the operations further comprise selecting the application for inclusion in the CGR environment based on the user being proximate to the object and the determined object type corresponding to the object type of the user preference.