Triggering presentation of an object based on saliency
In some implementations, a device includes one or more processors and a non-transitory memory. In some implementations, a method includes obtaining an object that includes a plurality of portions including a first portion and a second portion. In some implementations, the method includes determining a first saliency value for the first portion of the object and a second saliency value for the second portion of the object. In some implementations, the method includes triggering presentation of the first portion of the object in accordance with a first display characteristic that is based on the first saliency value and the second portion of the object in accordance with a second display characteristic that is based on the second saliency value.
1. A method comprising:
at a device including one or more processors and a non-transitory memory:
receiving a first user input directed to an object generation environment;
in response to receiving the first user input, generating an object that includes a plurality of portions including a first portion and a second portion;
determining a first saliency value for the first portion of the object and a second saliency value for the second portion of the object;
generating, based on the first and second saliency values, an extended reality (XR) environment object that represents the object, wherein the XR environment object includes a first portion associated with the first portion of the object, and wherein the XR environment object includes a second portion associated with the second portion of the object; and
triggering presentation, within an XR environment, of the first portion of the XR environment object in accordance with a first display characteristic that is based on the first saliency value and the second portion of the XR environment object in accordance with a second display characteristic that is based on the second saliency value.
2. The method of claim 1 , wherein determining the first saliency value comprises determining the first saliency value based on a first characteristic value associated with the first portion of the object; and
wherein determining the second saliency value comprises determining the second saliency value based on a second characteristic value associated with the second portion of the object.
3. The method of claim 1 , wherein the first saliency value is a function of a first amount of resources associated with the first portion of the object and the second saliency value is a function of a second amount of resources associated with the second portion of the object.
4. The method of claim 1 , wherein the first saliency value is a function of a first amount of time associated with generating the first portion of the object and the second saliency value is a function of a second amount of time associated with generating the second portion of the object.
5. The method of claim 1 , wherein the first saliency value is a function of a first amount of computational resources associated with generating the first portion of the object and the second saliency value is a function of a second amount of computational resources associated with generating the second portion of the object.
6. The method of claim 1 , wherein the first saliency value is a function of a first amount of computational resources associated with presenting the first portion of the object and the second saliency value is a function of a second amount of computational resources associated with presenting the second portion of the object.
7. The method of claim 1 , wherein the first saliency value is a function of a first number of polygons in a first portion of a texture map that corresponds to the first portion of the object and the second saliency value is a function of a second number of polygons in a second portion of the texture map that corresponds to the second portion of the object.
8. The method of claim 1 , wherein the first saliency value is a function of a first level of interaction with the first portion of the object and the second saliency value is a function of a second level of interaction with the second portion of the object.
9. The method of claim 1 , wherein the first saliency value is a function of a first number of revisions made to the first portion of the object and the second saliency value is a function of a second number of revisions made to the second portion of the object.
10. The method of claim 1 , wherein the first saliency value is a function of a first gaze duration associated with the first portion of the object and the second saliency value is a function of a second gaze duration associated with the second portion of the object.
11. The method of claim 1 , wherein the first saliency value is a function of a first level of detail associated with the first portion of the object and the second saliency value is a function of a second level of detail associated with the second portion of the object.
12. The method of claim 1 , wherein the first saliency value is a function of a first number of colors associated with the first portion of the object and the second saliency value is a function of a second number of colors associated with the second portion of the object.
13. The method of claim 1 , wherein the first saliency value is a function of a first resolution associated with the first portion of the object and the second saliency value is a function of a second resolution associated with the second portion of the object.
14. The method of claim 1 , wherein the first saliency value is a function of a first amount of movement that the first portion of object is capable of performing and the second saliency value is a function of a second amount of movement that the second portion of the object is capable of performing.
15. The method of claim 1 , wherein determining the first saliency value and the second saliency value comprises obtaining a user input indicative of the first saliency value or the second saliency value.
16. The method of claim 1 , wherein triggering the presentation comprises associating the object with a saliency map that indicates the first saliency value for the first portion of the object and the second saliency value for the second portion of the object.
17. The method of claim 16 , wherein the object includes a plurality of pixels; and
wherein the saliency map includes respective pixel characterization vectors for the plurality of pixels, each pixel characterization vector including a saliency value for a corresponding one of the plurality of pixels.
18. The method of claim 1 , wherein triggering the presentation comprises:
triggering display of the first portion of the object with a first pixel density that is a function of the first saliency value; and
triggering display of the second portion of the object with a second pixel density that is a function of the second saliency value.
19. A device comprising:
one or more processors;
a non-transitory memory; and
one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:
receive a first user input directed to an object generation environment;
in response to receiving the first user input, generate obtain an object that includes a plurality of portions including a first portion and a second portion;
determine a first saliency value for the first portion of the object and a second saliency value for the second portion of the object;
generate, based on the first and second saliency values, an extended reality (XR) environment object that represents the object, wherein the XR environment object includes a first portion associated with the first portion of the object, and wherein the XR environment object includes a second portion associated with the second portion of the object; and
trigger presentation, within an XR environment, of the first portion of the XR environment object in accordance with a first display characteristic that is based on the first saliency value and the second portion of the XR environment object in accordance with a second display characteristic that is based on the second saliency value.
20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device, cause the device to:
receive a first user input directed to an object generation environment;
in response to receiving the first user input, generate an object that includes a plurality of portions including a first portion and a second portion;
determine a first saliency value for the first portion of the object and a second saliency value for the second portion of the object;
generate, based on the first and second saliency values, an extended reality (XR) environment object that represents the object, wherein the XR environment object includes a first portion associated with the first portion of the object, and wherein the XR environment object includes a second portion associated with the second portion of the object; and
trigger presentation, within an XR environment, of the first portion of the XR environment object in accordance with a first display characteristic that is based on the first saliency value and the second portion of the XR environment object in accordance with a second display characteristic that is based on the second saliency value.
21. The method of claim 1 , further comprising receiving a second user input directed to the object generation environment, wherein the second user input specifies a salient portion of the object, and wherein determining the first and second saliency values is based at least in part on the salient portion of the object specified by the second user input.
22. The method of claim 1 , wherein at least one of the first and second display characteristics indicates a display resolution or a display refresh rate.