Dynamic content rendering based on context for AR and assistant systems
In one embodiment, a method includes rendering a first output image comprising one or more augmented-reality (AR) objects for displays of an AR rendering device of an AR system associated with a first user. The method further includes accessing sensor signals associated with the first user. The one or more sensor signals may be captured by sensors of the AR system. The method further includes detecting a change in a context of the first user with respect to a real-world environment based on the sensor signals. The method further includes rendering a second output image comprising the AR objects for the displays of the AR rendering device. One or more of the AR objects may be adapted based on the detected change in the context of the first user.
1 . A method comprising:
rendering, for a display of an augmented-reality (AR) device associated with a user, an output image comprising one or more AR objects, wherein the one or more AR objects comprise a user interface;
detecting a gaze of the user directed towards a first portion of the user interface;
in response to detecting the gaze of the user towards the first portion of the user interface, displaying an indication of a notification on a second portion of the user interface;
receiving, from the user, an interaction with the displayed indication; and
in response to receiving the interaction, performing an operation associated with content associated with the notification.
2 . The method of claim 1 , wherein the user interface comprises a notifications region, and the second portion of the user interface comprises the notifications region.
3 . The method of claim 2 , wherein the notifications region is located at a top portion of a field of view of the user.
4 . The method of claim 2 , wherein the first portion of the user interface comprises the notifications region.
5 . The method of claim 1 , wherein the output image comprises a real-world scene.
6 . The method of claim 2 , wherein the AR device is operating in a glance power state in which the notifications region is displayed relative to a real-world scene.
7 . The method of claim 6 , wherein the output image comprises a first layer and a second layer, the first layer comprises the real-world scene, and the second layer comprises the user interface,
wherein the AR device is operating in a standby power state in which the second layer is hidden by default behind the first layer, and
wherein displaying the notification on the second portion of the user interface comprises displaying the second layer in front of the first layer as an overlay.
8 . The method of claim 1 , wherein the notification is a push notification.
9 . The method of claim 1 , wherein the indication is displayed in further response to an input gesture performed by the user.
10 . A non-transitory computer-readable storage medium embodying software that is operable, when executed, to:
render, for a display of an augmented-reality (AR) device associated with a user, an output image comprising one or more AR objects, wherein the one or more AR objects comprise a user interface;
detect a gaze of the user directed towards a first portion of the user interface;
in response to detecting the gaze of the user towards the first portion of the user interface, display an indication of a notification on a second portion of the user interface;
receive, from the user, an interaction with the displayed indication; and
in response to receiving the interaction, perform an operation associated with content associated with the notification.
11 . The non-transitory computer-readable storage medium of claim 10 , wherein the user interface comprises a notifications region, and the second portion of the user interface comprises the notifications region.
12 . The non-transitory computer-readable storage medium of claim 11 , wherein the first portion of the user interface comprises the notifications region.
13 . The non-transitory computer-readable storage medium of claim 10 ,
wherein the notification is a push notification.
14 . The non-transitory computer-readable storage medium of claim 10 , wherein the indication is displayed in further response to an input gesture performed by the user.
15 . The non-transitory computer-readable storage medium of claim 10 , wherein the output image comprises a real-world scene.
16 . A system comprising: one or more processors; and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the instructions, when executed by the processors, cause the system to:
render, for a display of an augmented-reality (AR) device associated with a user, an output image comprising one or more AR objects, wherein the one or more AR objects comprise a user interface;
detect a gaze of the user directed towards a first portion of the user interface;
in response to detecting the gaze of the user towards the first portion of the user interface, display an indication of a notification on a second portion of the user interface;
receive, from the user, an interaction with the displayed indication; and
in response to receiving the interaction, perform an operation associated with content associated with the notification.
17 . The system of claim 16 , wherein the user interface comprises a notifications region, and the second portion of the user interface comprises the notifications region.
18 . The system of claim 16 , wherein the notification is a push notification.
19 . The system of claim 16 , wherein the indication is displayed in further response to an input gesture performed by the user.
20 . The system of claim 16 , wherein the output image comprises a real-world scene.